you dont look like your soil has any perlite. it looks like it holds water for a good few days.
i personally think they are doing fine, if they are outside permanently then of course bugs will get them.
doesnt look like spidermite to me as you dont have enough white spots, but you can clearly see bugs have been munching. if you dont know what bugs, get some neem and go to town.
its you or the bugs my friend!!
this is war!!!!