The outdoor game can definitely be cruel. I've dealt with mold, powdery, etc.
But it all years outdoors I've never seen damage shown in those pictures to be anything other than caterpillar damage. Their favorite spot to hide is main stem, where flowers develop. You get that fur, stem damage...