Yo! Larva-like worms inbedded in my bud! Aug 19th

I've got some outdoor plants two weeks into solid bud growth. When I examined closely (with a magnifying glass) I found some dark brown egg/shit little balls and figured something like a worm was probably in there wreaking havoc. Sure enough, found little maggot looking larvae/worms chewing away, one even manage to break through the soft membrane under a soft stem and ate a hole into a larger stem (though not the main!). Still, I'd hate to chop off if I can avoid it. I've done some surgery on it and removed all the worms I could find with a toothpick and tweezers, got most of the egg or whatever fecal matter it might be out of there as well.

Should I be considering some kind of spray two weeks into budding? I'd like to nip this potential threat in the bud (pun intended, I guess) if need be.

From reading around it seems that what I have is likely the result of moths laying eggs in the soft bud and my larva guest(s) are starting their existence in a pretty remarkable place but probably doing lots of damage to my plant! My greater worry is not only what they will eat as they develop but how their shit might rot and trigger mold and fuck up the whole section or plant as a whole.

Advice?

Sounds like it could either be beetle borers or cabbage maggots. The beetle larvae bore into stems, and if they get into the main stem fluid flow could stop, causing death. They look like grubs or maggots.

Cabbage maggots are about .3 inches long, and turn into small flies. If you see flies smaller than house flies that's probably it. You could have significant root damage. Neem oil might help, but you mostly need to pick them off my hand. You can make a liquid solution of neem to get to the roots if you think it's needed