Sounds similar to my worm farm. I had a problem with soldier fly larvae, there were thousands of the bastards, although yours sound too small for them, it could be some kind of larvae attracted to rotting food.
The only way I could get rid of them was to stop putting food in there, I put only 1...