Can you provide a picture please? I'm having troubles picturing your screw in caps....I ask because the answer to your question is dependent on your situation. (Is it going to be under water constantly or just splashed occasionally? What types of plastic? What sort of water pressure do you have to fight?)
I use GE Silcone in a caulk gun, any home depot will have it. I seal my fence posts with it and glue the end caps on. It holds well and you can cut it off and sand it down if necessary.
I've used aquarium glue before to seal holes for tubing ports on the bottom of my DWC units. I probably wouldn't do it again, I've had leaks...instead I use decent bulk heads and that silcone.