I grow a lot of things, especially a wide variety of peppers. Many herbs are great companion plants outdoors as well. A lot of great plants and flowers can help keep away pests and attract predators. My biggest trouble I ever had was in my greenhouse last year when someone else continually and intentionally kept bringing aphids in there. As a result I declared war and began killing them. That someone else was carpenter ants. They love aphid's shit so much that they will carry them to plants and even milk them. Oddly enough they went straight for tomatoes and not cannabis or anything else but my tomatoes had a rough time. The downside of all organic is when you do have a problem it's harder to deal with. Albeit this year I planted catnip all around the greenhouse.
I didn't have the problem but I did attract cats.
Have you ever considered planting “trap crops” as bait for insects? Some pests like certain plants, and will gravitate towards them first - like marigolds, peonies, and other plants. Others, like alliums, help repel insects. Try planting a bunch of garlic cloves or chives around your garden, and stuff like marigolds. It’s a pesticide free option, and you can save seeds for each of these, and continue to grow them perpetually, for free. Bonus, the one you can eat helps keep vampires away, and the other is pretty and will flower hard until frost.