I grow outdoors in a small backyard with two neighbors attached to me and a walkway path 15 feet behind my house, along with a community pool about 30 feet behind.
The good news is, my house faces south and the plant gets direct sunlight from 5;30 am to about 8;30 pm, and the plants are up against my house wall so they cant see it from there upstairs window, cant see over the backyard fence from the pathway either.
I personally feel very secure with how they are but i'm not sure how big the odor is gonna play an effect. My backyard is also nicely done up with lots of plants and a custom home-made outdoor pond so it blends in pretty well.