I just bought a budget RPK(?) extractor fan that came with a budget filtration kit. I cut a hole in the celing of a cupboard and shoved it in the attic. They make noise, but not that much. That was with a 600w hps so i could have gotten away with a far quieter fan if i'd either spent money or not tried to grown as much as i could as opposed to a plant or two.
And you said it, loner. Without space to hide things away (i grew in a cupboard 1 foot from my pillow) it meant that for 3 years i've not been able to have someone in my bedroom let alone a girl in my bed, it seriously cripples your social scene. If you have a spare room to have it in though, it shouldn't have too much of an impact, just gotta find reason for people not to want to venture in, like making it clear (say by keeping the door open) that it is a room for nothing but storage etc, boxes everywhere etc, nothing too wrong with that. In my case i just made sure to have a computer on anytime someone visited, that overwhelmed the grow noise should they for some reason stik their head into my bedroom.