Painting near plants?

I'm building a permenant home for my garden, right next to the shady "panda plastic on a frame" structure its living in now. The new room needs to be painted, but the passive air intake in right next to where we will be painting. There are not any windows, just a door to blow the fumes upstairs. Its only 6x6 so it shouldn't take more then a few hours. I'm thinking moving the plants to another floor, but it seems like your asking for bugs and other problems by moving them to a completely foreign environment this late in their life cycle. Anyone have problems painting near their rooms?

I have used paint from home depot in a sealed room and it did not have any significant effect on the plants. Flat white latex water based paint. Get the stuff that says low fumes.