Yes unless you are a sealed enriched environment you want as much fresh air as possible. The down side to this is if you are pulling the air from directly outside, you will be risking bugs, and temp swings that happen outside. I prefer to intake from my house, then exhaust to outside. You will lose efficiency in your house for heating/cooling, typically not enough to notice, and you will bring "fresh" air in through all the little gaps in the house.