Is your fan an occolating fan or an high turnbine fan? I keep my exaust fan on 24/7 because when lights on they are 22degrees and when lights off they drop to 19 degrees. Perfect for me.. But if it gets to cold, keep fan off when lights off... I like it on becuase it keeps air pulling into my basement from all the cracks in the house, and it turns my air in fan by convectional pull.
If its your air in, and temp is cold out (depending were u live) time your air in when lights are on, and turn off when lighs are off!! good luck