If it's an outhouse with electricity then insulate it and maybe run an electric oil filled space radiator on a timer.
Could do similar if it were to be a spare room in the house
Could maybe put your fan on a timer , whereby it runs for 20 minutes and goes off for 5, allowing for the room to...