the dehumidifier in the grow room is used to keep the rh about 70% when vegging and about 50% when flowering, 30% the last week for sticky stuff, 40-45% is needed for a drying room, if the outside air is 60% and your growroom is around 60% or above with a fan running that is normal, the only way around this is to use a dehumidifier switched to full power connected through a stand alone digital humidistat connected to your fans, for instance when flowering, when your room reaches 48% humidity the humidistat cuts the dehumidifier and turns on the fans, when the room reaches 52% the humidistat cuts off the fans and turns on the dehumidifier this is a constant effect. maintaining temperature with the fans and humidity with the dehumidifier.
dehumidifiers are made for closed areas, when you turn your fan on its just like opening a window.
here is a humidistat on ebay :
http://www.ebay.co.uk/itm/DIGITAL-HUMIDITY-STAT-HUMIDIFYING-DEHUMIDIFYING-P1-/230615646425?pt=UK_Home_Garden_Hearing_Cooling_Air&hash=item35b1c380d9
(these humidistats are normally used with both a humidifier and dehumidifier maintaining humidity at a constant rate anywhere on the planet)
and are 240 volts.
when people have your problem in a house they buy air conditioning systems that have built in dehumidifiers that work together.
which is harder to maintain on a small scale.
the only other way round it is to dry the air in a large bedroom to say 45% with a large dehumidifier and suck that air in to your growroom with your fan expelling it outside at say 55% maintaining the growroom at 50%, a dehumidifier will not heat a large room.
i use one in my large growroom and the 6" fans are on constantly, i had to buy a bigger dehumidifier to maintain my 48-52% flowering humidity a smaller one before this had the same problem as you, as we get a lot of rain and damp in winter outside where i live.
i have 10 plants only just now, but that is 20 litres of nutrient water being poured in there and some of it evaporating every 2 days as well as the outside air being 55% and i suck the air in from the rest of the house as it is a little drier before it gets to my inlet fan.
when i dry my buds for 5 days i turn the outside fans off, reduce the humidity to 40% and use 2 oscillating fans and open the growroom door once a day to empty the dehumidifier.