You need to be sure to water FULLY when you do water, and to dry out almost entirely between waterings. Water slowly, and until water JUST starts to seep out of the bottom of the pot. Then you dont need to water again until soil is dry a good 2inches or more down (depending on pot size)
If your top is wet, and the bottom is dry, your not watering fully. What happens when you dont water fully, is you constantly have to give water near the top, which can cause stagnation and rot, as well as a shallow root system.
You dont want the soil to always be wet, the plant needs the wet>dry>wet>dry cycle in order to properly grow