So, I do. & I know what they say.
I'm in a small greenhouse, so this time of year, things get tight. The plants are close together. The canopies get thick. Airflow gets seriously restricted.
So I defoliate. Ive found on years that I don't take those big fans & small leggy branches... They wilt & mold becomes a problem.
Instead of waiting for things to go wrong, I'm proactive. I lollipop, defoliate & stake branches apart for better airflow. & I feel like I loose less to mold & my plants are healthier. Smaller buds?? Maybe.
But if rather smaller & healthier than chop for mold.
Its Really up to you, experiment with 1 plant. See what works for you.
Also, I think its worth adding, it depends also on where you are, & what you're climate is like. I'm in New England. Fall here isn't very dry.