If you trim your yellowing or off color leafs you can't tell what the plants wants or needs. Trim away if thats what you want to do.
If your new growth starts yellowing or looking unhealthy or a large portion of the plant is having problems then i would certainly never suggesting cutting them off to resolve the problem.
I'm just talking about older leaves which start to go yellow and dry. I'm just saying trimming a few fan leaves has never caused me any problems (at least not any that i noticed) and that there is debate about it. Maybe there shouldn't be and the debate is fueled by misinformed people who just say what they think makes sense without actually having any experience or evidence to back it up. I try and avoid speculating like that, but i can only speak from my own experience.
By the way, when i said i think you were wrong - i was specifically referring to you saying that there was no debate. Probably should have made that clear earlier.