What about Chinese or Hispanic?
Can they say it?
The word should either be off limits or not. Personally I think just because of the office Obama holds its wrongful to call him that.
Office aside, I know your point is essentially the reality we live in. But that doesn't make it right.