I do it when I have company who's proficiency with firearms i don't know and therefore am uncomfortable with. I want a firearm available when I need/want it. If I locked them all up and was sitting in the front room watching a movie or entertaining, I would have to recognize the potential threat, go to the safe, unlock it, secure my firearm, then engage said threat. I personally know two people who have been home invaded. Both had guns. Neither had one immediately available to them. They both lost their guns and much more even though they were locked up. One happened while he was mowing his lawn.
So, yes, I carry one on me at home sometimes. Is that not being responsible? Tbh, when I have company and carry a handgun, its purpose is to allow me to get to my shotgun.
I have had only two guests get all sketchy on me about me carrying a gun in my own home. They were both told that this is how it works in my home and they are free to leave if they wish. After honest discussion, neither one left and both now own their own firearms.
May not be your choice, but it IS mine.