and as such I don't really give a fuck who uses the men's bathroom.

As long as women aren't freaked out over a person with a penis using their facilities I think the men should stay out of the discussion. I will add I had a GF many years ago who had a "girl friend" who she went shopping with, drinking with, occasionally fell asleep in the same bed with, who was born a male and still had male genitalia, IOW a dick. It never bothered me a bit that they would often share a restroom, bed or dressing room. The thought of them engaging in sex together was downright laughable, and why else would I object to "girlfriends" doing "girlfriend" things together?

With the exception of hookers, who have the right to as racist, sexist, ageist etc as they want where it comes to who is allowed inside their bodies, I most definitely do NOT support any other business owner's "right" to refuse service due to bigotry.