Transgender people and bathroom issues

I am honestly undecided on the issue myself, but going around and being rude and practically a bully on the issue is not helpful in the least.

I as a woman, have walked into men's bathrooms and used them when the womens restroom had lines a mile long, and alot of them have locks on the door(gas stations, etc) and guess what, no one ran me out, tried to look in the stall or raped me. Alot of places also have family bathrooms already, so if its that much of a concern, let all places set up such.

Also, the worry of perverts and child molesters, its a scary idea, but It has never stopped them before, I've seen creepers who are clearly men go into whichever bathroom they choose. Men going into womans bathrooms, etc. But if thats the true concern, should bathrooms also have a separate bathroom for peoples sexual orientation? Lesbian bathrooms, Gay men bathrooms, Bi Sexual Bathrooms? We've not seen abunch of issues from woman attacking woman in bathrooms, or Men attacking men in bathrooms?

So is this really an issue, or just an issue of comfort levels?

Also, cetrain places have unisex bathrooms, and I've not known of an excessive amount of issues from that.

I believe bathrooms should have full doors and no way to be seen into the stall, that should be pretty effective in the matter.