Automatically LGBT+ because of rainbow?!

My dad is very phobic to the LGBT+ community. I really hate being around him when anything of that nature is discussed or seen or anything because I support the communities. I am also still trying to come to terms with myself that it's very likely that I am bisexual. I will NEVER tell my family this. But my 8 year old sister and I bought matching rainbow sock today because they are just adorable. He got pissed and said we aren't allowed to have them (I am 20, he can't tell me, but he can tell my sister)because that means we are gay or support them. I just wanted to punch him so hard. Yeah, it is part of that community, but rainbows were around WAY before it represented the communities. You don't have to be part of or support them communities to wear or have to do with the rainbow. Ugh, I'm just so sick of him and his shit.