Do I have an issue or something ?

So I think I'm kind of having a problem.. Every once in a while I'll really think about how I want physical contact with a male like hugging or just anything honestly, but when it actually comes to them showing interest in me whether it be romantic or just regular, I get really terrified. I'm an only child and I live with my mom. I don't want to come to any conclusions, but she has dated a bit with me around and I guess you could say I know how messed up the people of the world can be sometimes. I guess I'm wondering if I'm scared of men or something? At the same time though, I always sit at home and want a male to hug or comfort me which completely contradicts myself. It could also be my social anxiety though, but that also seems a lot worse around men.