Doubts

I really like this guy but I am really really tall and he's shorter than me. I don't care at all plus it's not a big difference but all my friends keep telling me he wouldn't ever want to be with me because he'll feel like I'm 'the man' of the relationship. I don't think he's anything like this but they have made me doubt myself. Any opinions?