CONFESSION: I'm a VIRGIN and I'll be 22 in January

Of course there has been moments were I could of has sex but I wasn't ready at the time. And there was the time when I wanted too but I knew the guy just wanted to have sex and not a relationship and that's not what I am looking for. I've talked to a few guys who wouldn't even date me because "a virgin is a lot to handle". Their words not mine, all 4 of them basically said that my virginity is a burden to them. Recently at work my coworkers and I were all talking and this guy brought up another guy that works there and how he's 31 and a virgin and they all started talking shit and making fun of him. A friend told me that I should just go to a bar and go home with a random guy but that's just not me, you know. Should I be ashamed that I'm still a virgin?

There is also this guy I'm talking to, all my friends think I'm crazy because he is in his late 30s and has an 7 yr old. But when I'm near him I want to know everything about him and I want him to know everything about me. He makes me happy. I haven't told him that I'm a virgin I'm afraid of his reaction, this time it'll be hard to brush off. Am I crazy?