Experienced and dating a virgin

So I've been sexually active for about 3 years now (I'm 19) and I've been seeing someone who is a virgin (He's 18). I know sex isn't all a relationship is, but I'm very confident and comfortable with my sexuality and I know what I like. We've messed around a little bit and each time he's told me he isn't ready, which I'm totally cool with and respected his boundaries so we stopped. I'm just in kind of a weird place right now because I like him and I enjoy spending time with him, but if we end up not being compatible sexually i don't think I could continue that relationship. Am I an asshole for thinking this is really what I'm asking here