Boyfriend troubles :(

So I've been with my boyfriend for just over 2 months now and I'm 17 he's 18. I don't always feel happy when I'm around him and he irritates me more often than not. I feel like I'm being such a bitch and really selfish by not breaking up with him but there are also those times when we are intimate I think the world of him and can honestly say that I really love him but other than those moments, and by moments I mostly mean sex ahah, I just feel so unhappy being with him. I can't even consider breaking up with him though because I feel so bad because I can tell he's become really attached to me. He's my first boyfriend but I already know he will not be the last. I wanna get out there in the whole sex world so to say but then again I also know I'm going to regret leaving and will want him back because I know he actually loves me and what if I never find that again!? I know I need to make up my mind about what it is that I actually want but if anyone has some advise on how to make my mind up please share! Xx