Should I lose my virginity?

What is sex like, emotionally? I've been with my boyfriend on and off for 3 years now. We've only really been sexually active through oral sex but I haven't felt ready to officially lose my virginity to him, only because I don't want to regret losing it to the wrong person. I know a lot of people say that if you love each other, you should just do it but I've been too scared because my boyfriend and I reach a point where things aren't always easy (jealousy, emotional cheating, etc) and we ended up separating but, somehow we always find each other back together again. Right now, we've been the most stable, more transparent to each other. But I still have doubts. I told him how I felt, he understands and he's willing to be patient with me. It's been really tempting but I don't know if I should just wait.