I'm scared to have sex with my boyfriend.

This is the first boy I've dated that has actually treated me well, who hasn't been manipulative or overwhelming. He's literally everything I could have asked for in a significant other. The thing I'm nervous about though is that the last time I thought I was in love with someone, and had sex, they dumped me the next day. I really don't want to lose this one. I'm not letting myself getting reliant obviously, I'm pretty independent, but I really do think I love him. I know that I want to do it with him some day, but I'm scared of him leaving directly afterwards. Should I be scared or is this a dumb fear?