need answers soon

So I've been dating my boyfriend for a year and a half almost now. We have been having sex for a year in the relationship but 2 months ago I said I wanted to stop because I want to wait till marriage now, yes, I know it doesn't make sense but I felt guilty and idk why. He is annoyed that I made this decision and I feel like it's ruining the relationship because there's been more fights recently but I still really really want to have sex with him, I love him a lot just feel guilty. I know it's wrong to do this to him but so you guys think I should have sex with him, or is it wrong?