Freaked out during sex

So a few months ago I was seriously pressured into having sex, to the point where I didn't really give consent. I thought I was over it. But now I have been dating this guy and I am sooo into him. But last night we started having sex and I freaked out. He was amazing, stopped straight away and was so sweet. We had sex when I relaxed much later. But I am still nervous that i will do this again. Was just looking for some advice, because I really like him.