was this wrong of him?

I remember one instance of my ex I didn’t want to have sex or do anything sexual, I just wanted to be with him, and told him we would do it later that night. it was the middle of the day. he got mad and pouty and said he was going to take a nap then and didn’t talk to me. I felt guilty so I pretended like I changed my mind and had sex with him. and then I never said no to anything after that again even if I didn’t want to because i didn’t ever want him to be upset with me. and this is the guy I still cry over everyday.....over a month later. and he used to BEG me to go three rounds when I said no multiple times.