I think I fucked up my relationship

I honestly feel awful. This is my first boyfriend and I think I have ruined everything. I was never allowed to date. My mother was extremely religious and I wasn't even really allowed to talk to the opposite sex. We met online and have hit it off and been together 10 beautiful months. We are both 21 and he said he can see himself marrying me and having a family. I ruined everything. We had sex for the first time yesterday. A few hours after we were cuddling and watching a movie. He told me he was always scared to be vulnerable. Both emotionally and sexually. That I'm the first person he's been vulnerable with. He told me he never told anyone this but when he was 18 he was raped by a much older man who he was vulnerable with and thought was his friend. We had a long silence and I without thinking said "Well at least you've walked the shoes of a woman." I don't know why I said that. I really don't. Earlier that day we had talked about why I don't like walking places alone at night and that I have been sexually harassed and being a woman is scary. Maybe that came back to me. I don't know. I know it upset him and he left and I've texted him a couple times saying Hey but he hasn't replied back. I think I ruined everything. I need the right words to fix this😞😞😞😞