Am I wrong?

So my fiancé and I were making out and stuff and then my phone went off and it was my mother and she has our 5 month old so of course I stop and text her back to see if everything was okay. She was texting me while he and I were doing the do and after he said it wasn’t attractive how I replied but I was worried about our kid. He’s upset with me now bc I didn’t apologize in time and it just blew up to this whole ugly fight. This isn’t the first time he’s said something I did was unattractive dealing with sex. I’m currently crying bc I feel this is all my fault.