I feel like I’m going to ruin my marriage

Last week my friend came to stay with my husband and I. Her and my husband have a special bond over anime which is whatever. I’m not a fan of it but u try to not make a big deal about it. My friend at one point said something bout crying in the middle of the night because she was so sad about something that happened and my husband said “oh you should have texted me and I would have helped you through it” well that pissed me right off. I found the comment really inappropriate. At no point would I encourage a man to text me in the middle of the night. I talked to my friend about it, and she said well if you can’t trust him with me then who can you trust him with. And now I’m annoyed with her too. My husband and I talked about it later and he said that he felt like my opinion was stronger than it needed to be because I did have an ex who tried to sleep with her in college. He did say that because I thought it was a problem for him to text other women (which he was not doing before) then it’s something that will be off limits for him since he knows I’m not comfortable with it. But I’m now getting to the point where I’m feeling like I’m having to watch him and how he’s interacting with women in other spaces because who knows what else he could think is okay that’s inappropriate and I’m not feeling really comfortable in our marriage. I don’t know how to navigate this going forward