Upset because of masturbation

So my fiancé and I are actively ttc and I’m at my fertile window. I won’t ovulate until tomorrow or so but still baby dancing. We did it Sunday and didn’t on Monday. We were supposed to bd today but when I woke up he was coming out of the restroom looking guilty. He has masturbated and I was so upset. I feel like he sometime can’t control his urges to masturbate like a teenager. We’re ttc so it bugs me but I also know that it’s his body and I can’t control what he wants to do. Should I really be upset about this or just let it go?