Bare with me because this is long.

Back story:

So my daughter is 10 weeks old and I've been battling post partum depression. My SO works 12-16 hour days 4 days a week and picks up a fifth shift. I guess we've been fighting way more and he said he hates how I talk to him. I've acknowledged that I sometimes cross lines when I'm very upset. We separated but have been working on things and still live together. I told him I don't feel wanted or attractive since having my daughter. When I told him I don't feel wanted he responded with "your not". Well he acknowledged that he shouldn't have said it since he loves me and I am wanted. He has said part of what makes him unhappy in the relationship is that I don't want to have sex a lot. Well after having my daughter I was waiting until I was on birth control just to make sure I don't just rely on condoms. So we had sex a couple days ago. I am ready to be more intimate now that I have my birth control. So after having sex, the next night we were planning on having a few drinks, sitting down and talking about us and I asked if he'd want to have sex. He said yeah. About 9:45 at night he tells me his friend wanted to go to the casino and he'd pay him gas money so he wanted to go to the casino. I told him I'm not happy about it but I won't control you. He said he'd only be gone a couple hours and have just 1 or 2 beers. He left at 10 and still wasn't home at 3 in the morning. I called and called but his phone went right to voicemail. I sat and waited for a long time and by 9 the next morning he still wasn't home but I found out he never took the car. He had it parked on the street but parked farther back so it was more so park in front of our neighbors. He got home at 5 at night... So he was gone about 19 hours. I ask him where he was and he said he got too drunk and got a hotel room. When I asked his friend if he knew where he was when he was gone for all that time he NEVER told me he was at a hotel even though he was supposed to be with him. He had the charge to his checking account for the room. I said why didn't you call me to let me know what was going on, he replied that his phone was dead.. Hotel rooms have phones and he knows my number by heart. He said he was so drunk and tired that he didnt really think about it. But he still didnt call me when he woke up. He said he had uber drive him to the casino and home. He didnt text me at all while at the casino. He thinks I'm ridiculous for thinking he was there with another woman. Especially since he blew me off to go to the casino even though he knew we were going to work on us and have sex... Also when he got dropped off at the house he wasn't dropped off in front of the house... He didnt want sex last night either. This is 2 nights in a row that he hasn't been interested in having sex. Am I crazy for thinking he got a hotel to be with another woman?