Crying... In Hawaii

So my husband had this business trip in Hawaii and I wasn't coming, but he booked my flight last minute because I'm 31 weeks pregnant and we agreed it will be difficult to travel after I have the baby. Before we get here he told me he would be going out with his friends from work and he didn't want me to be upset about it, I said that I was okay with it, I'm always tired and it wouldn't be far to make him go to the hotel early with me. Anyways, it's been 3 nights and he goes out every night, he does invites me to go with and then around 10pm I come to the hotel bc I'm tired and he only comes around 1 in the morning. That happened Sunday and Tuesday, on Monday I decided I'd stay out with him and I was even having fun but around 11:30 his friends decided to leave ( don't know why) and then we left too. So today is my fourth night here and when he came to the hotel room around 5pm ( he worked all day) I was already sad because last night he came to the room so late again but I was trying to not say anything about it, then he saw me changing and he said something about how big the baby was getting (bc my huge belly) and said that maybe I was eating too much. Of course, I wanted to start crying right away but again I tried to pretend that I was okay with the "joke"... But I couldn't for too long... We meet 2 of his friends at the lobby and went to a sushi place for dinner. I don't even like sushi and he knows, they had steak there and he kept telling me to order steak but I had no appetite I just wanted to cry and leave. I couldn't talk to anyone, it was so akward that when they were done eating ( I just ordered i fruity virgin drink ) he said he would take me to eat something and meet with them later. We came to the room to talk and I was already crying.. He said he wouldn't apolygise for going out because that's how it works and he told me before hand and that I should because I was here instead of home because I wasn't even suppose to come anyways...  I also told him that I'm not feeling very comfortable with my body and that made me sad when he said that maybe I was eating too much.. The whole thing was just a mess. He said he had to leave and meet his friends to smoke cigars and asked if I was coming with, I said no... He just gave me a kiss and told me to call if I change my mind. Now I'm here at the hotel, just crying... And I know he is thinking that he shouldn't had spent the money on my flight and is probably mad about it. Am I so wrong? We do have plans for Friday night and during the day on Saturday ( because his friend leaves on Friday afternoon); and he said I should be grateful for that but I just complain. I just hate being so sensitive... So sad right now :(