Should I be upset?

KK

So my SO goes out for guys night once a month. He's on a rotating shift and after the end of the 3pm-11pm shift he has been going to Hooters with some co workers. Since Hooters closes at 12pm he then goes to a small bar with his friend (coworker) and is home no later than 2am. I have been fine with that. I trust him. Well the past two times they wanted to go to SilverStar which is 2 hours away in another state! Last month he got home at 4:30am.... this time I told him I didn't like him going and he said he wasn't going if he didn't win a bet he made on a baseball game. Well I wake up at 12 to see if he was home or texted me to tell me he won the bet. Nothing. I woke up at 2 to see if they went to the bars instead. Nothing. I woke up again at almost 6am. I panic because he's never been gone this long. He doesn't answer his phone and his car isn't here. I text him and no answer. Finally I call him again and he sounds weird and I'm so furious I just hang up on him after I hear he is alright and I decline him getting breakfast for me. I heard his guy friends in the background. I just I really don't know what to do. I've got to get ready for work in a few minutes and I am just hurt. I don't know what to say to him or even what to think. I feel like he is lying to me. I don't know what to do. I'm not mad he went. I'm upset that I woke up to get ready for work and he wasn't there and I didn't have a text and honestly I thought he was dead or in the hospital. We aren't married so I wouldn't be notified until his parents decided to let me know and I have no idea if they would let me know or not. And I lost my dad when I was 3 and we have a 10 month old and for that 30 minutes it felt like forever and I kept thinking she wasn't going to have a daddy anymore! And I was just scared.

UPDATE: I know he went to SilverStar last night because he came home with $500 and he had the stamp on him. Also, I do the bills now and have access to his account to pay bills and I know he didn't take out $500. Also it looks extremely straight and new which is what that casinos money looks like. I also called him and when I finally got him his coworkers all told me hey. So I know he went with them. I've also went to check if his car was at the bar a few months ago because he said BWW and I know he doesn't like that place but he meant busmahowards which he told me and his truck was there. So I know he isn't cheating..... also, this isn't a every night thing! This is once a month and I'm okay with them going local that's fine he always asks if I'm okay with him going and I usually say yes. I said no one time and he didn't go that night and he was fine about it.. I'm not okay with him going out of state like he has the past two times to go to a casino ...... I'm also not a gambler it's not fun for me but he is and I don't understand that! We always have money to pay bills. It's not an issue. The only thing I am upset about and want advice for is him not checking in. I don't know how to address it without causing a fight. Thank y'all all for your help so far!