I need some opinions here because I just might be crazy..

What gets me upset is that he goes out on weekdays such as last night, and he didn't come home until 4am like to me that isn't okay it's a fucking weekday and you have work in a few hours?! So it concerns me that maybe I'm just being a little crazy and I HAVE talked to him about why this upsets me because it's something that is JUST ASKING for a woman to start wondering. And he goes out quite often practically every week.. sometimes I just feel as if he doesn't want to spend time with me. Also to be completely honest I don't have many friends that are women because I work in aviation and well it's mostly men here at my company, so please help me am I exaggerating???