Am i the only one who would be upset

So my bf has been hanging out every weekend with his friends. Not that it makes me mad, what makes me mad is he tells me last minute. Today he went hunting, came home said he was going golfing for 9 holes. When I asked him later what hole they were on after he'd been gone for two hours he told me 1 and that they were doing it again. Didn't mention a thing till I asked him. Then he got mad when I got upset and told me he smoked a cigarette which he knows I hate. Its ridiculous. I work nights and he works days so I really only see him on the weekends and anymore I don't. We're going to worlds of fun and he even invited his coworker and wife to go with us. When do I get time with him?