Am I wrong to feel this way?

So my baby girl made her appearance a week ago and my boyfriend was with us the whole time and he has helped me with her with everything throughout this whole week. Tomorrow he goes back to work so I told him to go play basketball (his hobbie) and he looked at me shocked that I was allowing him to go. I felt like he should get out of the house for a little bit since we've been cooped up in the house. Well he comes back home and says his friends want to play poker at 8 and I was kinda mad that he even like suggested to go because we just had our daughter and before he goes to work he should spend as much time with our daughter since he works 12 hr shifts. Well he knew I was mad about it but I told him he could go because I shouldn't have to tell him not to go. It should be out of his heart to spend as much time with her. But I feel like I'm overreacting about this and it's now 12 and he's still not home