I feel so sad about my husband

Ever since I’ve had our daughter 10 weeks ago he has slowly went downhill. The first 6 weeks he helped around the house and was a great father to both his step son and our daughter. But ever since she started getting fussy he only handles her for small amounts of time and immediately gives her to me when she begins to fuss.m (even if I’m in the shower he will bring her to me telling me she needs me). Now she is 10 weeks and he seems just not to care about the whole family life. He is Switching jobs and going to work at this place that has swing shift so he will be away for 2 weeks at night, knowing how hard it’s going to be on me with a 5 year old and a 2 month old at night while I’ve worked a full time job. He also is constantly on his phone 247 when he is home. On the phone with one of the guys that he’s going to work with at this new place. ( whom of which I don’t like because he is unfaithful to his wife and anytime the guy comes over he tells my husband that I make google eyes at him and tries to start shit.) I have expressed to my husband I don’t want him hanging out with him all the time after work when he starts the new job and he told me that he was going to go to the gym 3x week with him after work and then get beers after work sometimes. Am I wrong for feeling some type of way right now? I’m not trying to be childish but I just want my husband to want to be home with us and help me 😩