Husband working in another state doesn’t want me to visit with our daughter

I’m going to try to keep this as short as possible, I just want others opinions if I’m right to be upset.

My husband lives/works in another state and usually comes home every 2nd or 3rd weekend to spend some time with us, I only go about 3 times a year to visit him with our toddler for a week or so.

I booked a flight for my daughter and I to visit him next week 2 month ago, because she’s off preschool for 2 days next week (and I don’t like to lose money), we’re supposed to stay Wed afternoon -Mon morning. Yesterday he told me I should cancel the flight because he’s really busy at work and he doesn’t know how much time he can actually spend with us, so I checked the change/cancellation fees, and I would basically lose all the money. So today I told him we’re still going, it’s fine if he has to work Thursday and Friday, at least we’re going to be able to spend some time together on the weekend. He then told me that he already has plans with friends Thursday night and he’s invited to a party on Saturday, so he really wouldn’t have time for us and it’s better if we lose the money than me sitting in his apartment waiting for him. I got really upset and told him that his priorities are really messed up, and he knew all the time that we were coming so he shouldn’t have made any commitments with someone else. I totally understand the work part, but not the hanging out with friends while we’re there. He told me that I’m being a bitch and hung up on me.

How do you feel about this? Am I wrong to be upset? I’ve been really looking forward to some time with him, if I don’t see him next week I won’t see him until the end of October (almost 4 weeks since we have last seen each other), aside from losing all the money 😕