regretting vacation

We have an 8 month old and planned a vacation a year ago. Found out this past weekend he has sent a woman texts at 2 am telling her how great she is. I confronted him and he's apologetic but says nothing happened, this is while he's traveling for work in another state with her while I'm home with our baby. He continues to tell me how awesome she is and he really wants to keep her as a friend. We are suppose to leave at 3 am for our trip and I'm contemplating telling him I'm not going. We would be out $4,000 but at this point I don't care to spend a week away from my baby to be with him.