Stay or go ?

Currently I'm 12 weeks pregnant with my first I'm 34 the baby dad is 40 also his first. We live in different states and have been rocky in our relationship as of late but he asked me to come visit and I'm thinking this is a step in the right direction. But then he tells me yesterday that he is going to spend the weekend with his friend Teal so he can buy one of her horses and visit her friends ranch for a possible job in the future. And I'm not allowed to go. Back story, I've never met her or talked to her I've wanted to asked to. They dated after his divorce timing or whatever it didnt work. She is married but hes gone all the time and james and teal talk sun up to sun down he knows how uncomfortable that is for me also. But he says hes going matter what and I'm not going. That him and teal talked and its inappropriate that I do. I want our relationship to work for our little girl. I'm I over reacting should I stay should I go ? I feel disrespected and hurt.