BABY TRAPPED?!

So my boyfriend and I are currently pregnant with our first child.... I’m beyond happy no issues at all. But my boyfriend and I got into an argument 2 days ago because I got a call from a random number and I answered and it was this guy that I use to date when I was single .... keep in mind I haven’t seen or heard from this guy in YEARSSSSSSS... so I was really shocked. So the guy called me to say if we could meet up and that I was “the one that got away” and that he wishes he could see me again.... and i basically explained to him (with my boyfriend next to me) that I was taken & that I was engaged and that I was 5 months pregnant as well.... anyways we ended the call and my boyfriend got upset that I was giving in to his questions so easily that i should have just told him “I’m engaged and pregnant goodbye leave me alone.” So I tried to explain myself but this was his response “well you know what at the end of the day you can do you.... do whatever you want.” That seriously triggered me! I got so upset that I told him “so I can go meet up with him and it doesn’t matter ? So what your telling me is that I’m single?” And he said “do whatever you want.” I got so heated that I had to step out and walk for a bit.... 5 mins later he comes outside and asked “what happened ?” And I told him I was upset because of what he said.... he said I was taking it too seriously & that he was upset that I was giving such importance to something so minimal .... and i said “well you saying that you don’t care what I do makes it seem like you actually don’t care and i can go have sex with this guy and it’s not gonna matter too you! Like wtf ? So I can go suck this guys dick and it’s okay? Is that what your trying to tell me?” And he said no.... this is where I got kinda mind fucked HE SAID “no that’s why I got you pregnant because I know your not that type of girl! I know you would never do that to me.” Has someone ever been in this type of situation ? Wouldn’t you feel kinda weird ? Like baby trapped on purpose ?