Is he being selfish?!?!

Ok, so heres a little back story....im about 17 weeks pregnant and havent been with my child's father since the very beginning now my ex fiancé has found out im pregnant after confessing he wants to be with me and not his current fiancé b/c he isnt happy. But he tells me i dont think i can be with u if u have this mans child (he always wanted that with us) and i want the best for u and dont want u to struggle...is he right for how he feels/says or is he being selfish?!?!