Advice pretty please!

So it's a long story. My son is 9 months old. At 3 months old his father and I broke up because he wasn't getting his shit together. Well I then began dating a man who is just amazing. He loves my son and he loves me. Well we broke up for idk why. Well I found out I was pregnant after that, then 3 days later I misscarried. I never got to tell him. Just recently I told him and he and both want to try for a baby but we armed together yet. He wants my baby daddy out of the picture because he isn't any help or anything. I am afraid that if he and I try for a baby that his family will think I am only trying to trap him. We both really want this baby.