Ladies i need help SERIOUSLY!!

Chiquita
So I have two beautiful children both by two different people. No judging lol. My first daughter I didn't even know I could have because was told I couldn't have babies...her father and I fooled around during a brief single phase in my life and BOOM here she is lol. Second daughter is with my soon to be ex husband. Both girls are their father's first children. After being single for a while I met a wonderful man....he has no children and is 29 but one day will love to have some. I battle with the fact of having more children because I don't want to be that women that has 3children with 3 different children father. I say I don't care what people say but I guess deep inside I do. Am I just being crazy or are the feelings I'm having valid?!?! Help me ladies.....I value my fellow glow ladies opinion. S.N. I haven't even spoke to family about this.