Help please.

So before me and my husband got together i was with my ex bf for 6 years. Never got pregnant (thought i couldnt) and never used protection. Things didnt work iut and i met my current husband. We started messing around and before we got serious i had intercourse with my ex one time. So a month later i found out i was pregnant naturally i was excited and to me it was obviously my husbands. I told him we were excited. We got married after i gave birth. Raised the baby for a whole yr life was great. Someone started twlling my husband to take a dna test because the baby didnt look like him. I did it cuz i had nothing to hide. I knew it was his. Well after we did this turned out not to be his. Idk how this happened. Its crazy 6 years trying and nothing. Finnaly found someone else. I was sure it was his. Now we are trying to fix this and stay happy and a family. But he also wants me to have another baby now. So it can be his blood. Im so lost. Of course i want him to have kne. What do i do? Any friendly advise.