Is this possible

So hubby and I have been TTC a year here's the thing I had two with my first marriage got pregnant day one of TTC git pregnant again on accident and lost the baby at 5 weeks got a divorce (not cuz baby just life ) met my new hubby (bf at the time ) a few months later never used protection for three months no baby we broke up I had a one night stand and got pregnant my man stepped up and considers our son his we have now been TTC a year I have lost 3 more baby's between 4 1/2 and 6 weeks could there be something about out DNA or genes that don't mix and make it so we can't have a baby ? I'm so confused cuz all this