Could he b the problem?

So I have three kids got pregnant with all three the first time s.o didn't pull out I'm with my new husband and for 16 months he's never pulled out no BC no condom nothing iv had three early losses with him but I'm wondering could it be him ? We were together 4 months never used protection broke up I got pregnant on accident two weeks later by someone else and hubby and I got back together 10 months later abd have been TTC for a year now