Anyone else feel like a failure

Please don't give up on my long explanation I know it's alot.... I know it's gonna sound weird but me and my ex well more him he admitted later it was his plan but after the 3rd time of us having sex he stopped pulling out or using a condom an admitted he was trying to get me pregnant its now almost 3 years later and I believe I have but unconfirmed cuz I was scared to know 2 early miscarriages which at the time we were seeing other people so I could of not been his....but anyways I always thought that I was the issue on no baby because of the depo shot I was on for 5 years after my son.... Recently we split up again and I slept with someone on my peak day an got pregnant an lost the baby I'm starting to think he might be the problem or maybe we just wernt trying on the right days does anyone else feel like a failure even tho it might be him with the fertility issues