Depo shot

I was on the depo shot for about 3 years and I've been with my boyfriend for about 5 years and were engaged now we've always wanted a baby so two years ago when I got off the shot we never used any protection now we're trying to have a baby. He has had two other babies with different girls so I know he's fertile can the depo shot make you not get pregnant. Or what opinions please!!!!