I'm ready to TTC but my hubby isn't

I went back and forth about posting this but I just need to find out if I'm the only one going through the struggle of disagreeing with your partner on when to start a family. I've been with him for almost 3 years and married for one year. When we first started dating he was leaving for basic and my mother had just passed away...one thing lead to another and I ended up pregnant. I lost the baby right before the end of my first trimester, long story short he was supportive of me being pregnant then however now as a married couple, we can't agree on when to start actively trying. He is active duty military and supports his reason to wait four more years is so he can spend more time with younger kids when he retires at 45. While I respect and appreciate his reasoning, he knows I have some serious fertility issues that caused me to miscarry in the first place. I have tried to make him understand but he just seems set on sticking to what he wants. I don't want to resent him later or have him resent me for pressuring starting now versus waiting for medical purposes.