No judgement question

First I want to start off and apologize if this is in the wrong room. I wasn't sure where to post this.
I ended up getting pregnant 5 years ago and my now fiancé and I were only together for a year at the time. I ended up having the abortion pill. We have been trying to get pregnant for a year now and no luck. Today I find out my fiancé hasn't been happy in the relationship for the time we have been trying because of the past abortion. He doesn't talk about his feeling much so I had no clue he felt this way. Now he is on the fence about whether or not he can handle staying together. I can't bring to baby back or fix past mistakes. What do I do! I don't want to lose him but I don't want to make him stay. How can we get through this