I'm so sad !

So long story, I grew up as a Jehovah's Witnnes when I was 25 I got a divorce from my mentally abusive husband , not in their cult rules to get a divorce until death or some sleep with someone else . Anyways they told me I would get shunned because I did that and didn't want to go back to church . The following year i met a guy that I've been with for about 5 years now , he always told me he wanted to have a big family (i already have a 11 year old daughter from a previous relationship) so big family I was down with that. Took me about 4 years to get pregnant and lost my baby just about 10 weeks this year in early June , my ob doctor started me on fertility treatment after my 3 cycles after mc. My bf now kinda gave me a little hint that what if I can't get pregnant or lose another baby again ....... I have a strong feeling he doesn't want to be with me anymore because of that but he doesn't tell me straight up. I also love him enough to let him go , if he wants to have kids why should I hold him back if I can't give him none. If we break up seriously with my immediate family shunning me and him n i break up I have no one just me n my daughter . Going through depression . I just hope it works out