19 years old struggling with fertility

I am 19 years old about to be 20 and have been trying to get pregnant for 2 years as of this month. I know to a lot they would call me stupid and tell me I am too young but I feel like this a topic that needs to be talked about. So a little back story my mother had to have a hysterectomy at 29 and almost died from losing so much blood and my grandmother at 31 was also only 20 minutes away from bleeding to death. With the way my health is going it seems as if I am on the same path they were. So growing up I was always told these stories and always told by my mother all of the struggles she went through and how she wanted a couple more babies but never got the chance and how much she wished she could have just had one or two more. So for some reason I just had a feeling getting pregnant would not be easy for me. So right after my husband and I graduated high school we started trying for a baby. We were so excited and just knew we would be great parents to a beautiful baby and then a month went by, then two, then six, and then finally a year. I had finally worked up the courage to talk to my doctor just to see if she could run test and make sure everything was okay. at this point only for her to tell me i am way to young and that there is nothing wrong with me. I believed her. I felt defeated. But that didn’t make me stop me and my husband continued to try and finally about 3 months ago I got a new doctor and told him I need help. He was skeptical at first but then told me that it is my body and if this is what I want then he will help me. I have pcos did not ovulate for the whole two year and probably more that i was trying. The only reason I would get periods is because I would randomly be put on provera to induce one. I am currently about to start my fourth round of clomid and he told me that he only feels comfortable doing about 2 more then I have to go to a fertility specialist and talk about those options because he thinks that there is a problem with the eggs sticking. I honestly didn’t know how to take it because I never expected at 19 years old I would hear those words. I know a lot of people go through this and I know it could be worst but what if it never happens? What if I can never have a baby? People always say “oh you’re so young” “it’ll happen when the time is right” but what if my time is never right? What if I never get the chance to look at a beautiful little child that I created? I in no means mean to offend anybody from this post I just feel lost. I feel horrible for my husband because what if I can never give him this? Will it destroy my marriage? Will it make him grow apart from me in hopes to start his own family? I know this is all hypothetical and I know my husband truly loves me but how can I expect him to just sit around and not get to experience such a amazing thing? I feel selfish for this even though I cannot help it. Please no hate I just need to get this off my chest and have no where else to talk too.