Pep talk needed

I had an IUD (copper) removed in May. When my new OB removed it, he said, "I'm surprised it worked" (I guess it was partially coming out or something.) I have been freaking out that it didn't work and I just can't get pregnant. Then glow suggested that I talk to a doctor about endometriosis because I logged moderate cramps and diarrhea with AF. Also I'm 36. What do you ladies think of my odds. Hasn't been too long but I'm feeling discouraged...😥