Doctor don't want to give letrozole or clomid

Hey ladies , I was supposed to start on letrozole in June when I get my AF. But I got my positive and was 5wks pregnant when it turned into a chemical in July. I took the letrozole in Aug but didn't end up pregnant.

I went to another doctor recently and asked for fertility meds but he refused to give stating that I got pregnant naturally 😳. Should I see another doctor and get fertility meds ? It's 13months of trying to conceive. I want to get that 2 positive lines again. 💔