Can your GP refuse to refer you to a fertility clinic in ontrio?

Hi all, I’m writing because me and my husband have had a hard time getting my GP to refer us to a fertility specialist because of his ED (his doctor is almost impossible to get an appointment with) we have tried many times. Lately however we have been discussing the option of a donor to avoid genetic diseases on his side of the family but I’m really scared to bring it up with my doctor just to be told no again. So I was wondering if it’s legal for them to refuse to refer you or if my doctor just doesn’t want too? Please only kind comments.