TTC WITH POLYP

I have been going to an infertility doctor after a year of ttc. He said I had a polyp on my uterine wall that they found during my HSG. He said it's up to me if I want to remove it. It shouldn't interfere with fertilization, but it might with implantation and it increases my chances of miscarriage. Anyone with experience with polyps? Is it still possible to get pregnant with one?