Uterine polyp?

Did anyone have a successful pregnancy despite a uterine polyp? I ovulate each month and after HSG and water sono, they are saying the polyp may be the only reason we haven't conceived yet. My husband's count is not great but it's not excessively poor. Did anyone have a polyp removed or had a full term pregnancy despite one?