IVF and overweight

Hi everyone. So I am just doing my first round of IVF starting stages this month. We’ve tried for a couple of years to get pregnant and have done IUI with no success. My doctor says that my weight is not an issue but I have other people in my ear saying if I wasn’t overweight then I would have had a better chance at getting pregnant. Mind you I’m not extremely overweight but I am on the heavier side. Now in just super worried that my weight may play into IVF possibly not working. Anyone else had this issue?