diet influencing fertility

Does anyone have knowledge on wether diet can effect conceiving/fertility? I've been struggling with it for a while and weighing different factors and don't know if my plant based diet could me heightening/lowering my chances. ( and before anyone jumps down my throat for being vegan, it was clinically suggested to me by my doctor because of medical issues) I'm just asking factually if it's effecting my fertility