Giving up not trying anymore

Decided today that I am not meant to have any kids. Trying for 4 years. Doctors don’t want to put me on anything I am 36 keep trying she says. I have pcos she says to lose weight I am 180. She is worried about my blood pressure. I workout and eat healthy. I ovulate but no baby. Maybe not meant to have children.