I feel like everyone around me is pregnant except me...

I'm 32 years old, married for almost 4 years and have been trying to get pregnant for over 2 years the natural way and have had no success... I have an amazing husband who I've been with for 12 years and want to desperately have a baby with him but unfortunately I have a lot of issues working against me - I have PCOS and was on birth control for over 10 years. I did an ovulation blood test for my doctor & it turns out Im not ovulating every month. My obgyn suggested I get on Clomid but I'm scared of the possibility of massive ovarian cysts since it sends your system into complete overdrive. I have an appt to see my doctor to discuss this on 4/17 and I don't know if this is the best option for me.