Should I start Clomid?

Summer
I just picked up my first round of Clomid, 50mg. But I haven't decided if I'm going to use it. We've been trying for 7 months and I have irregular cycles (sometimes 36-45 days, last month 70 days before I did Provera). 
I don't care about my side effects, but more concerned about the side effects it might have on the baby. I've read studies, blog posts, articles.... All making me go back and forth. 
Anyone else having these concerns??