Clomid for baby 1, what about baby 2?

I had to go on clomid for baby #1 and now starting to try for baby #2. I want to avoid the stress and the disappointment but wondering if anyone conceived baby #2 without clomid after being on clomid for #1. Thanks!