Fertility issues

Hello. I just wanted to share what I'm going through and see if anyone else has. My husband and I have been married for almost 3.5 years. March of 2015 we found out I was pregnant. We'd been trying for a couple month. We were so happy. But I miscarried April 15. Two days later my SIL told us she was pregnant as well. 😩 My husband is in the military and had just joined and left for basic training May 4 which meant no more trying until he got home. I tracked my stuff the whole time he was gone and low and behold, my fertile cycle was due to start the day I would see him let alone speak to him in 3 months so everyone assumed I would get pregnant. Well, I did. Nolan was born April 4 2016... 4 months after our miscarriage baby was due exactly. October 2016 we started trying again. No luck. My husband left for more training January of 2017. When I finally saw him after 4 months it was the same situation as before... I was in my fertile window. Well we have been trying since with no luck. We went to my dr to have me looked at and they thought I had a polyp. Turned out I didn't. But then they had my husbands sperm checked and he's at 30% motility. Normal is 50%. They are putting me on Clomid as my cycles have been crazy since my son was born like 23 day cycle one month and 32 the next. Has anyone else had fertility issues with their second and none with their first? It's just weird how it was so easy with our first and this child is gonna be conceived via fertility treatment.