Advice needed....

Me and my husband suffered a painful loss, our first baby back in 2012. We decided to start trying again, so i went to the doctor in July to get a prescription to double clomid to help me ovulate, because sadly there is times when i need help ovulating, anyways around the first of August i started my period and started the clomid... I did everything correctly, down to checking my bbt with a ovualtion thermometer, checking my cervix and my CM. On the 25th day i went back to my OBGYN to have my pogesterone level checked. Couple of days later i get a call from my doctor that i did not ovulate, claiming that my level was 0.6 and to ovulate my levels need to be 5.0 and above. He also told me that it was "abnormally low"... So i asked him what he could do.. And he claims, unfortunately there is nothing that can be done, that my last hope is a fertility specialist.... I was livid and my husband is furious!! Because according to my bbt i ovualated.... But sadly i didn't get pregnant this time around. Me and my husband have talked & prayed about it and i just feel that IVF is not my last option, and i should get a second opinion! Thoughts?