specialist referral

My OB/GYN is referring me to a infertility specialist. I'm a little upset because I have had irregular periods, missing periods and I am not ovulating. Even 150 mg of clomid can't make my body ovulate. But that's all my Dr. will do is give me those pills. I believe I have a major hormone imbalance or possibly PCOS but she also waves away any questions about those. I'm just trying to process why it bothers me so much that I am being referred. My husband thinks it's because I feel like they didn't look into the cause of my issues. Sorry I'm rambling but I was on clomid of different strengths for 7-8 months and now I feel like they are dropping me instead of figuring out what was really wrong.