Gyno or RE?

I'm ready to go to the doctor and get a whole fertility to workup to be sure there's nothing wrong with me. I'm confused if I'm supposed to start with my gyno or a specialist? I just called my gyno and the front desk girl said she'll talk to the dr and find it if she even wants to see me. What the heck?