I need advice!! What doctors did y'all use?

So ladies, hubby and I have been ttc for about 3 years now. He has a kiddo from a prior marriage, so we thought this would be a breeze. But no such luck. Recently, he had a vericosilectomy of the left testie, to hopefully boost his sperm count. He's pushing 40 (I'm 24), so its nothing out of the ordinary considering. The doc did say though, that his sperm count wasn't low enough to make pregnancy impossible, so it would be best for me to make sure I'm healthy just in case the problem isn't him. I get regular exams, but he made it seem like i needed to go beyond that and check hormones and all that. That's where I'm stuck. I made an appointment with the top rated gyno in my area, and she made me feel like a total idiot. She just kept going on and on about how she couldn't give me Clomid or anything because of hubby's procedure, that it wouldn't make sense to do so if he has a low sc. I kept trying to tell her that that wasn't why i was there, that i just wanted to make sure everything was working right. All of my aunts have had hysterectomies before 30, so i'm really worried something is wrong even though the biggest problem I've had is a rare missed or late period. I ended up leaving her office with nothing but a regular check up and a little bit of a parking lot meltdown. I'm a pretty anxious person, so reaching out to a new doctor was a big deal for me, and having that doctor talk to me like I was stupid was almost too much to handle. What kind of doctor do i need to get, and how do i communicate what i want from them? What did you guys do when you realised you might need extra help having a baby?