Doctors appointment for possible infertility

Just had my first appointment at a women's clinic today. She has me going for all kinds of blood tests, an ultrasound and an Hsg. I'm starting to feel panicky about all this. My mom had a hard time getting pregnant, and my brother and his wife never were able to have children. 
I didn't really think I fell into that category but all over my forms it says primary infertility, and I think it just kind of hit me what this all means. 
It's all very overwhelming. Just looking for some support from people in the same boat as me!