Prolactin / Hypothyroidism

Pls excuse my ignorance & long post. TTC for over 2 yrs now. My blood work has shown high prolactin & testosterone in the past. A nurse practitioner ordered an ultrasound after I gained 40 lbs in 8 mths (after being the same size for 10 yrs) & my periods stopped. The ultrasound showed no cysts so no PCOS. Then a MRI was done to check for a pituitary tumor (pituitary gland controls hormones). It too was neg. I was not allowed to consult the OBGYN as I was not already pregnant. This was all over 1 yr ago. My periods came back but were never regular & I have lost 9 lbs. I can't seem to lose any more. I am 27 yrs old, 5'7 & 150 lbs... not even close to obese. However I am lethargic all the time, constant headaches, no energy, irritable. I had a BC implant over 4 yrs ago & only for 1 yr. No BC since. My paternal g'pa has a pituitary tumor & there is cases of hypo/hyperthyroidism on my mom's side. I'm so frustrated w/ doctors. I feel like no one has my best interest & I don't even know who I need to consult. Any advice from someone who has been through this or knows anything about it???