Endometriosis

I recently started tests at a fertility clinic. Found out through ultrasound I have cysts on both ovaries. Wasn't given the extent of how big or how many. She said she doesn't want me to remove them unless I was in a lot of pain bc lowers egg count. My husband has a low sperm count so pretty much impossible to conceive. I'm curious if I should get removed rather than getting IVF...it's pretty costly. Should I go to OB doctor and get second opinion? Fyi I had a son 6yrs ago...never had this problem.