Should I been concerned?

I had a FET last month and now almost 6 weeks pregnant. I was discharged from my RE and had to find a OB/GYN. I recently moved so I called a well known hospital that I want to deliver at to make an appointment with one of their doctors. I found out I have fibroids during my IVF process. I never had any symptoms or pain. They said I have numerous fibroids but none are impacting the embryo. My RE said he believes I have only a 5%chance of miscarriage so I shouldn't stress. They called to inform me of my new doctor and upon research I find she is specialize in high risk pregnancy and a bunch of other things that I don't think I need or have. I only have fibroids, sickle cell trait and allergic to penicillin. I don't think that categorize me as high risk since I'm only 31.😭