12 weeks pregnant and found out i have a Fibroid!

The midwives said it is common but do I need to worry? She said its probably 5cm in diameter and may cause some pain, has anyone experienced this and had a normal pregnancy and delivery?? Im terrified