Pregnant at 41

I went through egg retrieval in November and was preparing to have fibroid removal surgery in two weeks to clear uterus to prevent miscarriage. I didn’t get period and found out I’m 4 weeks pregnant naturally. I’m worried I’m too old, the fibroids will cause miscarriage, and have to decide if I need to terminate or not. My obgyn told me to cancel fibroid surgery and if I have miscarriage likely in first trimester. Any advice? Anyone been 41 and pregnant after IVF naturally? Pregnant with fibroids?