I’ve been taking medication for my anxiety since before I was pregnant only Sertraline 50mg ones so a really low dose, but now my doctor wants me to

Slowly come off them but I said I don’t feel ready but he didn’t take much notice, but he just kept going on about the risks he said there low but he just said like it could need weaning off it when it’s born or could have a heart defect now it’s just worrying me completely anyone else take them and been fine 🤔