To exercise or not to exercise

Hi ladies, I am 31 currently 5weeks pregnant with my first following 2 years of trying and 2 cycles of IVF. I want to be healthy during this pregnancy and have always exercised about 3-4 times per week in moderate intensity gym classes (spin, step, cardio boxing, yoga)... I returned to the gym this week after resting until by BFF. I’ve told a few of the gym instructors and they’re encouraging me to attend classes and just make some modifications to ab exercises and to generally take it easy. But today I went to my GP and she really freaked me out saying I should just stick to walking only. What do you all think? 🤷🏽‍♀️🥺