PCOS and pregnant

Last year I hit my highest weight at319. I started to exercise since September weight lifting and I was able to loose 20lbs. For my first pregnancy I had to take a fertility pill to be able to conceive I was 200lbs back then by the end of my pregnancy I was 280 😢 and ever since struggled to get back to my previous weight. This time around I thought I was going to need medication and that’s why I started going to the gym but I got pregnant without it and I’m still not a healthy weight either🤦🏽‍♀️ I’m now been referred to a high risk pregnancy clinic all I can think of is the possibility of gaining 80lbs again and it scares me.