Shortness of breath @ 31 weeks

At what point is it something that I need to be seen about.. I did call my doctor to let her know but haven’t heard back. Lately I have super bad shortness of breath. I try to lay on my sides and it doesn’t relieve it and then it sends me into a massive panic and I start sweating and crying but it does subside eventually once I stop panicking. So I don’t know if I’m just claustrophobic in my own body right now or if it’s something not right.

I will add I do have gestational diabetes that has been pretty much controlled through diet with spikes here and there. No signs of hypertension that I’m aware of.