I can't breathe?

Is anyone else feeling like they can't catch their breath? It's not all the time but when it happens it kind of freaks me out. I just keep sighing and taking deep breaths but not feeling like its enough. I thought this should happen later in pregnancy? I'm 21 weeks.