My doctor said I could die if I don’t get the flu shot!?!!

I haven’t had the flu shot in 2 years. This would be my third year, if I decide not to get it again. I wasn’t planning on it but a few days ago during my O.B. appt, my doctor was scaring me, saying that I could end up in the hospital and possibly die if I caught the flu while pregnant. I didn’t take the flu shot still but that conversation has been on my mind and I’ve been debating if I should take it or not. Wouldn’t it be more risky if I take the shot suddenly after not getting the shot for 2 years? Or would that even make a difference? Has anybody had the experience of getting the flu while pregnant? Do the benefits of getting the shot outweigh the risks? I have 3 children ranging from ages 6-11 and they do tend to bring back colds from school during this season. I’m not sure what to do. The reason I stopped taking the flu shot was because I get very sick for about 2-3 weeks strait after taking the shot.