Exercise while pregnant?


Here's my issue. I am 5 weeks along with my first baby :) I'm scared to work out since I have exercise induced anaphylaxis and I can break out into hives and swell up and go to the ER if I'm not on medicine (which I can't take) or do very minimally exercise a couple times a day (like walking for 15 mins then take a 30 min break and repeat). I'm just curious if a little bit of exercise is better than none at all?

I'm going to my midwife next week for my first appointment and will ask her too just wanted some opinions from you ladies! TIA!