How often do you walk when pregnant

I am 11 weeks and trying to walk when I can but my fatigue is kicking my butt. Is it okay to skip some days and not always go for a walk when pregnant?