Is it safe to lose weight while pregnant?

I'm not talking drastic diet changes and crazy cardio, but walking several times a week and cutting out the carbs or whatever in my diet? That would be safe right? Slower weight loss process, but overall safer for baby? Thanks!