Can I take a hot bath while pregnant?

I’m 5 weeks 1 day confirmed by doctor today! I feel nauseous and a little crampy. Baths are the only thing that help. Can I take a bath as long as it’s not too hot?