Can I take a bath at 4 weeks pregnant?

I'm four weeks pregnant and my back is already hurting me. Can I take a hot bubble bath to help relieve the pain?