is it ok to take a bath?

I've been dying to take a warm bath! But I haven't since I got pregnant, my doctor said yes but that was around 20 weeks. I'm now 39 weeks and would love to go soak, haven't been feeling well. Any of you mamas taken a bath this far along and know if it's ok? 
Thanks 😉