Pregnant and rarely hungry

I’m 32 weeks pregnant and I’m hardly ever hungry. I will wake up around 7am and not be hungry enough to eat until 12-4pm. At that point I will eat a large meal to take advantage of actually being hungry but then I either won’t be hungry again the rest of the day until the same time the next day or I’ll only get hungry enough for a small snack. My doctor says I’m healthy and my baby is healthy but I worry I’m not eating enough for my baby. Has any one else experienced this? Should I continue to be a worry wart about it?