Dairy free?

For those who went dairy free once you started breastfeeding, what led you to that choice?

My little man is 3 weeks old. He has normal yellow poo and good amount of wet diapers. However, he appears to struggle to push out poo. He grunts, gets very red, bloated belly, scrunches his face, and looks generally uncomfortable. He has colic-like behavior, especially at night. He really is breaking my heart!

I’ve been told by mom friends this is normal baby behavior? But I don’t remember my first born being this uncomfortable 😣 (she’s 19 months). I’m wondering if I need to change my diet??