I think my baby has a dairy intolerance. Anyone else's baby?

Ra

I have thought my sons had a dairy intolerance since birth. The health visitor said this was unlikely but I changed him to a comfort formula with reduce lactose and this made a huge difference. When he was about 8 months I transitioned him back to normal formula which was fine. I've been increasing his cows milk in his food, yogurt, cheese etc and some days his poo is like korma (sorry tmi). Tonight he's been crying and passing a lot of wind and he had more dairy today. I'm wondering if he's intolerant to it. Is it worth taking him to the doctor so should I reduce dairy from his diet and try him again in a couple of months? Also when I tried to transition his formula to cows milk (he will be one soon) his poo started turning very pale.