Eating dairy free while breastfeeding

I’ve been eating dairy free since my lo was 6 weeks due to a suspected allergy or intolerance to milk, (because he was screaming in pain constantly and had some baby acne) He’s now 3 months and also on ranitidine / Zantac for reflux. I am soooo anxious to try something with dairy to see if it is the problem. I’ve had no slip ups and have made sure that everything I have eaten has been milk and dairy free. Anyways for those in the same situation as me when did you try eating something with dairy in it or when did you realize your little one wasn’t sensitive to it anymore?