Does my son have a cow milk protein allergy

Now this is not my son's picture but this is exactly what it looks like he is exclusively breastfed he was on formula but stopped that a little over a week ago and it was very rarely that I give him a bottle of formula anyways

His doctor said he has colic and reflux wondering if this is signs of a cow's milk protein allergy I have already cut out milk weeks ago I don't use sour cream I don't use yogurt but I find myself still using cheese and butter to cook with should I eliminate both are slowly continue to eliminate as I have been please if anybody has anything rude to say just save it not trying to hear it thank you for taking time to read and respond by the way my son is 6 weeks old today