Walking with baby in carrier

I have the infantigo carrier I wear my son facing towards me when we go grocery shopping or around the house. We also walk 4 miles every morning with him in the stroller. Is it safe to wear him for the walks? Hes 11 weeks old