Grandparents not in childs life

My sons grandparents aren't really interested in him anymore mostly because of his fathers actions but I'm curious to if him not having them around will affect him he has my parents but he does not have his fathers I grew up with both sets so I'm honestly not sure how it feels I'd like to hear you ladies advice on this please.