Not having much sex at all ... what to do

To

My partner and i met 3 years ago and were having sex every day when we first got together and ots slowly tapered off to a point where ive had sex with him maybe 4 times in 6 weeks.

Is this normal? Im 24 hes 30. I tried to talk to him and hes like "its not all about sex in a relationship " which i know but bloody hell its quite the drought...