How many times??

I'm with my partner 5 years and at the start we used to have sex all the time now it's not as much as we used to it would only be about 3 times a week should I be worried that it will disappear the longer we are together