Parents in law are possessive! What should I do?

It all started when we went to cancun together as a family vacation, me and my boyfriend spent 4 days straight with them(having dinner, breakfast, being at the beach together.. Etc) on our fourth day we went to a trip as a family  where we were doing zip lining, scuba diving and other fun stuff. My boyfriend parents didn't want to do any type of activities with us because they were tired and weren't willing to do it, so they preferred to stay at the buffet where they were eating or being on there phone. That same night we came back and didn't go to dinner with them because we fell asleep from all the activities we did. the next morning we want to the beach and all they wanted to do was be on there phone or tablet, me and my boyfriend enjoyed our time being in the water, when we got back to them my boyfriend told them he wanted to have dinner with me only and enjoy our night, his dad told him he needed to have a serious talk with him and he did... He told my boyfriend we were being rude at not wanting to spend time with them and that we weren't spending enough time as a family. My boyfriend  stood up and told his dad that we've been spending our time with them for the past days and that was sorry if we weren't sitting down with them in the lobby on our phones and preferred to enjoy the beauty. 

My boyfriend has been working extra hours around 10 hours a day, once he gets off we go to the gym. On his days off he runs errands for his parents, cleans his parents  house and we hit the gym for two hours once are done its 7:00 we visit his parents and they are just watching tv, each person on there phone. Every Sunday my boyfriend has breakfast with them and every Friday he stays home with his parents till 7:00. So I really don't know where this is coming from. 

It hurts me because I know my boyfriend does everything to please his family and all they are doing is trying to manipulate him. I love my boyfriend but it hurts to see how they could still control his life. I invited him to dinner with my family today and he told me he couldn't come cause he didn't want to cause drama with his family. He's been spending the last two days by there side and they have already planned out his two days off so he could be at home once they get off work...