Boyfriends Mom!!

So my boyfriends mom has a problem with me coming around the house a lot. Like last week I was going to her house everyday to spend time before I went to go work out. And then he told me that she wasn't liking it. What do I do?? Without me staying away..