Sleeping over

So I live with my boyfriend we are in both 20. He doesn’t care that I go stay with my mom it’s just he said that I don’t keep my word as in saying I’m going to come home at a specific time and I don’t. He said he didn’t want me sleeping over because he doesn’t want me taking Uber late at night. He says I have to be fair but I’m annoyed lol. I want to stay and he said to just come back.