Buying a house

So my SO and I are ready to buy a house together, just waiting on the right property.

We’ve been together 4 years, we live around 45 minutes away from each other and we mostly only have each other.

My SO does have one close friend. He has bought a house in March and since then, my SO has went over every Saturday. It doesn’t bother me just now since we don’t see each other on a Saturday anyways.

I made a comment today saying I hope he doesn’t plan on going over every Saturday when we’re together since I was looking forward to being able to see each and do things on the weekend for once.

He obviously replied he was planning too.

I’m obviously okay for him to go hang out but I don’t want to move out of my family home to be sitting in myself every Saturday.

Any help?

** ps, I don’t expect every Saturday for him to stay in. I just to expect every Saturday for him to go out **