He said he didnt want me

So my boyfriends hanging out with friends at his brothers house. I surprised him by showing up after a long day at work (to give his brothers girlfriend coffee) I asked my boyfriend if he was having fun(because he didn’t seem happy) he said yes. I asked if he was happy I was there and he said no. I asked if he wanted me to leave and he just stayed quiet. I’m sad and idk what to do. He was high during it :( any advice?

Édit: he had previously invited me and I had to decline because of work.