Friends can kind of suck sometimes...

I'm friends with this guy and he is gay. We've gone out with our friends and on double dates (me, my guy and him and his guy). We have even had him in our house! After about a week he started acting like he doesn't like me. He hangs around people who tend to talk badly about people but I don't like to accuse... I asked him about it and he said he is just busy, but he still talks and hangs with our mutual friends.. My feelings are really hurt but idk what to do. Wait around or stop trying?