BF never wants to do anything

Bonita

Hey guys, I hope I could get some feedback on my situation in my relationship. I been dating my boyfriend for close to 5 months and although he's nice and sweet, he never wants to do anything with me. We've only gone out to eat once, and last weekend we had an argument because my siblings invited us to go to a hunted house and he wanted me to go alone, without him. He keeps saying he's not a people person and doesn't like socializing like I do. It made me feel some type of way cause I thought he felt like this towards my siblings, but he says it's not that. He just doesn’t like being around people other than his “boys” who go on gun ranges on the weekends. Our argument almost lead to a breakup but he says that he’s working on himself and he will do better on going out. He’s bipolar and sometimes suffers from depression. He has two daughters whom one of them was killed 3 years at the age of 1. He says her death has changed his behavior and such. I’m doing my best to give him time but at the same time, I’m afraid if I’m wasting my time? I communicate that effort in this relationship is very important to me. I will never make him do something that’s uncomfortable with him. Then on top of this, my little sister moved in with me on Monday for a few weeks since she's struggling at this moment. I just asked him if we're going to see each other this weekend and he says maybe. I feel like he doesn't want to come around cause my sister will be there but I had told him that she was moving in, in advance. I'm not asking him to go to the club with me or bar but at least a movie or dinner out would be nice. I feel like this will cause our relationship to end. I think about the future and don’t want to waste time on someone who doesn’t want to enjoy life and I worry now on how it’ll be if he ever meets my son since he’s not a “peoples person”. Am I in the wrong to get upset?