What's Your Thoughts...

My boyfriend is always having people come over such as friends and family but I can't have anyone over. It sucks because when he is gone I get extermly lonely and bored. If I say I'm going out for the day, he'll ask if I really have to. Or if my mom brings me groceries, he'll ask how long she's going to stay and will keep asking the whole time she's there if she's gone yet. But it's prefectly fine for his family and friends to come over anytime  they want and for as long as they want. And To make it worst he makes me feel like I'm  just a maid to clean the house and a nanny to care for his son then his ma yells at me about the house not being spotless, laundry not being done, baby not being bathed, etc. 
I'm on my last nerves already and just want to leave even though I love him :( 
How would you feel?  Am I just over reacting or being selfish by feeling this way?