I need advice!!

So I'll try to make this short. My boyfriend & I have been together for 3 years. We finally just mortgaged our first home together. He leaves me here by myself while he goes to his parent's house everyday for hours! (I will not go to his parent's house when his sister & his nephew are there.. I have a 3 year old daughter and his nephew is so mean to her, I refuse to let it even have a chance to happen. So her & I just stay home.) I don't think it's right.. He goes there everyday after work and doesn't get home until 10:30. And on weekends when we can sleep in, he gets up by 9AM, gets dressed and heads out the door. It really pisses me off he can't even spend one day with my daughter & I! And last night my daughter went to my parent's house for the night so we could have spent some alone time together. But he just blows me off everyday for his parents and his friends. I don't know what it's gonna take for him to realize that I'm just gonna leave if this continues to happen. I feel like I'm just a live in maid for him. He expects for me to get his clothes out for him every night so they're ready for the next morning as well as pack his lunch and get the coffee all set up so it's ready for him when he gets up. I'm tired of it! I bend over backwards for him and he just doesn't seem to care. He tells me I'm useless and a waste of space all the time. And throws in my face I have no friends and that nobody likes me. I have had depression in the past, it's a hard thing to deal with as it is. And he just doesn't care at all I feel like. Sorry for the long rant! I just literally have no one else to talk to and felt like I could get it all out this way and hope for positive replies and advice.