Am I being selfish ?

Christina
I'm a FTM due at the end of August with a son ! My boyfriend has two children from a previous relationship that have lived with us for almost 3 years now. For about 2 years now, things have been really strained and stressful between my boyfriend and I. He doesn't work and I fully support him, his kids and myself ... Since I moved out in August I've been supporting 2 households with no complaints or nagging him to get a job. Now that I'm pregnant he wants me to move back into his house and for us to work on our relationship and be a family, which is honestly what I want being that I didn't have a father growing up. But I really hate the way he treats me, talks to me and makes me feel. He's constantly putting me down and telling me I'm not good enough or what I've done isn't good enough. He critisizes everything I do or say and let's me know how horrible of a person I am and that nobody likes me any chance he gets. Too him I'm just being sensitive but my feelings are genuinely hurt everytime. We bounce between fussing and not speaking to each other and I feel that I should just keep my apartment but he acts as if he's not gonna be involved in my child's life if I decide not to be with him. As much as I want my son to know his father, I want to be happy as well. Am I being selfish?