What to do

So my boyfriend currently lives with me and my mom I’m 16 years old and he’s 18 we’re having our first baby together and he wants to get an apartment or a house for us and I’m having so many mixed emotions about it I love him but I love my mom more. I just don’t feel ready to leave my mom alone she’s a single mother and my brother lives with my dad and my sister is in the process of moving 8 hours away because she recently got married she’s 19 anyways if I were to move in with my boyfriend my mom would be alone and I hate being home alone all the time I can’t imagine how my mom would feel being alone all the time I’m not ready to leave my mom but I don’t know what to do because I’m starting my own family now... my boyfriend regardless said he’s getting a apartment or a house and he’s talked about always having all the baby stuff there and he gets angry at me when I talk about making the room in my current house with my mom I don’t like talking to him about me wanting to say because I truly do not know what to say to him I don’t know what to do because I lead him on about what we can get for the house and whatever but then I’m here laying down thinking about how alone my moms going to be in a 3 bed room home with all our furniture just for it to be her alone should I tell him I’m not ready to leave my home