Please read, stressful family situation

Thanks in advance to whoever helps. ❤️

So I'm 25 and my boyfriend is 24. We've been together for 4 years and have a week old baby boy. We are in a serious relationship. We both live in different houses with our families because housing is extremely expensive where I live and we can't afford to move out unless we have around $500,000-$1,000,000 (literally). So around my area we hardly know anyone who has moved out on their own yet. Anyway, my baby lives mainly with me and my boyfriend comes over during the day and leaves at night. This is fine and works for us, however my mom treats my boyfriend as if he only has visitation rights and gets mad whenever I go over to his house for the day. She sends me things like "he's only the boyfriend" and "I feel like I'm losing to over him". I tried to explain to her that this is his child and no he isn't "just the boyfriend", he is his dad and an amazing one at that. She doesn't get it. Eventually I do want to move in with my boyfriend because my mom is stressing me out.

It bothers me so much that she thinks she's more important than my boyfriend, aka the father of my baby.

Ugh. Advice please?