Am I being insensitive

Me and my boyfriend are expecting a baby and moving out.

I left my family to be with him, and now we are leaving his family to find a place of our own.

He won't stop saying how he doesn't wanna leave his mom and she's been crying because he's leaving and it's seriously starting to get on my nerves! I understand it's a difficult time for everyone but he needs to look at the bigger picture now right?