Am I wrong for this?

My boyfriend and me have been together for almost 2 years now and just recently he talked to me about how he wants to have more fun, travel to places, and go out. Which is understandable, but I’m also a mom (he’s not the dad) and I get that I more than likely won’t be able to do those things since I have my child half of the time. And it just got me thinking because when he had told me he just said that everyday feels the same to him like a repeat and I understand since we’ve kinda been on the same schedule for a while now and he’s also going to school and work which probably makes it even more repetitive. But would I be wrong to think that maybe we have different things in mind when it comes to our lives? Am I being selfish for almost not wanting him to do that? He’s told me before he wants to settle down with me and have kids. If anything we are basically trying to get me pregnant, so it just has me confused that he wants to do all that after telling me that he wants to have a life together even though he wants to go out and live his life. Would I be wrong to suggest a break or to break up? I don’t wanna hold him back from anything since it’s his life but sometimes I think that dispute how much we love each other that maybe he got into a relationship with the wrong person. There’s probably so much more I could put into this but it’s all I can say right now