I don’t know what to do

Me and my very serious boyfriend (we live together) are at a cross roads in life where I feel like it is time for us to leave the town we went to school in and move away and really find somewhere to call our own. We’re young and have nothing tying us down to one specific place I feel like this would be the perfect time to travel and move and be spontaneous but every time I talk about it he just wants to stay exactly where we are and thinks it’s reckless to move somewhere else for no reason. I’m not sure what to do, all my friends have left this small town and I have no one but him here anymore and I want to be young and move and explore new places but my boyfriend is obsessed with staying right here and working at his job here (that doesn’t even pay well!! ). Is this difference in life plans a deal breaker? Am I just being irresponsible or should I enjoy my time while I’m young with no kids to move around? I just want something new in my life and he makes me feel bad for even wanting to leave whenever I bring it up. I feel trapped and even if I did decide to leave him and I live together and there will be such an awkward amount of time where we will have to have a hard convo. Should I grow up or should he chill out??