changing mind on kids

Last weekend my husband and I had a long talk about children. We had just started TTC but now we are both having second thoughts. We are starting to like the idea of travelling and moving across the country, no strings attached. 
Does this make us bad people? It's so hard when everyone around you is having or wants children. 
I'm just worried that if we were to get pregnant we would now be missing out on this new life we are thinking about.