Traveling after baby?

So I'm 22yo and my husband is 29. He has had the whole college/travelling experience but I have only gone to a few different states with my family and it's always been my dream to travel and experience different cultures. I feel blessed to be having a healthy pregnancy, (and this may be selfish) but I am worried that I won't be able to experience life after baby. Would I be a terrible mom to go on a vacation without baby (as well as family vacations with baby) after the age of 1yr?