Baby moon ideas?!

Evangeline
My husband and I have decided we want to start TTC soon! But we also really want to have one last adventure just the two of us. 
I really wanted to save up and go to a different country, but with planning for a baby I think I'd rather do a vacation on a budget and put money towards the baby. I live in Virginia if that helps.
I'll take any ideas! I'm kind of lost on where to start but I know we won't have as much spontaneous time with a baby!