When is it a good time to take a vacation with a new born?

My baby is two weeks old but my husband wants to go on a vacation to a beach or something like that since it is summer break and we have a 5 year old who gets bored alot,,  we will be driving wherever we go but I feel like my baby is still too little, when would be a reasonable time to go on a vacation?