too close in age?

I have a 4 month old and Hubbie and I have discussed baby #2! It is too soon already? My body has returned to normal despite needing to lose 10lbs to get back to pre baby weight! Any Mumma with kids close in age to give advice