Babies close in age.

So we have a daughter who will be 4 in December and a son who will be 2 in November. My husband keeps telling people or insinuating that we are trying to have another baby when we in fact are not. Lol we've had multiple conversations about it and I'm just not ready right now. Our son is such a handful and I'm a stay at home mom. My husband works from 7:30 AM until 7/8 PM 7 days a week so I'm with them literally all day by myself and I just can't handle another baby right now. His mom keeps mentioning how I should just "get it over with" and now has his grandpa on board with her. 😂😂 My family is the exact opposite and thinks I should never have another child. Obviously mine and my husbands choice but when is ideally the best age to add another baby to our family. I want to wait until our son is in school and my husband wants another one right now. Lol