Am I really insane?

I had my first baby at 21. I am wanting at least 3-5 year age gap before we start trying. My husband leans more towards 5. We are all for short age gaps too. We just want to spend one on one time with our son. Some make rude remarks when we say it. I feel like 5 isn't really that bad. Idk maybe I'm nuts🙃