Baby fever

When do you actually decide to start trying??? Hubby and I have already discussed and for sure would love another baby (#3) but it’s in my hands now when we start trying. He has voiced that he is ready now lol 😂 our kiddos are almost 4 and 1. I have been having baby fever a lot lately but then I have the tantrums with our littlest baby and realize... do I want to add another right now... but then also, I feel like I want to experience what it’s like having 2 closer together because there we’re definitely some cons with the age gap between the 2 we have now. Then also throw in the family probably saying **** about us being “crazy”.... I guess I was curious what other moms thought about before officially trying for their next baby?? Lol I really feel like maybe we should just start trying??? Any input from mamas with 3 kiddos???