Not trying but not not trying

Does that makes sense? We are not charting or anything but we are not using any bc. Our son is 7 weeks old. Anyone else potentially going to have kids really close in age? People are giving us crap for it saying we need to wait two years between kids. We are already 32 years old. Two years is a long time when you are this age. The longer we wait the chances go up for issues. I just don't know what to say to these negative people.