Two years too close?

My husband and I made the decision to remove my IUD and use condoms because I’ve been bleeding for so long on the IUD. This is my second time having an iud, the first time, I bled for 6 months, this time we decided to not wait that long and got it out after 6 weeks. We have two sons. One will be 4 in February and my 1 year old will be two next sept. . If I were to get pregnant now, they’d be 23 months apart. Is that too close? Both of us have been having feelings that we could have another baby, but for some reason, I’m just scared what other people will think if they’re too close in age. We’re also living in my parents basement, trying to get my husbands degree. So I worry people will think we shouldn’t be pregnant for that reason too. Am I insane for wanting another baby so soon? Maybe I’m secretly just hoping for a girl? I dunno!! We’re going the condom route, but I’m scared it will turn into pulling out, which we all know where that leads!!