shaming me for wanting to have another baby

I haven’t told anyone of my decision to want to get pregnant again other than my husband, my LO is 3 months olds and I would like to have another one soon so we are trying but people are always telling me that I should never have/want another baby so soon and that they are sooo hard to deal with and they act like it would be the end of my world and I am stupid to even think in that way, they basically find it childish, while I know that caring for babies is not a walk in the park, this is what I truly want deep down and I dont think its just baby fever what do y’all think? please no hurtful comments