Would you foster cats/kittens with a baby?

Long story short the local no kill shelter just won a case for a dozen or so cats and kittens taken from a hoarder and they need fosters for animals they already have so they can make space for the new quarantines. It's a short foster period, 1-4 weeks, and I've been asked if we could take one or two. I love animals and my heart already says yes but I'm worried about our son who's only 4 months. Obviously our son comes first but just curious what other moms say. I'll add we only have a 2 bedroom apartment so no way to separate them.