please help me. any comments appreciated

My mom just asked me "you're not scooping cat litter, are you?" I explained that for the first 15 weeks of my pregnancy I was not, my fiancé was doing it for me knowing the risk. But over a month ago he stopped and now refuses to do it. (He's not a cat lover and he doesn't like cleaning up after my pets). I understand that, so i just do it. My mom then suggested re-homing my cats because it's not good for me or the baby when he's born, to be around the litter. She then brought up what if the baby has an allergy when he's born..

I'm at work right now and it may be hormones, but I lost my cool. Ran to the bathroom hysterically crying at the thought of having to give them away. Or the thought of the cats thinking I don't love them anymore. I can't even type this with out crying. That breaks my heart. 

Of course I said, if the baby had an allergy I would have no choice but to give my cats away and deal with it. But right now, until I know for a fact my son will have an allergy, I can't give my cats away. This is ruining my day and I feel like my heart is being torn out just at the thought....

Any moms with cats have advice of any kind? When/how did you know your child had an allergy? Is it unlikely/likely? How did you keep yourself and your child safe if you have cats?