Kiwi allergy

I bought kiwis the other day and have slight allergic reactions to them. It just makes me mouth/face itchy and slightly irritated. I’m 32 weeks and I know this may sound stupid but is there anything bad that can happen to my baby if I keep eating them? I don’t want to waste them and my husband doesn’t like them