Offending people rant

Just a week into announcing to friends and family and the amount of people offended is ridiculous. I always refer to the baby as he and sometimes she when talking because I just won't say "it". My mother use to call me that to hurt me so I just say anything but that and people keep getting mad because we don't know the sex but refer to it as he or she in general conversation.

I personally don't care what the baby is but he/she is definitely not an it but everyone thinks that just the he/she referencing is insane and possibly more damaging.

What's gonna happen? Baby will hear and get confused about the gender? Seriously I really don't understand.