Oral while pregnant.

Missy • I'm 26 I have 2 boys and a girl. My husband and I are pregnant with our first together. Currently I'm a stay at home mom
So my husband sends me a random message today today saying. 
" I have something to tell you.  I myself have a problem with you swallowing while your pregnant." So I ask why and his response. "Everything you ingest goes to the baby." 
What??? but I love to give head. Is this normal for guys to think this way? Anybody else's Spouse think like that?