going to kill my husband

I got pregnant using clomid. And it is still very early pregnancy and he has been looking up birth defects that are apparently cause from clomid and he is absolutely freaking out that we are going to have a defective baby. And he is just stressing me out and worrying me. Has anyone heard of birth defects from it? and if there is so many like he's read why is it such a common fertility drug?