Vitamin A during pregnancy

So I'm hearing that vitamin A is bad for you during pregnancy and can lead to birth defects. I looked at the back of my Nature Made Multi prenatal vitamin and I see Vitamin A 4000 IU 100% Beta Carotene and I am freaking out. Can anyone tell me what that is and if your prenatals have that as well. I google searches it but all that popped up was info about Vitamin E . Someone please shed some light on this for me!