Sex while pregnant

This may be gross to ask but my husband has a large penis and we think we may be pregnant but have not gone to the dr yet can having sec with him hurt the baby?