Im afraid to have sex with my husband

Just found out I'm pregnant, roughly 4ish weeks and I'm afraid to have sex. I know it's not harmful but I've heard both sides 😣 ladies, help me out