scared to have sex at 5 weeks pregnant

I've miscarried before and im really scared to have sex! But I'm feeling the urge to attack by man lol. What do I do? Wait til my Dr appt?