Sex during pregnancy

Is anyone else of having sex during pregnancy? I'm currently 20 weeks pregnant with my first and I haven't had sex since I found at which was at 6 weeks. Lately my hormones have been driving me crazy and I feel bad because everytime we try I get scared. I have a normal pregnancy my doctor said it was fine ,does anyone have any advice that will help me lose that fear .