Crazy Sex Drive at 12 weeks?

I'm currently 12 weeks pregnant. Weeks 5-11 were pretty awful with all day nausea and multiple episodes of vomiting per day. I ended up calling my Dr. and she put me on B6 and half of a unisom at night which has made all the difference in the world. I still don't have a great appetite but the nausea and vomiting is 90% gone. For the past week I've had absolutely an crazy sex drive. My husband is onboard but is afraid that so much sex will be bad for the baby. Anyone else have a crazy Sex Drive? Is too much of a good thing bad for the baby? Thanks in advance!