Post partum sex

I am 11 days post partum and had a very simple vaginal birth. No tearing and no stitches.

My doctor said to wait 4 weeks for baths, douching, and sex. My sex drive Is back full force. More than it has been my husband and I's entire marriage. I am not bleeding anymore either. I haven't had blood in 2 days. Just a little bit of mucus like discharge. I am wondering if it's ok for me to have sex. If we use a condom should we be okay to have sex? If it's too risky or not worth it then we obviously won't but I've read on a lot of sites that if I am not bleeding and I didn't tear that sex is safe.