To have sex or not to have sex...

My husband and I have been diligent with having sex every other day. I just added the app today and it says that today is my most fertile day but we just had sex yesterday. The doctor told me that sex everyday will lower his count. What should I do!?!