Bad timing or unlucky

When I first started dating my husband we had sex whenever no matter the time or day. Then I got on BC for two years and my libido hit a steep decline, we still had sex just not as often and it felt completely uncomfortable. Now I'm off my BC which I thought would bring me back to normal but I'm finding that the times I'm turned on are when my husband either isn't home or sleeping (he works nights). Normally I satisfy my needs right then or try to wait until I can't take it anymore but when I do i don't feel like initiating sex for a good long while :/

Should I wait for him more often (if I wait too long it's the same situation) or does it get better the longer I'm off the BC?