When is it the best time to have sex when ovulating

I don't think I'm having intercourse the right time we always have sex later that night 11 or 12 at night because he works late and I was reading that it's better to have sec during the mornings can anyone tell me what I'm doin wrong