Anyone else frustrated?

My DH and I are ttc with no luck. Currently we only have sex on my fertile days and on ovulation day. My recent ovulation day was Christmas (December 25) It's been fun trying but DH is also getting frustrated that I only want sex on a schedule. He hates that he has to time it and keep going at it multiple times during my fertile period. He wants sex whenever the mood comes and wants it to be romantic/natural. I don't know what to do.