Am I right to be annoyed or is it my fault?

Basically my partner and I been TTC for 3years I have pcos I’m now on clomid

So last night I took a opk and it was positive my partner and I have sex probably every 2-3 days last night he fell asleep early he as work out of town for 2 nights in this morning anyway fast forward I text him when he was gone and told him I probably ovulated last night and we’ve missed it and he said why didn’t I tell him last night ect but the thing is I don’t want to turn sex into something we HAVE to to he clearly didn’t want to last night! But now he’s kinda mad at me for us missing this opportunity!

I just want him to want to have sex with me not only for making a baby