partner won't BD!

So me and my partner decided to try for our second baby a few months ago he says he really wants another one but when I tell him I'm in my fertile week or that I'm ovulating it feels like he doesn't want to BD, my fertile week started on Tuesday and we have done it once! I've tried starting it but he just goes to sleep, it's been like this for the last month and I feel like it's never gonna happen like this! :( I feel really frustrated but I don't want to annoy him by talking about it cause he don't like talking about it..