Ok I'm turning my husband off...

So we have two other kids which happened without planning really. We have been married for coming up on 6 years and we have always had great sex life. We are generally on the same page when it comes to sex. This is our third cycle ttc. I've been monitoring everything and trying not to share too much of it with him because I can see how it could be a turn off. But during my fertile week I've been trying for sex like crazy and he just never seems to be in the mood. He says he really wants a baby and has been disappointed the past months when we weren't. But he says that he feels like I'm just "using him for his sperm" and it's a turn off. I've tried to make it fun and do spotsniuous things but nothing seems to work. This fertile week we only had sex once because every other time he shot me down. It makes me feel horrible about myself. Anyone else?