I'm a Sleaze because he has Low T. Depressed

I'm seriously starting to go into a deep depression. I am 25 and my fiance is 24. We are TTC but how can we if we don't have sex?! He wants a child more than I do actually. Obgyn Doctor says I am normal by all of his tests and his urologist says he is normal, but has low testosterone 220. So we are told to seek a fertility specialist since they can't figure out why we are not pregnant. I chart and everything. Doctor put him on estrogen reducer to try to lower his testosterone and told him to lose the weight. We have been TTC over 2 years now. I've been pregnant in 2011 by a previous partner, but my son was stillborn. So I know I can get pregnant- or at least 4 years ago I could. But if his sperm is fine why isn't this working? He forces himself to have sex with me during my ovulation week.

But besides all of that I am feeling unwanted. The only time hell have sex with me is my ovulation week either daily or EOD, then I only get it 1x per week the rest of the month and each time we have sex it only lasts 2 minutes. If i never initiated id probably only get it 1x/month. I have urges too other than wanting sex just for conceiving. Were young!!!!!! I understand this when you get older, but it's getting hard for me to deal with. I love him, but I feel so undesired and unsatisfied. I would like it at least 1x a day 15 minute periods, I would LOVE 2-3 times a day (but that would only happen in a dream world with him). But I feel like never in my life I will get that. I'm going to have a sex life of an old woman, and the older he gets the worst it'll get. I am actually crying while I write this.

He makes me feel like a sleaze because I want sex. I can initiate, dress sexy, dance, anything- doesn't work unless he "feels like it". He actually gets annoyed with me trying to get sex out of him. Like I'm some kind of bother.

I don't know what to do any more. I'm not a cheater, but fantasize about it at times, which makes me feel so guilty. That's not how I am. With partners in the past they'd be able to have sex multiple times a day. I just with I could have that with him.

What can I do???? I love this man, but can't handle the future of a sexless marriage and possibly childless.

I needed to vent and also need any input you can give me.