Don't know what to feel (long)

So me and my fiancée tried for a baby for 15 months and we finally fell pregnant in November. Unfortunately we miscarried in January. Since my miscarriage my brother and my sister have had and are due to have their babies. We have been trying again since March and still nothing. I have now been told I have suspected endometriosis. It's like we are having bad luck after bad luck. He was poorly last year right before we fell pregnant and when we did, it felt like something was finally going right for us. Today we had this blazing argument. He basically said he has had enough, we never talk (we do) but it's hard sometimes as we work and live together, so finding chat can be difficult. He said he dreads weekends and coming home in the evenings. I suggest doing things all the time, cinema, bowling, pub, dinner, anything but it's always a no or something like work gets in the way. We have gone through so much and now it feels like I have to deal with this. It is probably just bad luck getting on top of him but I'm just so confused. We have been together 11 years, I have always been the same. In one breathe he is saying he wants a baby desperately and the next he says he is fed up. He is putting so much pressure on getting pregnant too saying we have to get super healthy, which I do agree, o have started exercising 5 days a week and have given up smoking. I have a couple of days out planned and have done for months and he is pissed off as I will be having a drink on these days. I said I will take it easy but he says it's bull shit and this trying for a baby is not as important to me as it is him. It is so not true and I am doing my best but I don't feel I should stop absolutely everything. I don't know how to feel or what to do anymore. I guess I just don't need this. Feeling so so stressed out by everything. Sorry for the long rant. Don't really want to talk to my family about it as they will obviously take my side and they struggle to like him as it is.