TTC is killing my Marriage

So my husband and I have “not tried” tried to get pregnant for 2 1/2 years ever since I was diagnosed with PCOS. About 5 months ago I decided to go to a doctor. I have done 3 rounds of Clomid. 1st was 50mg 2nd 100mg 3rd 150mg... I’m miserable. I’m not myself and I can’t sleep comfortably threw the night and all day and night I’m hot one minute to the point I’m sweating and feel I will pass out to freezing the next. Light headed and dizzy randomly. I use opks and my husband and I have sex every other day. Well it’s causing problems. My husband feels I only want to have sexy with him when I’m fertile and not because I want him. He feels like there is to much pressure on us. It’s taken the romance and spontaneous facts out and he feels it’s a job. I have made him feel this way and didn’t even realize it. I thought we both understood that the spontaneous fun fact wasn’t in the cards for us and we had to be by the book. Not to mention it’s hard to feel sexy for me. I hate my body right now and I feel broke.... I hate that I have made my husband feel unwanted or shitty and I don’t know how to fix it. I feel like he regrets us TTC because it’s not fun. But if I say so he says it has nothing to do with that it’s the way I made him feel. I don’t want to try and do things differently and him feel I’m only doing it because he said something and I feel bad. I love my husband more than anything that’s why having a child is so incredibly important to me. He had a daughter from a previous relationship and I love him so much I want to create a life that is a product of our love and I have let that drive and focus become and obsession I guess and lost sight of what creating a child is really about and turned it into a job. But I’m scared if that’s what I did and we have to get further treatment to get pregnant it only gets less romantic the more you have to do with IUI or IVF