Falling for my donor!

So me and my Husband have been trying for years to get pregnant. Nada.  So me and my SO got into a big fight ( we fight everyday) and he said to take matters in my own hands if I wanted a child that bad. Well I started searching for donors. Told my So I found one and he's been donating naturally. Once with So there other times no. Well each time is getting harder for me. He actually spends time with me and talks to me. And he's actually good in bed. I don't know what to do. I'm starting to have feelings for him and me and my so have struggled for awhile to the point I don't feel any love for him except friendship because of how hes been treating me. And he won't go to counseling because he said we can work it out ourselves but it never does because he doesn't try. What should I do?