Conceiving problems

Me and my fiancé have been trying to conceive for about 6 months. He had so health problems in high school and they told him there was a slight chance he wouldn't be able to have children. Really is putting stress on our relationship. He believes I'll leave him for someone who can give me a baby (which I won't) but it's 2 days before Valentine's Day and he'll barley kiss me because of what it'll lead to and he feels disappointed in himself because I haven't gotten pregnant yet. 🙁 Just don't know how to deal with him like this and not getting any affection from him lately..