Sex and first trimester

Since finding out I am pregnant my husband seems to have some primal attraction to me and wants sex ALL the time. The problem is, I am still in the first trimester and am so sick most nights that I have zero interest. He is taking it very person and gets bummed when I turn him down. Anyone else having the same issues in their relationship?