Husband troubles

My husband has been really sweet and supportive. This is our first pregnancy and I'm 17weeks, with a super tiny baby bump. He is not physically attacked to me anymore and I'm stressing out. How should I feel? What should I do? I've told him before he can't hurt the baby and he knows that but it's been weeks.