Should I be concerned

So I'm almost 23 weeks now and all I want to do is shop and organize. My husband on the other hand won't go anywhere near the baby isle and says it's "too early to shop" we know we are having a boy and his name was picked before I ever got pregnant. Every time we go to the store he drags me away and says we can't even look, he has no interest in anything baby. Should I be concerned or am I over reacting? I just thought he'd be more excited, especially after feeling him kick..