Is your husband insecure?

So I've been with my husband for over 5 years, I lost my virginity to him & we are expecting our 2nd child together. We are & always have been VERY sexually active. BUT he absolutely will not let me see, or touch his dick when it's soft. Like seriously, we take a shower together & if he isn't hard, he will cover his dick with one of his hands  the ENTIRE time & wash his hair, body, etc one handed. He is my man & im very touchy so I try to grab his dick often but he swats my hand away persistently. He also grabs me often, which I never have an issue with. But lately, it's really bothering me that he's so insecure. He's a "grower not a shower" I suppose, & I guess he is self conscious about his dick size when he's soft, but I have no issue with it & he's aware of that. But after so long together, it's a very strange thing to me. Does your husband not let you touch his unless it's hard?