Does size matter??

My boyfriend is actually pretty average. But I was just wondering what y'all think, does size really matter?