Does size affect ttc?

Ok let me start off by saying I LOVE my man... However he's not exactly packing down below. In the past I've only dated black men who have always been on the larger side, I'm wondering if because he's kinda small the sperm aren't getting deep enough to get where they need to be. We've been ttc for 6 months now