Size issues

I turn down guys all the time because I think their dick is small and sometimes cause I can tell the dick come with too many problems. Is that a bad thing?