personality or penis size?

This guy I've been talking to and I decided to have sex a few days ago and I found out that he is on the small side.. like really small. I'm not trying to be rude or anything but I definitely consider myself to be experienced and I guess fortunate to always have had a guy with a nice size/ large dick. I know people always say that "size shouldn't matter, that personality and obviously how they treat you should be the most important and you'll learn to work with what they have" buuutt For me, the physical aspect of relationships is equally as important as the other part. 

Anyway, I guess I'm just curious as to what you would do in my position; like would you keep talking to him or stop??