Does size matter?

I feel like this is a question people have been asking for years. I'm getting into a serious relationship with my bestfriend of 5 years, and we've been in the talking stage 4 months. He knows everything about me, he's a gentleman, he can cook, clean, works out, he's extremely hard working, good to me overall. However we had sex for the first time last night and it wasn't the best. I dont think it was him, I think I was thinking too much about him being my bestfriend to even enjoy myself. He's not the biggest I've had but he does good positions and strokes. I'm gonna try with him again to see if its better next time. But I honestly feel like if the sex isnt good that a deal breaker for me. I know relationships aren't just about sex but that's a big part of a relationship.