Is it me?

I just recently started having sex with a new guy. He's got kind of a short penis (I feel so bad for saying that 😰) but it's not to be mean.. The only real issue with that is when I try to ride him, it always slips out.. Is this because I'm loose or because of his size or something completely unrelated.. Anyone else have this issue? I hope I'm not alone..