He (38) gets hard around me (28) but won’t do it with me

He (38) gets hard around me but won’t do it with me

He’s said it several times that I make him hard. Even with a hug I see it’s up. He says my voice is sexy and my butt.

Problem is I’ve been in his room twice and he stops. One time he went soft. First he said he didn’t have condoms which I’m glad he told me

We have been touching eachother but he doesn’t really show eagerness to have sex with me. He’s hard but that’s it.

He’s made a comment like “I’m scared I won’t be able to please you”

But I’m thinking he’s not really attracted to me? I had stopped seeing him and sometimes he just comes to my job to hug me that’s it

He told me he likes me but at this point I’m confused.

Edit: I’m not forcing him to have sex and he has told me he’s not asexual …it’s just confusing that we are in the middle of doing it and he stops. I wish I can understand