Sex tips

Ive recently been seeing someone that’s significantly older than me (he’s 40 and I’m 26). We’ve only had sex twice and things just feel a little off and I don’t know how to address it, or if I even should.. I’m not on any birth control so I just use condoms. This guy totally understands and he went and got some. At the start things are going great, but once he’s inside, he gets soft at times and he’ll casually change positions and just finger me until he gets hard again. Why do you think this could be? Is it me?