Doing something wrong??

Alright so last night me and my bf were making out on the couch and he was kinda fingering me and touching my butt and i was liking it so I went to unzip his pants to touch his dick and I was just rubbing my hands up and down it and then he was like “uh i’m not even hard” and it was so awkward and I didn’t know what to do so we just stopped. Like was I doing something wrong? Also does anyone have any tips on giving handjobs??