First time having sex he went soft

So me and this guy have been talking for maybe a month and we finally went on a date. The date went SO well, we talked all night, heavy flirting, held hands and I invited him back to mine. We watched a movie (both movie buffs), cuddled, laughed and we ended up making out and having sex. I gave him a blow job (which he loved from the sounds he was making) and when we started having sex he went soft. I gave him another blow job and started fucking again and he went soft. I am not sure how to talk to him again because I really like him and want to fuck the shit out of him and make him cum. But I feel like maybe he doesn't like me as much as I thought? I don't know how to make him feel comfortable talking to me about what he wants. Advice ladies / gents???