He’s being distant after we had sex should I continue the conversation?

We went out on our first date had a few drinks and ended up having sex. During the date he seemed nice but now he’s not saying much so I feel weird about it. He takes hours to respond. The condom also tore a little while we were having sex so I don’t want to stop talking in case if something happens.