Do you think he isn’t interested?

We’ve been on a few dates and the dates normally last all day because he doesn’t want me to go home. I’m 27 and he’s 40. I’ve noticed though I have to be the one to reach out. If I don’t text/call him then we just don’t talk. Last time I seen him was two days ago and I went to his house. We had dinner with his kids (they’re 16/17) and all watched a movie together. Then him and I went to his room. We had sex and then right after he said “okay so what’s the plan? Are you staying the night or going home?” I felt weird that he said that immediately after we had sex- hadn’t even gotten dressed yet so I told him I’d let him get some sleep and headed home. I’m just confused since I haven’t heard from him since then and not sure if I should continue just being the one to reach out.