knowing where he's going?

Whenever my bf leaves he tells me he's going somewhere like the store or his mans house. Sometime he'll go from the store straight to somewhere else and come home hours later. So when I text him "are you coming straight home?" He asks "why? You need something?" And he just can never say "nah I'm finna chill out here for a little" never! He always does that! I don't understand why he can never go from point A to point B and come straight back to point A. And if something were to happen to him and the police ask me "well what did he say he was leaving to do?" I'm gunna have no choice but to be like "I have no clue". Am I over-reacting or is there any methods to just not GAF where he is? Cause god -.-