Potty training help.

Not sure where to post. So I am potty training my son. Sometimes he tells me he needs to go other times he doesn't. Sometimes he'll tell me after he went in his diaper. Anyway I read somewhere to leave them in shorts with no diaper so they don't have that snug security of the diaper. So my question is if he does go potty in his shorts do I let him sit in it so he can feel that discomfort or change him right away?