When he realizes that you really did leave him alone he will want to wander around to find you.