What the robot knows