What Hides Behind a Gesture?