EVOLVING UNIVERSAL GESTURE SETS

In a gesture-based system, gestures may control aspects of a computing environment or application, where the gestures may be derived from a user's position or movement in a physical space. Gesture recognition data, used to recognize gestures from captured data representative of a user's input gestures, may be evolved based on captured data from a plurality of users. A common set or default set of gesture recognition data may be evolved by selecting a plurality of users for tracking. Captured data of the plurality of users may be processed to identify input gesture data for the plurality of users, and the gesture recognition data may be evolved based on features of the input gesture data that is common to multiple users. The evolved gesture recognition data may be implemented not only for the users tracked, but for users not tracked. An identifier may identify when the evolved gesture recognition data applies and implement the evolved gesture recognition data when the identifier is present.