GENERAL SPATIAL-GESTURE GRAMMAR USER INTERFACE FOR TOUCHSCREENS, HIGH DIMENSIONAL TOUCH PAD (HDTP), FREE-SPACE CAMERA, AND OTHER USER INTERFACES

A system for a spatial-gesture user interface employing grammatical rules at various levels. Various distinct subset of the gestemes can be concatenated in space and time to construct a distinct gestures. Real-time spatial-gesture information measured by a spatial-gesture user interface is processed to at least a recognized sequence of specific gestemes and that the sequence of gestemes that the user's execution a gesture has been completed. The specific gesture rendered by the user is recognized according to the sequence of gestemes. Many additional features are then provided from this foundation, including gesture grammars, structured-meaning gesture-lexicon, imposed interpretations, context, and the use of gesture-rendering prosody. The invention can be used to provide very general spatial-gesture grammar user interface for touchscreens, high dimensional touch pad (hdtp), free-space camera, and other user interfaces.