Patent US 9,749,574

Techniques are disclosed that can be implemented as a system configured for image matching-based pointing and/or selection from information presented in an image displayed by a projection device. A pointing device configured as described herein may be pointed at a target portion of an image displayed by a projection device and allowed to capture an image inclusive of that target portion. In turn, the captured image data may be compared with data pertaining to the original displayed image. The resultant pointing location data can be used to generate one or more pointing indicators within the original image, and the projection device may display the resultant annotated image on screen, in some cases in real time and/or with precision resolution of a single pixel. A subsequent user selection can be made based on the known location of the pointing indicator. The techniques provide for more native human-machine interaction than existing approaches.