PROVIDING A SET OF USER INPUT ACTIONS TO A MOBILE DEVICE TO CAUSE PERFORMANCE OF THE SET OF USER INPUT ACTIONS

Patent №

US 10,248,440

Granted

2019-04-02

Filed 2017

Owner

GOOGLE INC.

AI components

2

vision · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

15783390

Systems and methods are provided for automating user input using onscreen content. For example, a method includes receiving a selection of a first screen capture image representing a screen captured on a mobile device associated with a user, the first image having a first timestamp. The method also includes determining, using a data store of images of previously captured screens of the mobile device, a reference image from the data store that has a timestamp prior to the first timestamp, identifying a plurality of images in the data store that have respective timestamps between the timestamp for the reference image and the first timestamp, and providing the reference image, the plurality of images, and the first image to the mobile device.

VisionAI hardwareG06F 9/451G06F 3/04842G06F 3/04845G06F 16/156G06F 16/2228G06F 16/24578G06F 16/583G06F 16/5854+10 more

AI classification

Vision1.00
AI hardware0.83
Planning0.36
Knowledge representation0.34
Natural language0.09
Evolutionary computation0.02
Machine learning0.01
Speech0.00

Ownership

GOOGLE INC.

assignment · 483380680

Assignors

PETROU, DAVID, SHARIFI, MATTHEW

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC