PROVIDING INSTRUCTIONS DURING REMOTE VIEWING OF A USER INTERFACE

Patent №

US 11,201,906

Granted

2021-12-14

Filed 2017

Owner

INTERNATIONAL BUSINESS MACHINES CORPORATION

AI components

1

hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

15689038

Method and system are provided for providing instructions during remote viewing of a user interface. The method carried out at a host computer system includes: capturing an image of one or more application user interfaces as displayed at the host computer system; and serializing data of each application user interface to provide a map of each window class and containers and/or control elements of the window class, wherein a container has attributes and child control elements. The captured image and the map are transmitted to a remote computer system; and control element input instructions are received from a remote computer system for instructing an interaction with a control element.

AI hardwareH04L 67/025G06F 3/04842G06Q 10/101H04L 65/403H04L 67/131

AI classification

AI hardware0.54
Vision0.23
Natural language0.01
Knowledge representation0.01
Planning0.00
Machine learning0.00
Evolutionary computation0.00
Speech0.00

Ownership

INTERNATIONAL BUSINESS MACHINES CORPORATION

assignment · 437110527

Assignors

HE, JENNY J., KYTE, ADRIAN, LIU, GUAN JUN, WINCHESTER, JOE, ZHOU, BEI CHUN

On an employer assignment, the assignors are typically the inventors.

From the same owner

© 2026 NYSGPT2525 LLC