INTERACTIVE COMPLEX TASK TEACHING SYSTEM THAT ALLOWS FOR NATURAL LANGUAGE INPUT, RECOGNIZES A USER'S INTENT, AND AUTOMATICALLY PERFORMS TASKS IN DOCUMENT OBJECT MODEL (DOM) NODES

A system which allows a user to teach a computational device how to perform complex, repetitive tasks that the user usually would perform using the device's graphical user interface (GUI) often but not limited to being a web browser. The system includes software running on a user's computational device. The user “teaches” task steps by inputting natural language and demonstrating actions with the GUI. The system uses a semantic ontology and natural language processing to create an explicit representation of the task that is stored on the computer. After a complete task has been taught, the system is able to automatically execute the task in new situations. Because the task is represented in terms of the ontology and user's intentions, the system is able to adapt to changes in the computer code while still pursuing the objectives taught by the user.