SYSTEMS AND METHODS FOR AUTOMATED SCORING OF TEXTUAL RESPONSES TO PICTURE-BASED ITEMS

Patent №

US 9,836,985

Granted

2017-12-05

Filed 2015

Owner

EDUCATIONAL TESTING SERVICE

Lab

AI components

6

ml · nlp · vision · speech · kr · planning

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

14633314

Systems and methods are provided for measuring a user's English language proficiency. A constructed response generated by a user is received, the constructed response being based on a picture. The constructed response is processed to determine a first numerical measure indicative of a presence of one or more grammar errors in the constructed response. The constructed response is processed to determine a second numerical measure indicative of a degree to which the constructed response describes a subject matter of the picture. The constructed response is processed to determine a third numerical measure indicative of a degree of awkward word usage in the constructed response. A model is applied to the first, second, and third numerical measures to determine a score for the constructed response indicative of the user's English language proficiency. The model includes first, second, and third variables with associated first, second, and third weighting factors, respectively.

AI classification

Natural language1.00
Speech1.00
Vision1.00
Machine learning1.00
Knowledge representation0.83
Planning0.77
AI hardware0.06
Evolutionary computation0.00

Ownership

EDUCATIONAL TESTING SERVICE

assignment · 388540443

Assignors

SOMASUNDARAN, SWAPNA, CHODOROW, MARTIN, TETREAULT, JOEL

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC