MACHINE GRADING OF SHORT ANSWERS WITH EXPLANATIONS

Patent №

US 11,450,225

Granted

2022-09-20

Filed 2021

Owner

QUIZLET, INC.

+1 more

Lab

AI components

6

ml · nlp · vision · speech · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17501429

An example method embodying the disclosed technology comprises: digitally storing Teacher models and a Student model at a server computer; training each model with a corpus of unlabeled training data using Masked Language Modeling; fine-tuning each Teacher model for an ASAG task with labeled ground truth data; executing each Teacher model to generate and digitally store a respective set of class probabilities on an unlabeled task-specific data set for the ASAG task; further training the Student model by a linear ensemble of the Teacher models using KD; receiving, at the server computer, digital input comprising a target response text and a corresponding target reference answer text; programmatically inputting the target response text and the corresponding target reference answer text to the Student model, thereby outputting a corresponding predicted binary label; displaying correction data indicating the corresponding predicted binary label in a GUI; and, optionally, displaying explainability data in the GUI.

Machine learningNatural languageVisionSpeechPlanningAI hardwareG06F 40/35G09B 7/04G06F 17/18G06F 40/20G06F 40/30G06N 3/045G06N 3/0895G06N 3/096+1 more

AI classification

Natural language1.00
Machine learning1.00
Speech1.00
AI hardware1.00
Vision1.00
Planning1.00
Knowledge representation0.23
Evolutionary computation0.00

Ownership

QUIZLET, INC.

assignment · 578670106

JPMORGAN CHASE BANK, N.A.

correct · 636720460

Assignors

KILARI, MURALI KRISHNA TEJA, MOONEY, SHANE CURTIS, CHENG, LINGFENG

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC