Patent №
US 9,536,443
Granted
2017-01-03
Filed 2014
Owner
INTERNATIONAL BUSINESS MACHINES CORPORATION
Lab
AI components
5
ml · nlp · speech · kr · planning
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
14262928
An approach is provided for evaluating subject matter experts (SMEs) in a question and answering (QA) system. In the approach, a number of responses are received at the QA system with each of the responses being a response to a common question and each of the responses being received from a SME. One of the responses is selected with the selected response being from one of the SMEs that is being evaluated. The approach evaluates the selected response by comparing the selected response to the responses received from the other SMEs. Based on the evaluation, the approach updates a SME confidence score that corresponds to the selected SME.
AI classification
Ownership
INTERNATIONAL BUSINESS MACHINES CORPORATION
assignment · 327660370
Assignors
HAVERLOCK, KEVIN B., ROORDA, STEPHAN J., WHITLEY, MICHAEL D.
On an employer assignment, the assignors are typically the inventors.