1 RECIPROCAL QUESTIONS ORGANIZATIONS AND THINGS, OR MAJOR SUBCLASSES...

3.1 Reciprocal Questions

organizations and things, or major subclasses of

QDC also employs the notion of reciprocal ques-

these), we can for each of these classes manually

tions. These are a type of follow-on question used

establish once and for all a set of auxiliary questions

solely to provide constraints, and do not add to the

for QbD and constraints for QDC. This is the ap-

dossier. The idea is simply to double-check the an-

proach we have taken in the experiments reported

swer to a question by inverting it, substituting the

here. We are currently working on automatically

first-round answer and hoping to get the original

learning effective auxiliary questions for some of

subject back. For example, to double-check “Sac-

these classes.

ramento” as the answer to “What is the capital of

In a more ad-hoc situation, we might imagine that

California?” we would ask “Of what state is Sacra-

a simple variety of QDC will be invoked using

mento the capital?”. The reciprocal question would

solely reciprocal questions whenever the difference

be asked of all of the candidate answers, and the

between the scores of the first and second answer is

confidences of the answers to the reciprocal ques-

below a certain threshold.

tions would contribute to the selection of the opti-