SECTION 3.3. A BENEFIT, SINCE IT GIVES MORE OPPORTUNITY FOR ENFORC-

5.2 Better confidences

testing.

Even if no changes to the ranking are produced by

the Constraints process, then the mere act of valida-

In direct QA, when an A

NSWER

S

ELECTION

module

tion (or not) of existing answers can be used to ad-

generates two (or more) equivalent correct answers

just confidence scores. In TREC2002 (Voorhees,

to a question (e.g. “Ferdinand Marcos” vs. “Presi-