WE DEFINE STRICT PRECISION (P 1 ) ASOLD, WE ACCEPT IN OUR CANDIDATE SET PART OF THE DOCUMENTS HAV-THE RATIO BETWEEN THE NUMBER OF RESULTS RATED ASING THE NEXT LOWEST READABILITY – OR A MEDIUM READABILITY IF THERELEVANT AND ALL THE RETURNED RESULTS, AND L...

1. Relevance: we define strict precision (P ₁ ) as

old, we accept in our candidate set part of the documents hav-

the ratio between the number of results rated as

ing the next lowest readability – or a medium readability if the

relevant and all the returned results, and loose pre-

user’s reading level is low

cision (P ₂ ) as the ratio between the number of re-

general satisfaction values for U in Tab. 1 show

sults rated as relevant or partially relevant and all

an improved preference for YourQA.

the returned results.

7 Conclusion