19 AND 20 CONTAIN BOTH FACTUAL AS WELL AS @1 @5 @10 @ 50 OPINION A...
18, 19 and 20 contain both factual as well as
@1
@5
@10
@ 50
opinion aspects and the OQA system performed
better than the TQA, although in some cases,
TQA
OQA
TQA
OQA
TQA
OQA
TQA
OQA
1
F 9
1
0
0
1
1
1
1
3
answers were lost due to the artificial boosting of
2
F
13
0
1
2
3
0
6
11
7
the queries containing NEs of the EAT (Ex-
3
F 2
0
1
0
2
0
2
2
2
pected Answer Type). Therefore, it is obvious
4
F 1
0
0
0
0
0
0
1
0
5
F 3
0
0
0
0
0
0
1
0
that an extra method for answer ranking should
6
F 2
0
0
0
1
0
1
2
1
be used, as Answer Validation techniques using
7
F 4
0
0
0
0
1
0
4
0
Textual Entailment. In Table 3, the OQA missed
8
F 1
0
0
0
0
0
0
1
0
9
O 5
0
1
0
2
0
2
0
4
some of the answers due to erroneous sentence
10
O 2
0
0
0
0
0
0
0
0
splitting, either separating text into two sentences
11
O 5
0
0
0
1
0
2
0
3
where it was not the case or concatenating two
12
O 2
0
0
0
1
0
1
0
1
13
O 8
0
1
0
2
0
2
0
4
consecutive sentences; thus missing out on one
14
O
25
0
1
0
2
0
4
0
8
of two consecutively annotated answers. Exam-
15
O
36
0
1
0
2
0
6
0
15
ples are questions number 16 and 17, where
16
O
23
0
0
0
0
0
0
0
0
17
O
50
0
1
0
5
0
6
0
10
many blog entries enumerated the different ar-
18
O
10
0
1
0
1
0
2
0
2
guments in consecutive sentences. Another
19
O 4
0
1
0
1
0
1
0
1
source of problems was the fact that we gave a
20
O 4
0
1
0
1
0
1
0
1