Beyond Factoid QA: Effective Methods for Non-factoid Answer Sentence Retrieval

  • Liu Yang
  • Qingyao Ai
  • Damiano Spina
  • Ruey-Cheng Chen
  • Liang Pang
  • W. Bruce Croft
  • Jiafeng Guo
  • Falk Scholer
Proceedings of ECIR'16, 2016

Retrieving finer grained text units such as passages or sentences as answers for non-factoid Web queries is becoming increasingly important for applications such as mobile Web search. In this work, we introduce the answer sentence retrieval task for non-factoid Web queries, and investigate how this task can be effectively solved under a learning to rank framework. We design two types of features, namely semantic and context features, beyond traditional text matching features. We compare learning to rank methods with multiple baseline methods including query likelihood and the state-of-the-art convolutional neural network based method, using an answer-annotated version of the TREC GOV2 collection. Results show that features used previously to retrieve topical sentences and factoid answer sentences are not sufficient for retrieving answer sentences for non-factoid queries, but with semantic and context features, we can significantly outperform the baseline methods.

@inproceedings{yang2016beyond,
    author = {Yang, Liu Yang and Ai, Qingyao and Spina, Damiano and Chen, Ruey-Cheng 
                      and Pang, Liang and Croft,  W. Bruce and Guo, Jiafeng and Scholer, Falk},
    title = { Beyond Factoid QA:  Effective Methods for Non-factoid Answer Sentence Retrieval},
    booktitle = {Proceedings of ECIR'16},
    year = {2016}
}
Damiano Spina
Assign a menu in the Right Menu options.