Evaluación de sistemas de búsqueda de respuestas con restricción de tiempo
- Llopis Pascual, Fernando
- Noguera Robles, Elisa
- Ferrández Rodríguez, Antonio
- Escapa García, Alberto
ISSN: 1135-5948
Année de publication: 2007
Número: 39
Pages: 45-52
Type: Article
D'autres publications dans: Procesamiento del lenguaje natural
Résumé
Previous works on evaluating the performance of Question Answering (QA) systems are focused in the evaluation of the precision. Nevertheless, the importance of the answer time never has been evaluated. In this paper, we developed a mathematic procedure in order to explore new evaluation measures in QA systems considering the answer time. Also, we carried out an exercise for the evaluation of QA systems within a time constraint in the CLEF-2006 campaign, using the proposed measures. The main conclusion is that the evaluation of QA systems in realtime can be a new scenario for the evaluation of QA systems.