Evaluación de sistemas de búsqueda de respuestas con restricción de tiempo

  1. Llopis Pascual, Fernando
  2. Noguera Robles, Elisa
  3. Ferrández Rodríguez, Antonio
  4. Escapa García, Alberto
Aldizkaria:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Argitalpen urtea: 2007

Zenbakia: 39

Orrialdeak: 45-52

Mota: Artikulua

DIALNET GOOGLE SCHOLAR lock_openRUA editor

Beste argitalpen batzuk: Procesamiento del lenguaje natural

Laburpena

Previous works on evaluating the performance of Question Answering (QA) systems are focused in the evaluation of the precision. Nevertheless, the importance of the answer time never has been evaluated. In this paper, we developed a mathematic procedure in order to explore new evaluation measures in QA systems considering the answer time. Also, we carried out an exercise for the evaluation of QA systems within a time constraint in the CLEF-2006 campaign, using the proposed measures. The main conclusion is that the evaluation of QA systems in realtime can be a new scenario for the evaluation of QA systems.

Datuen iturria: Dialnet