The QALL-ME Benchmark:a Multilingual Resource of Annotated Spoken Requests for Question Answering1 1 1 1Elena Cabrio , Milen Kouylekov , Bernardo Magnini , Matteo Negri ,2 2 3 3Laura Hasler , Constantin Orasan , David Tomas´ , Jose´ L. Vicedo ,4 4Gunter¨ Neumann , Corinna Weber1 FBK- irstfcabrio, kouylekov, magnini, negrig@fbk.eu2University of WolverhamptonfL.Hasler, c.orasang@wlv.ac.uk3University of Alicanteftomas, vicedog@dlsi.ua.es4DFKIfneumann, cowe01g@dfki.deAbstractThis paper presents the QALL-ME benchmark, a multilingual resource of annotated spoken requests in the tourism domain, freelyavailable for research purposes. The languages currently involved in the project are Italian, English, Spanish and German. It introducesa semantic annotation scheme for spoken information access requests, specifically derived from Question Answering (QA) research. Inaddition to pragmatic and semantic annotations, we propose three QA-based annotation levels: the Expected Answer Type, the ExpectedAnswer Quantifier and the Question Topical Target of a request, to fully capture the content of a request and extract the sought-afterinformation. The QALL-ME benchmark is developed under the EU-FP6 QALL-ME project which aims at the realization of a shared anddistributed infrastructure for Question Answering (QA) systems on mobile devices (e.g. mobile phones). Questions are formulated by theusers in free natural language input, and the system returns the actual sequence of ...
Voir