Multilingual Question-Answering System in Biomedical Domain on the Web: An Evaluation

Olvera-Lobo, María-Dolores and Gutiérrez-Artacho, Juncal . Multilingual Question-Answering System in Biomedical Domain on the Web: An Evaluation., 2011 In: UNSPECIFIED, (ed.) Lecture Notes in Computer Science. Springer-Verlag Berlin Heidelberg, pp. 83-88. [Book chapter]

Multilingual Question-Answering System in Biomedical Domain on the Web - An Evaluation.pdf

Download (136kB) | Preview

English abstract

Question-answering systems (QAS) are presented as an alternative to traditional systems of information retrieval, intended to offer precise responses to factual questions. An analysis has been made of the results offered by the QA multilingual biomedical system HONqa, available on the Web. The study has used a set of 120 biomedical definitional questions (What is...?), taken from the medical website WebMD, which were formulated in English, French, and Italian. The answers have been analysed using a serie of specific measures (MRR, TRR, FHS, precision, MAP). The study confirms that for all the languages analysed the functioning effectiveness needs to be improved, although in the multilingual context analysed the questions in the English language achieve better results for retrieving definitional information than in French and Italian.

Item type: Book chapter
Keywords: Multilingual information, Multilingual Question Answering Systems, Restricted-domain Question Answering Systems, HONqa, Biomedical information, Evaluation measures
Subjects: L. Information technology and library technology
Depositing user: Maria Dolores/ M.D. Olvera Lobo
Date deposited: 23 Jul 2018 16:00
Last modified: 23 Jul 2018 16:00


Ely, J.W., Osheroff, P.N., Ebell, M., Bergus, G., Barcey, L., Chambliss, M., Evans, E.: Analysis of questions asked by family doctors regarding patient care. British Medical Journal 319, 358–361 (1999)

Lee, M., Cimino, J., Zhu, H.R., Sable, C., Shanker, V., Ely, J., Yu, H.: Beyond Information Retrieval –Medical Question Answering. AMIA, Washington DC (2006)

Yu, H., Kaufman, D.: A cognitive evaluation of four online search engines for answering definitional questions posed by physicians. In: Pacific Symposium on Biocomputing, vol. 12, pp. 328–339 (2007)

Zweigenbaum, P.: Question answering in biomedicine. In: Rijke, Webber (eds.) Proceedings Workshop on Natural Language Processing for Question Answering, EACL 2003, pp. 1–4. ACL, Budapest (2005)

Costa L.F., Santos, D.: Question Answering Systems: a partial answer (SINTEF, Oslo) (2007)

Blair-Goldensohn, S., McKeown, K., Schlaikjer, A.H.: Answering Definitional Questions: A Hybrid Approach. New Directions in Question Answering 4, 47–58 (2004)

Olvera-Lobo, M.D., Gutiérrez-Artacho, J.: Language resources used in Multi-lingual Question Answering Systems. Online Information Review 35(4) (forthcoming, 2011)

Cui, H., Kan, M.Y., Chua, T.S., Xiao, J.: A Comparative Study on Sentence Retrieval for Definitional Question Answering. In: SIGIR Workshop on Information retrieval for Question Answering (IR4QA), Sheffield (2004)

Tsur, O.: Definitional Question-Answering Using Trainable Text Classifiers. PhD Thesis. University of Amsterdam (2003)

Olvera-Lobo, M.D., Gutiérrez-Artacho, J.: Question-Answering Systems as Efficient Sources of Terminological Information: Evaluation. Health Information and Library Journal 27(4), 268–274 (2010)

Diekema, A. R.: Translation Events in Cross-Language Information Retrieval: Lexical ambiguity, lexical holes, vocabulary mismatch, and correct translations. PhD Thesis. University of Syracuse (2003)

Cruchet, S., Gaudinat, A., Rindflesch, T., Boyer, C.: What about trust in the Question Answering world? In: AMIA 2009 Annual Symposium, San Francisco (2009)

Blair, D.C.: Searching biases in large interactive document retrieval systems. Journal of the American Society for Information Science 31(4), 271–277 (1980)

Peters, C.: What Happened in CLEF 2009: Introduction to the Working Notes. In: Peters, C., Di Nunzio, G.M., Kurimo, M., Mostefa, D., Penas, A., Roda, G. (eds.) CLEF 2009. LNCS, vol. 6241, pp. 1–12. Springer, Heidelberg (2010),

Raved, D.R., Qi, H., Wu, H. Fan, W.: Evaluating Web-based Question Answering Systems. Technical Report, University of Michigan (2001)

Salton, G., Mc Gill, M.J.: Introduction to Modern Information Retrieval. Mc Graw-Hill, New York (1983)


Downloads per month over past year

Actions (login required)

View Item View Item