TY - BOOK ID - 8581518 TI - Interactive multi-modal question-answering AU - Bosch, Antal van den. AU - Bouma, Gosse. PY - 2011 SN - 3642175244 3642175252 PB - New York : Springer, DB - UniCat KW - Human-computer interaction. KW - System design. KW - User interfaces (Computer systems) -- Design. KW - Multimodal user interfaces (Computer systems) KW - Multimedia systems KW - Information storage and retrieval systems KW - Question-answering systems KW - Engineering & Applied Sciences KW - Computer Science KW - Question-answering systems. KW - Computer science. KW - Information storage and retrieval. KW - Multimedia information systems. KW - User interfaces (Computer systems). KW - Computer Science. KW - Multimedia Information Systems. KW - Signal, Image and Speech Processing. KW - User Interfaces and Human Computer Interaction. KW - Information Storage and Retrieval. KW - Interfaces, User (Computer systems) KW - Human-machine systems KW - Human-computer interaction KW - Computer-based multimedia information systems KW - Multimedia computing KW - Multimedia information systems KW - Multimedia knowledge systems KW - Informatics KW - Science KW - Artificial intelligence KW - Problem solving KW - Multimedia systems. KW - Information storage and retrieva. KW - Information storage and retrieval systems. KW - Automatic data storage KW - Automatic information retrieval KW - Automation in documentation KW - Computer-based information systems KW - Data processing systems KW - Data storage and retrieval systems KW - Discovery systems, Information KW - Information discovery systems KW - Information processing systems KW - Information retrieval systems KW - Machine data storage and retrieval KW - Mechanized information storage and retrieval systems KW - Computer systems KW - Electronic information resources KW - Data libraries KW - Digital libraries KW - Information organization KW - Information retrieval KW - Signal processing. KW - Image processing. KW - Speech processing systems. KW - Computational linguistics KW - Electronic systems KW - Information theory KW - Modulation theory KW - Oral communication KW - Speech KW - Telecommunication KW - Singing voice synthesizers KW - Pictorial data processing KW - Picture processing KW - Processing, Image KW - Imaging systems KW - Optical data processing KW - Processing, Signal KW - Information measurement KW - Signal theory (Telecommunication) UR - https://www.unicat.be/uniCat?func=search&query=sysid:8581518 AB - This book is the result of a group of researchers from different disciplines asking themselves one question: what does it take to develop a computer interface that listens, talks, and can answer questions in a domain? First, obviously, it takes specialized modules for speech recognition and synthesis, human interaction management (dialogue, input fusion, andmultimodal output fusion), basic question understanding, and answer finding. While all modules are researched as independent subfields, this book describes the development of state-of-the-art modules and their integration into a single, working application capable of answering medical (encyclopedic) questions such as "How long is a person with measles contagious?" or "How can I prevent RSI?". The contributions in this book, which grew out of the IMIX project funded by the Netherlands Organisation for Scientific Research, document the development of this system, but also address more general issues in natural language processing, such as the development of multidimensional dialogue systems, the acquisition of taxonomic knowledge from text, answer fusion, sequence processing for domain-specific entity recognition, and syntactic parsing for question answering. Together, they offer an overview of the most important findings and lessons learned in the scope of the IMIX project, making the book of interest to both academic and commercial developers of human-machine interaction systems in Dutch or any other language. Highlights include: integrating multi-modal input fusion in dialogue management (Van Schooten and Op den Akker), state-of-the-art approaches to the extraction of term variants (Van der Plas, Tiedemann, and Fahmi; Tjong Kim Sang, Hofmann, and De Rijke), and multi-modal answer fusion (two chapters by Van Hooijdonk, Bosma, Krahmer, Maes, Theune, and Marsi). Watch the IMIX movie at www.nwo.nl/imix-film . Like IBM's Watson, the IMIX system described in the book gives naturally phrased responses to naturally posed questions. Where Watson can only generate synthetic speech, the IMIX system also recognizes speech. On the other hand, Watson is able to win a television quiz, while the IMIX system is domain-specific, answering only to medical questions. "The Netherlands has always been one of the leaders in the general field of Human Language Technology, and IMIX is no exception. It was a very ambitious program, with a remarkably successful performance leading to interesting results. The teams covered a remarkable amount of territory in the general sphere of multimodal  question answering and information delivery, question answering, information extraction and component technologies." Eduard Hovy, USC, USA, Jon Oberlander, University of Edinburgh, Scotland, and Norbert Reithinger, DFKI, Germany . ER -