Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, today’s smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and students—anyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one.

Information storage and retrieval. --- Information Storage and Retrieval. --- Information storage. --- Information retrieval. --- Data retrieval --- Data storage --- Discovery, Information --- Information discovery --- Information storage and retrieval --- Retrieval of information --- Documentation --- Information science --- Information storage and retrieval systems --- Information Storage and Retrieval --- Evaluation --- Information Retrieval --- Multilingual Information Access --- NTCIR --- Test Collections --- Information Search --- Information Storage --- Artificial Intelligence --- Open Acces --- Information retrieval --- Data warehousing

Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

This book constitutes the thoroughly refereed proceedings of the 8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, held in Budapest, Hungary, September 2007. The revised and extended papers were carefully reviewed and selected for inclusion in the book. There are 115 contributions in total and an introduction. The seven distrinct evaluation tracks in CLEF 2007, are designed to test the performance of a wide range of multilingual information access systems or system components. The papers are organized in topical sections on Multilingual Textual Document Retrieval (Ad Hoc), Domain-Specific Information Retrieval (Domain-Specific), Multiple Language Question Answering (QA@CLEF), cross-language retrieval in image collections (Image CLEF), cross-language speech retrieval (CL-SR), multilingual Web retrieval (WebCLEF), cross-language geographical retrieval (GeoCLEF), and CLEF in other evaluations.

Computer architecture. Operating systems --- Information systems --- Artificial intelligence. Robotics. Simulation. Graphics --- Computer. Automation --- Translation science --- Mathematical linguistics --- Linguistics --- ICT (informatie- en communicatietechnieken) --- IR (information retrieval) --- spraaktechnologie --- vertalen --- linguïstiek --- informatiesystemen --- database management --- KI (kunstmatige intelligentie) --- robots

Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

The seventhcampaignof the CrossLanguageEvaluationForum (CLEF)for - ropean languages was held from January to September 2006. There were eight evaluationtracksinCLEF2006,designedtotesttheperformanceofawiderange of multilingual information access systems or system components. A total of 90 groupsfromallovertheworldsubmittedresultsforoneormoreoftheevaluation tracks. Fulldetailsregardingthetrackdesign,theevaluationmethodologies,and the results obtained by the participants can be found in the di?erent sections of these proceedings. The results of the campaign were reported and discussed at the annual workshop, held in Alicante, Spain, 20-22 September, immediately following the 10th EuropeanConference on Digital Libraries. The workshopwas attended by approximately 130 researchers and system developers. In addition to presentationsinplenaryand parallelsessions,the poster sessionandbreakout meetings gave participants a chance to discuss ideas and results in detail. An invited talk was givenby Noriko Kando from the National Institute of Inform- ics, Tokyo on the NTCIR evaluation initiative for Asian languages. The ?nal session focussed on technical transfer issues. Martin Braschler,fromtheUniv- sity of Applied Sciences Winterthur, Switzerland, gave a talk on What MLIA Applications Can Learn from Evaluation Campaigns  while Fredric Gey from the University of California, Berkeley, USA, summarised some of the main c- clusionsoftheMLIAworkshopatSIGIR2006,wheremuchofthediscussionwas concentratedon problems involvedin building and marketing commercial MLIA systems. The workshop was preceded by two related events. On 19 September, the ImageCLEF group, together with the MUSCLE Networkof Excellence, held a joint meeting on Usage-Oriented Multimedia Information Retrieval Eva- ation .

Information systems --- Artificial intelligence. Robotics. Simulation. Graphics --- Computer. Automation --- Translation science --- Linguistics --- ICT (informatie- en communicatietechnieken) --- IR (information retrieval) --- vertalen --- linguïstiek --- informatiesystemen --- database management --- KI (kunstmatige intelligentie) --- robots

Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

Computer architecture. Operating systems --- Information systems --- Artificial intelligence. Robotics. Simulation. Graphics --- Computer. Automation --- Translation science --- Mathematical linguistics --- Linguistics --- ICT (informatie- en communicatietechnieken) --- IR (information retrieval) --- spraaktechnologie --- vertalen --- linguïstiek --- informatiesystemen --- database management --- KI (kunstmatige intelligentie) --- robots