Information Retrieval Evaluation in a Changing World: Lessons Learned from 20 Years of Clef
暫譯: 在變化的世界中進行資訊檢索評估:從20年的CLEF經驗中學到的教訓
Ferro, Nicola, Peters, Carol
- 出版商: Springer
- 出版日期: 2019-08-26
- 售價: $7,120
- 貴賓價: 9.5 折 $6,764
- 語言: 英文
- 頁數: 595
- 裝訂: Hardcover - also called cloth, retail trade, or trade
- ISBN: 3030229475
- ISBN-13: 9783030229474
海外代購書籍(需單獨結帳)
相關主題
商品描述
This volume celebrates the twentieth anniversary of CLEF - the Cross-Language Evaluation Forum for the first ten years, and the Conference and Labs of the Evaluation Forum since - and traces its evolution over these first two decades. CLEF's main mission is to promote research, innovation and development of information retrieval (IR) systems by anticipating trends in information management in order to stimulate advances in the field of IR system experimentation and evaluation.
The book is divided into six parts. Parts I and II provide background and context, with the first part explaining what is meant by experimental evaluation and the underlying theory, and describing how this has been interpreted in CLEF and in other internationally recognized evaluation initiatives. Part II presents research architectures and infrastructures that have been developed to manage experimental data and to provide evaluation services in CLEF and elsewhere. Parts III, IV and V represent the core of the book, presenting some of the most significant evaluation activities in CLEF, ranging from the early multilingual text processing exercises to the later, more sophisticated experiments on multimodal collections in diverse genres and media. In all cases, the focus is not only on describing "what has been achieved", but above all on "what has been learnt". The final part examines the impact CLEF has had on the research world and discusses current and future challenges, both academic and industrial, including the relevance of IR benchmarking in industrial settings.
Mainly intended for researchers in academia and industry, it also offers useful insights and tips for practitioners in industry working on the evaluation and performance issues of IR tools, and graduate students specializing in information retrieval.
商品描述(中文翻譯)
本卷慶祝CLEF(跨語言評估論壇)成立二十周年,前十年為CLEF的歷程,後十年則為評估論壇的會議與實驗室,並追溯其在這二十年間的演變。CLEF的主要使命是透過預測資訊管理的趨勢,促進資訊檢索(IR)系統的研究、創新與發展,以刺激IR系統實驗與評估領域的進步。
本書分為六個部分。第一部分和第二部分提供背景和上下文,第一部分解釋了實驗評估的意義及其基礎理論,並描述了這在CLEF及其他國際認可的評估倡議中的詮釋方式。第二部分介紹了為了管理實驗數據和提供CLEF及其他地方的評估服務而開發的研究架構和基礎設施。第三、第四和第五部分是本書的核心,展示了CLEF中一些最重要的評估活動,從早期的多語言文本處理練習到後來在多模態集合中進行的更為複雜的實驗,涵蓋各種類型和媒介。在所有情況下,重點不僅在於描述「已經達成的成果」,而是更重要的是「所學到的知識」。最後一部分探討了CLEF對研究界的影響,並討論了當前和未來的挑戰,包括學術界和產業界的挑戰,以及IR基準測試在產業環境中的相關性。
本書主要針對學術界和產業界的研究人員,同時也為在IR工具的評估和性能問題上工作的產業從業者以及專攻資訊檢索的研究生提供有用的見解和建議。
作者簡介
Nicola Ferro is an Associate Professor of Computer Science at the University of Padua, Italy. His research interests include information retrieval, its experimental evaluation, multilingual information access and digital libraries. He is the coordinator of the CLEF evaluation initiative, which includes more than 200 research groups around the globe involved in large-scale IR evaluation activities. He was also the coordinator of the EU Seventh Framework Programme Network of Excellence PROMISE on information retrieval evaluation.
Carol Peters, now Research Associate, was a Researcher at the Italian National Research Council's "Istituto di Scienza e Tecnologie dell'Informazione." Her main research activities focused on the development of multilingual access mechanisms for digital libraries and evaluation methodologies for cross-language information retrieval systems. She was leader of the EU Sixth Framework MultiMatch project, and coordinated the Cross-Language Evaluation Forum (CLEF) during its first ten years of activity. In 2009, in recognition of her work for CLEF, she was awarded the Tony Kent Strix Award.
作者簡介(中文翻譯)
尼科拉·費羅是義大利帕多瓦大學的計算機科學副教授。他的研究興趣包括資訊檢索、其實驗評估、多語言資訊存取和數位圖書館。他是CLEF評估計畫的協調者,該計畫包括全球超過200個參與大型資訊檢索評估活動的研究團隊。他也是歐盟第七框架計畫的卓越網絡PROMISE的協調者,該計畫專注於資訊檢索評估。
卡羅爾·彼得斯,目前是研究助理,曾是義大利國家研究委員會「資訊科學與技術研究所」的研究員。她的主要研究活動集中在數位圖書館的多語言存取機制的開發以及跨語言資訊檢索系統的評估方法。她是歐盟第六框架的MultiMatch專案的負責人,並在其前十年的活動中協調了跨語言評估論壇(CLEF)。2009年,因其對CLEF的貢獻,她獲得了托尼·肯特·斯特里克斯獎。