CLEF 2009 Ad Hoc Track Overview: TEL and Persian Tasks
2010, Lecture Notes in Computer Science
https://doi.org/10.1007/978-3-642-15754-7_2Abstract
The 2009 Ad Hoc track was to a large extent a repetition of last year's track, with the same three tasks: Tel@CLEF, Persian@CLEF, and Robust-WSD. In this first of the two track overviews, we describe the objectives and results of the TEL and Persian tasks and provide some statistical analyses.
References (21)
- M. Agosti, G. M. Di Nunzio, and N. Ferro. The Importance of Scientific Data Curation for Evaluation Campaigns. In C. Thanos and F. Borri, editors, DELOS Conference 2007 Working Notes, pages 185-193. ISTI-CNR, Gruppo ALI, Pisa, Italy, February 2007.
- O. Alonso and S. Mizzaro. Can we get rid of TREC assessors? Using Mechan- ical Turk for relevance assessment. In S. Geva, J. Kamps, C. Peters, T. Sakai, A. Trotman, and E. Voorhees, editors, Proc. SIGIR 2009 Workshop on The Future of IR Evaluation. http://staff.science.uva.nl/ ~kamps/ireval/papers/paper_ 22.pdf, 2009.
- M. Braschler. CLEF 2002 -Overview of Results. In C. Peters, M. Braschler, J. Gonzalo, and M. Kluck, editors, Advances in Cross-Language Information Re- trieval: Third Workshop of the Cross-Language Evaluation Forum (CLEF 2002) Revised Papers, pages 9-27. Lecture Notes in Computer Science (LNCS) 2785, Springer, Heidelberg, Germany, 2003.
- M. Braschler and C. Peters. CLEF 2003 Methodology and Metrics. In C. Peters, M. Braschler, J. Gonzalo, and M. Kluck, editors, Comparative Evaluation of Multi- lingual Information Access Systems: Fourth Workshop of the Cross-Language Eval- uation Forum (CLEF 2003) Revised Selected Papers, pages 7-20. Lecture Notes in Computer Science (LNCS) 3237, Springer, Heidelberg, Germany, 2004.
- C. W. Cleverdon. The Cranfield Tests on Index Languages Devices. In K. Spärck Jones and P. Willett, editors, Readings in Information Retrieval, pages 47-60.
- G. M. Di Nunzio and N. Ferro. Appendix A: Results of the TEL@CLEF Task. In this volume.
- G. M. Di Nunzio and N. Ferro. Appendix B: Results of the Persian@CLEF Task. In this volume.
- M. Sanderson and H. Joho. Forming Test Collections with No System Pooling. In M. Sanderson, K. Järvelin, J. Allan, and P. Bruza, editors, Proc. 27th Annual In- ternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2004), pages 33-40. ACM Press, New York, USA, 2004.
- S. Tomlinson. German, French, English and Persian Retrieval Experiments at CLEF 2009. In this volume.
- Tomlinson, S.: Sampling Precision to Depth 10000 at CLEF 2008. Systems for Mul- tilingual and Multimodal Information Access: 9th Workshop of the Cross-Language Evaluation Forum (CLEF 2008). Revised Selected Papers, Lecture Notes in Com- puter Science (LNCS) 5706, Springer, Heidelberg, Germany (2009)
- Anderka, M., Lipka, N., Stein, B.: Evaluating Cross-Language Explicit Semantic Analysis and Cross Querying at TEL@CLEF 2009. In this volume.
- Zhou, D., Wade, V: Language Modeling and Document Re-Ranking: Trinity Ex- periments at TEL@CLEF-2009. In this volume.
- Larson, R.R.: Multilingual Query Expansion for CLEF Adhoc-TEL. In this vol- ume.
- McNamee, P.: JHU Experiments in Monolingual Farsi Document Retrieval at CLEF 2009. In this volume.
- Kuersten, J.: Chemnitz at CLEF 2009 Ad-Hoc TEL Task: Combining Different Retrieval Models and Addressing the Multilinguality. In this volume.
- Sorg, P., Braun, M., Nicolay, D., Cimiano, P.: Cross-lingual Information Retrieval based on Multiple Indexes. In this volume.
- Katsiouli, P., Kalamboukis, T.: An Evaluation of Greek-English Cross Language Retrieval within the CLEF Ad-Hoc Bilingual Task. In this volume.
- Jadidinejad, A.H., Mahmoudi, F.: Query Wikification: Mining Structured Queries From Unstructured Information Needs using Wikipedia-based Semantic Analysis. In this volume.
- Bosca, A., Dini, L.: CACAO Project at the TEL@CLEF 2009 Task. In this volume.
- Leveling, J., Zhou, D., Jones, G.F., Wade, V.: TCD-DCU at TEL@CLEF 2009: Document Expansion, Query Translation and Language Modeling. In this volume.
- Dolamic, L., Fautsch, C., Savoy, J.: UniNE at CLEF 2009: Persian Ad Hoc Re- trieval and IP. In this volume.