Academia.eduAcademia.edu

Outline

Title
Abstract
References
All Topics
Computer Science
Data Science

Cross-language Information Retrieval

Profile image of Petra GaluščákováPetra Galuščáková

2021, Cornell University - arXiv

https://doi.org/10.48550/ARXIV.2111.05988
visibility

…

description

12 pages

link

1 file

Abstract

Lectures on Human Language Technologies publishes monographs on topics relating to natural language processing, computational linguistics, information retrieval, and spoken language understanding. Emphasis is placed on important new techniques, on new applications, and on topics that combine two or more HLT subfields.

Related papers

Literature review of cross-language information retrieval
Mustafa Abusalah

Transactions on Engineering, Computing …, 2005

Abstract-Classical Information Retrieval (IR) is the sifting out of the documents most relevant to a user's information requirement (expressed as a “query”), from a large electronic store of documents. A search engine performs IR by retrieving relevant web pages from the ...

View PDFchevron_right
Literature Review of Interactive Cross Language Information Retrieval Tools IAJIT First Online Publication
Andreas Nürnberger

2010

Abstract: The unprecedented rise of multilingual resources afforded by the exponential web growth demands the development of communication technologies in order to eliminate the barriers between languages. More comprehensive tools to overcome such barriers, such as machine translation and cross-lingual information retrieval applications, are nowadays in strong demands. In this paper, we present an overview of the literature of interactive Cross Language Information Retrieval (CLIR) tools and discuss their limitations. In addition, possible future research directions of interactive CLIR tools are discussed.

View PDFchevron_right
Using Linguistic Knowledge in Information Retrieval Technical Report
Wessel Kraaij

1996

Abstract The current practice in Information Retrieval is largely based on statistical techniques. These techniques are reasonably successful but many researchers believe that statistical techniques have reached their upper bound. Some recent research in IR is aimed at investigating whether Natural Language Processing techniques can be used to improve the performance of existing retrieval strategies.

View PDFchevron_right
Cross Language Information Retrieval System
Zahid Hussain

The number of web users accessing information’s over the net is growing hastily with each passing day. A massive quantity of information in extraordinary language is to be had on internet which can be accessed by way of all and sundry. Information retrieval(IR) is the technology which offers with locating beneficial statistics from a large series data, specifically unstructured, based and semi-based information. Records retrieval can be labeled into exclusive lessons which include monolingual information retrieval, move language information retrieval (CLIR) and multilingual information retrieval (MLIR). The sector has turn out to be global village naw and the range of data and language boundaries are the principal issues for verbal exchange and cultural trade internationally. To remedy such issues and to take away those barriers, move language information retrieval (CLIR) device is in strong demand now days. CLIR is the IR device in which the question or documents may seem in one-of-a-kind languages. on this paper we are able to offer an overview of the brand new application areas of CLIR. We are able to also overview the strategies which are used in the manner of CLIR research for question and record translation. Furthermore, we will additionally try and identify some of demanding situations and troubles in CLIR systems.

View PDFchevron_right
Natural Language Information Retrieval
Tomek Strzalkowski

Information Processing and Management, 1995

In this paper we describe an information retrieval system in which advanced natural language processing techniques are used to enhance the effectiveness of termbased document retrieval. The backbone of our system is a traditional statistical engine that builds inverted index files from pre-processed documents, and then searches and ranks the documents in response to user queries. Natural language processing is used to (a) preprocess the documents in order to extract content-carrying terms, (b) discover interterm dependencies and build a conceptual hierarchy specific to the database domain, and (c) process the user's natural language requests into effective search queries. During the course of the Text REtrieval Conferences, TREC-1 and TREC-2,* our system has evolved from a scaled-up prototype, originally tested on such collections as CACM-3204 and Cranfield, to its present form, which can be effectively used to process hundreds of millions of words of unrestricted text.

View PDFchevron_right
Survey on Cross-Lingual Information Retrieval
Eniafe Festus Ayetiran

— The rise in unmatched multilingual resources afforded by the exponential WWW growth demands the advancement of technologies to eradicate the communication barriers among languages. Relevant information in collections and the Web is not limited to the native language of the user, but today, the need to retrieve documents in other languages is growing so that the content, which can be translated, satisfies the information needs of the user. Information retrieval (IR) can be classified into different categories such as monolingual information retrieval, Cross lingual information retrieval (CLIR) and Multi lingual information retrieval (MLIR). In the present day scenario, the diversity of information and language barriers are the serious challenges for communication and cultural interchange across the globe. To solve such communication barriers, CLIR systems are today in strong demand. The goal of CLIR is to find relevant information written in a language different from other languages of the query. CLIR can be used to improve the capabilities of users to search and retrieve documents in many languages. Diverse translation techniques can be used to achieve CLIR. In this paper, we review the techniques and approaches of CLIR research for query and document translation and their role in current research directions, which include new models, and paradigm in the extensive area of IR. In addition, based on existing literature, a number of challenges and tools in CLIR has been identified and discussed. Finally, possible future research directions on semantic query-document translation for CLIR are discussed.

View PDFchevron_right
The successful application of natural language processing for information retrieval
Yenory Rojas

Journal of Computer Science and Technology, 2007

In this paper, a novel model for monolingual Information Retrieval in English and Spanish language is proposed. This model uses Natural Language Processing techniques (a POStagger, a Partial Parser, and an Anaphora Resolver) in order to improve the precision of traditional IR systems, by means of indexing the "entities" and the "relations" between these entities in the documents. This model is evaluated on both the Spanish and English CLEF corpora. For the English queries, there is a maximum increase of 35.11% in the average precision. For the Spanish queries, the maximum increase is 37.18%.

View PDFchevron_right
Cross-Lingual Information Retrieval Problems: Methods and findings for three language pairs
Turid Hedlund

2000

Abstract In this paper we will discuss dictionary-based cross-language information retrieval (CLIR) methods, and report recent findings and problems. We will consider three language pairs for CLIR: Finnish to English, English to Finnish, Swedish to English. We show that Finnish and Swedish have special features, eg, the frequency of homography and a high frequency of compound words that affect retrieval effectiveness. Especially correct word form normalization and compound splitting are essential.

View PDFchevron_right
Multilingual Cross Language Information Retrieval A new approach
Carolina Gallardo

2010

CLIR is the acronym of a great variety of techniques, systems and technologies that associate information retrieval (normally from texts) in a multilingual environments. Many of these systems are based on a double architecture composed by systems in charge of extracting information with a great dependency on the language together with classical machine translation systems. In the early 90's, machine translation systems fell from grace due to the failure of big machine translations projects in Europe, Japan and USA. Due to this reason some approaches, particularly those of linguistic knowledge representation were undeservedly forgotten, and above all the so called "interlinguas". Recently, the reemergence of these models under the generic name of "ontologies" are supporting most of knowledge representation initiatives, even in an language independent way However consistency problems are not well solved yet. UNL, initially conceived as a contents representation and multilingual generation system, can also be applied to the CLIR. This paper aims to discuss how the UNL could be considered as adequate for consistent knowledge representation in this type of systems.

View PDFchevron_right
Language-Dependent and Language-Independent Approaches to Cross-Lingual Text Retrieval
Christof Monz

Lecture Notes in Computer Science, 2004

We investigates the effectiveness of language-dependent approaches to document retrieval, such as stemming and decompounding, and constrast them with language-independent approaches, such as character n-gramming. In order to reap the benefits of more than one type of approach, we also consider the effectiveness of the combination of both types of approaches. We focus on document retrieval in nine European languages: Dutch, English, Finnish, French, German, Italian, Russian, Spanish, and Swedish. We look at four different cross-lingual information retrieval tasks: monolingual, bilingual, multilingual, and domain-specific retrieval. The experimental evidence is obtained using the 2003 test suite of the cross-language evaluation forum (CLEF).

View PDFchevron_right

References (17)

  1. Using Manually Constructed Translation Systems and Resources for CLIR ......... 29
  2. 1 Machine Translation .......................................................................................... 29 2.1.1 Rule-Based MT ..................................................................................... 30 2.1.2 Statistical MT ........................................................................................ 32
  3. 2 Basic utilization of MT in CLIR ....................................................................... 37 2.2.1 Rule-Based MT ..................................................................................... 39 2.2.2 Statistical MT ........................................................................................ 41 2.2.3 Unknown Word ..................................................................................... 41
  4. 3 Open the Box of MT ......................................................................................... 44
  5. 4 Dictionary-Based Translation for CLIR ............................................................ 45 2.4.1 Basic Approaches ................................................................................... 46 2.4.2 The Term Weighting Problem .............................................................. 47 2.4.3 Coverage of the Dictionary ................................................................... 49 2.4.4 Translation Ambiguity ........................................................................... 50 2.4.5 Selection of Translation Words ............................................................. 50 2.4.6 Other Related Approaches .................................................................... 53
  6. Translation Based on Parallel and Comparable Corpora ...................................... 57
  7. 1 Parallel Corpora ................................................................................................. 57
  8. 2 Paragraph/Sentence Alignment ......................................................................... 60 3.3 Utilization of Translation Models in CLIR ...................................................... 63 3.4 Embedding Translation Models into CLIR Models ......................................... 70
  9. 5 Alternative Approaches using Parallel Corpora ................................................. 75 3.5.1 Exploiting a Parallel Corpus by Pseudo-Relevance Feedback ............... 75
  10. 5.2 Using Latent Semantic Indexing (LSI) ................................................. 76
  11. 5.3 Using Comparable Corpora................................................................... 78
  12. 6 Discussions on CLIR Methods and Resources.................................................. 80
  13. 7 Mining for Translation Resources and Relations ............................................... 81 3.7.1 Mining for Parallel Texts ....................................................................... 81 3.7.2 Transliteration ....................................................................................... 85 3.7.3 Mining Translations using Hyperlinks .................................................. 88 3.7.4 Mining Translations from Monolingual Web Pages .............................. 90
  14. Other Methods to Improve CLIR ...................................................................... 95 4.1 Pre-and Post-Translation Expansion ................................................................ 95
  15. 2 Fuzzy Matching ................................................................................................. 96
  16. 3 Combining Translations .................................................................................... 97
  17. 4 Transitive Translation ........................................................................................ 98

Related papers

Twenty-one at TREC-8: using language technology for information retrieval
Wessel Kraaij

2000

Abstract This paper describes the official runs of the Twenty-One group for TREC-8. The Twenty-One group participated in the Ad-hoc, CLIR, Adaptive Filtering and SDR tracks. The main focus of our experiments is the development and evaluation of retrieval methods that are motivated by natural language processing techniques. The following new techniques are introduced in this paper. In the Ad-Hoc and CLIR tasks we experimented with automatic sense disambiguation followed by query expansion or translation.

View PDFchevron_right
Introduction to the issue: From Natural Language Processing to Information and Human Language Technology
Carlos Prolo

INTELIGENCIA ARTIFICIAL, 2007

View PDFchevron_right
A Cross-language information retrieval system based on linguistic and statistical approaches
Christian Fluhr

As the number of non-English documents that are available on the World Wide Web and in corporate repositories increases, the ability to quickly and effectively search and view documents across language boundaries will continue to grow in importance. Cross-language information retrieval techniques allow searchers access to a wider range of material without requiring specialized knowledge of the content or the languages in the database. We present in this paper a cross-language information retrieval system (Arabic-English-French) based on a deep linguistic analysis of documents and queries and a statistical model which assigns a weight to each word in the database according to discriminating power. A comparison tool is used to evaluate all possible intersections between queries and documents and order documents by their relevance.

View PDFchevron_right
Integrating different strategies for cross-language information retrieval in the MIETTA project
Feiyu Xu

Proceedings of TWLT14, …, 1998

TWLT is an acronym of Twente Workshop(s) on Language Technology. These workshops on natural language theory and technology are organised by the Parlevink Project, a language theory and technology project of the . For each workshop proceedings are published containing the papers that were presented. TWLT 14, has been organised together with the German Research Center for Artificial Intelligence, DFKI Saarbrücken, Germany. The idea for this workshop grew out of a longstanding cooperation between the University of Twente, TNO-TPD in Delft and DFKI. This co-operation manifested itself for the first time in the Twenty-One project, which inspired a whole series of other projects, such as Pop-Eye and Olive, but which also led to a close contact and exchange with independently established projects such as Mulinex and MIETTA for which DFKI was responsible. All of these projects had in common that they were funded by the Telematics Application Programme of the European Commission, all, except for Twenty-One, by the Language Engineering Sector.

View PDFchevron_right
Natural language processing for information retrieval: the time is ripe (again
Matthew Lease

2007

Paraphrasing van Rijsbergen [37], the time is ripe for another attempt at using natural language processing (NLP) for information retrieval (IR). This paper introduces my dissertation study, which will explore methods for integrating modern NLP with state-of-the-art IR techniques. In addition to text, I will also apply retrieval to conversational speech data, which poses a unique set of considerations in comparison to text. Greater use of NLP has potential to improve both text and speech retrieval.

View PDFchevron_right

Related topics

  • Computer Science
  • Information Retrieval
  • Cross Language Information Retri...
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved