Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Related Works
Conclusion and Future Work
References
All Topics
Computer Science
Artificial Intelligence

NGram Approach for Semantic Similarity on Arabic Short Text

Profile image of Ahmad ShariehAhmad Sharieh

2022, International Journal of Advanced Computer Science and Applications

https://doi.org/10.14569/IJACSA.2022.0131199
visibility

…

description

10 pages

link

1 file

Abstract

Measuring the semantic similarity between words requires a method that can simulate human thought. The use of computers to quantify and compare semantic similarities has become an important research area in various fields, including artificial intelligence, knowledge management, information retrieval, and natural language processing. Computational semantics require efficient measures for computing concept similarity, which still need to be developed. Several computational measures quantify semantic similarity based on knowledge resources such as the WordNet taxonomy. Several measures based on taxonomical parameters have been applied to optimize the expression for content semantics. This paper presents a new similarity measure for quantifying the semantic similarity between concepts, words, sentences, short text, and long text based on NGram features and Synonyms of NGram related to the same domain. The proposed algorithm was tested on 700 tweets, and the semantic similarity values were compared with cosine similarity on the same dataset. The results were analyzed manually by a domain expert who concluded that the values provided by the proposed algorithm were better than the cosine similarity values within the selected domain regarding the semantic similarity between the datasets' short texts.

Related papers

Corpus-based and knowledge-based measures of text semantic similarity
Rada Mihalcea

Proceedings of the National …, 2006

This paper presents a method for measuring the semantic similarity of texts, using corpus-based and knowledge-based measures of similarity. Previous work on this problem has focused mainly on either large documents (e.g. text classification, information retrieval) or individual words (e.g. synonymy tests). Given that a large fraction of the information available today, on the Web and elsewhere, consists of short text snippets (e.g. abstracts of scientific documents, imagine captions, product descriptions), in this paper we focus on measuring the semantic similarity of short texts. Through experiments performed on a paraphrase data set, we show that the semantic similarity method outperforms methods based on simple lexical matching, resulting in up to 13% error rate reduction with respect to the traditional vector-based similarity metric.

View PDFchevron_right
A Survey on Semantic Similarity Measures
IJIRST - International Journal for Innovative Research in Science and Technology

Measuring the semantic similarity between words, sentences and concepts is an important task in information retrieval, document clustering, web mining and word sense disambiguation. Semantic similarity is basically a measure used to compute the extent of similarity between two concepts based on the likeliness of their meaning. This survey discusses the existing similarity measures by partitioning them into two approaches: Corpus-based and Knowledge-based. The features, performance, advantages and disadvantages of various semantic similarity measures are discussed. The aim of this paper is to provide an efficient evaluation of all these measures and help the researchers to select the best measure according to their requirement.

View PDFchevron_right
Using Standardized Lexical Semantic Knowledge to Measure Similarity
Abdelmajid Hamadou

Lecture Notes in Computer Science, 2014

The issue of sentence semantic similarity is important and essential to many applications of Natural Language Processing. This issue was treated in some frameworks dealing with the similarity between short texts especially with the similarity between sentence pairs. However, the semantic component was paradoxically weak in the proposed methods. In order to address this weakness, we propose in this paper a new method to estimate the semantic sentence similarity based on the LMF ISO-24613 standard. Indeed, LMF provides a fine structure and incorporates an abundance of lexical knowledge which is interconnected together, notably sense knowledge such as semantic predicates, semantic classes, thematic roles and various sense relations. Our method proved to be effective through the applications carried out on the Arabic language. The main reason behind this choice is that an Arabic dictionary which conforms to the LMF standard is at hand within our research team. Experiments on a set of selected sentence pairs demonstrate that the proposed method provides a similarity measure that coincides with human intuition.

View PDFchevron_right
A Survey and Comparison of WordNet Based Semantic Similarity Measures
Dr Ayesha Banu

2013

Semantic Similarity relates to computing the similarity between concepts within ontology. We explore the different categories of approaches to compute semantic similarity and the most popular measures are evaluated using WordNet as the source ontology. We compare the measures using the benchmark dataset of Miller & Charles with WordNet to rank the measures category wise and overall.

View PDFchevron_right
Exploring Strategies for Measuring Semantic Similarity in Short Arabic Texts
Hani Mahdi

Indian journal of computer science and engineering, 2023

Measuring the semantic similarity of short Arabic texts is a challenging task due to the distinct linguistic characteristics of Arabic and the scarcity of resources for natural Arabic language processing. In this study, we investigate different strategies to accurately assess the semantic similarity between brief Arabic texts found in public domains and question-answering systems. We explore recent embedding techniques in NLP and propose deep learning approaches to understand the text's semantic meaning. However, analyzing short texts can be difficult because they typically contain terse sentences. Despite these challenges, measuring semantic similarity is crucial for various applications such as information retrieval, plagiarism detection, information extraction, and machine translation. Our study sheds light on the challenges and potential solutions for measuring semantic similarity in short Arabic texts.

View PDFchevron_right
Semantic Textual Similarity Methods, Tools, and Applications: A Survey
GOUTAM MAJUMDER

Computación y Sistemas

Measuring Semantic Textual Similarity (STS), between words/ terms, sentences, paragraph and document plays an important role in computer science and computational linguistic. It also has many applications over several fields such as Biomedical Informatics and Geoinformation. In this paper, we present a survey on different methods of textual similarity and we also reported about the availability of different software and tools those are useful for STS. In natural language processing (NLP), STS is a important component for many tasks such as document summarization, word sense disambiguation, short answer grading, information retrieval and extraction. We split out the measures for semantic similarity into three broad categories such as (i) Topological/Knowledge-based (ii) Statistical/ Corpus Based (iii) String based. More emphasis is given to the methods related to the WordNet taxonomy. Because topological methods, plays an important role to understand intended meaning of an ambiguous word, which is very difficult to process computationally. We also propose a new method for measuring semantic similarity between sentences. This proposed method, uses the advantages of taxonomy methods and merge these information to a language model. It considers the WordNet synsets for lexical relationships between nodes/words and a uni-gram language model is implemented over a large corpus to assign the information content value between the two nodes of different classes.

View PDFchevron_right
Measuring Semantic Similarity for Bengali Tweets Using WordNet
baby bhattacharya

2015

Similarity between natural language texts, sentences in terms of meaning, known as textual entailment, is a generic problem in the area of computational linguistics. In the last few years researchers worked on various aspects of textual entailment problem, but mostly restricted to English language. Here in this paper we present a method for measuring the semantic similarity of Bengali tweets using WordNet. Moreover we defined partial textual entailment (PTE) as in real data partial entailment cases are equally prevalent with the complete/direct entailment. Although by definition entailment is a directional relationship, but here we consider entailment more as semantic similarity.

View PDFchevron_right
A new semantic similarity approach for improving the results of an Arabic search engine
youness madani

Procedia Computer Science, 2019

Determining semantic similarity between documents is crucial to many tasks such as plagiarism detection, automatic technical survey and semantic search. In this paper, we have mainly focused on detecting the semantic similarity between documents in large documents collection and queries based on an Arabic search engine, we investigated MapReduce as a specific framework for managing distributed processing in dataset pattern and semantic similarity measures of documents. Then we study the state of the art of different approaches for computing the similarity of documents. We propose an approach based on parallel algorithm of semantic similarity measures using MapReduce and WordNet after translation phase to detect the relevant documents in the face of the Arabic query. The numerical results obtained and presented showed the efficiency and the performance of the technique adopted.

View PDFchevron_right
Semantic similarity based on corpus statistics and lexical taxonomy
David Conrath

Arxiv preprint cmp-lg/9709008, 1997

View PDFchevron_right
Description and Evaluation of Semantic Similarity Measures Approaches
Thabet Slimani

International Journal of Computer Applications, 2013

In recent years, semantic similarity measure has a great interest in Semantic Web and Natural Language Processing (NLP). Several similarity measures have been developed, being given the existence of a structured knowledge representation offered by ontologies and corpus which enable semantic interpretation of terms. Semantic similarity measures compute the similarity between concepts/terms included in knowledge sources in order to perform estimations. This paper discusses the existing semantic similarity methods based on structure, information content and feature approaches. Additionally, we present a critical evaluation of several categories of semantic similarity approaches based on two standard benchmarks. The aim of this paper is to give an efficient evaluation of all these measures which help researcher and practitioners to select the measure that best fit for their requirements.

View PDFchevron_right

References (27)

  1. A.-S. Mohammad, Z. Jaradat, A.-A. Mahmoud, and Y. Jararweh, "Paraphrase identification and semantic text similarity analysis in arabic news tweets using lexical, syntactic, and semantic features," Information Processing & Management, vol. 53, no. 3, pp. 640-652, 2017.
  2. A. Faaza, D. James, A. Zuhair, A. Keeley et al., "Arabic word semantic similarity," International Journal of Cognitive and Language Sciences, vol. 6, no. 10, pp. 2497-2505, 2012.
  3. F. A. Almarsoomi, J. D. OShea, Z. Bandar, and K. Crockett, "Awss: An algorithm for measuring arabic word semantic similarity," in 2013 IEEE international conference on systems, man, and cybernetics. IEEE, 2013, pp. 504-509.
  4. R. Mihalcea, C. Corley, C. Strapparava et al., "Corpus-based and knowledge-based measures of text semantic similarity," in Aaai, vol. 6, no. 2006, 2006, pp. 775-780.
  5. T. Slimani, "Description and evaluation of semantic similarity measures approaches," arXiv preprint arXiv:1310.8059, 2013.
  6. G. A. Miller, "Wordnet: a lexical database for english," Communications of the ACM, vol. 38, no. 11, pp. 39-41, 1995.
  7. Y. Li, D. McLean, Z. A. Bandar, J. D. O'shea, and K. Crockett, "Sentence similarity based on semantic nets and corpus statistics," IEEE transactions on knowledge and data engineering, vol. 18, no. 8, pp. 1138-1150, 2006.
  8. almaany, "Translation and meaning in almaany," https://www.almaany.com/en/dict/ar-en/, July 2022.
  9. A. Rozeva and S. Zerkova, "Assessing semantic similarity of texts- methods and algorithms," in AIP Conference Proceedings, vol. 1910, no. 1. AIP Publishing LLC, 2017, p. 060012.
  10. D. Chandrasekaran and V. Mago, "Evolution of semantic similarity-a survey," ACM Computing Surveys (CSUR), vol. 54, no. 2, pp. 1-37, 2021.
  11. M. Alian and A. Awajan, "Arabic semantic similarity approaches- review," in 2018 International Arab Conference on Information Tech- nology (ACIT). IEEE, 2018, pp. 1-6.
  12. J. Yang, Y. Li, C. Gao, and Y. Zhang, "Measuring the short text simi- larity based on semantic and syntactic information," Future Generation Computer Systems, vol. 114, pp. 169-180, 2021.
  13. S. Zad, M. Heidari, P. Hajibabaee, and M. Malekzadeh, "A survey of deep learning methods on semantic similarity and sentence modeling," in 2021 IEEE 12th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). IEEE, 2021, pp. 0466- 0472.
  14. A. Zouaghi, M. Zrigui, G. Antoniadis, and L. Merhbene, "Contribu- tion to semantic analysis of arabic language," Advances in Artificial Intelligence, vol. 2012, 2012.
  15. W. Wali, B. Gargouri et al., "Supervised learning to measure the seman- tic similarity between arabic sentences," in Computational collective intelligence. Springer, 2015, pp. 158-167.
  16. S. S. Aljameel, J. D. O'Shea, K. A. Crockett, and A. Latham, "Sur- vey of string similarity approaches and the challenging faced by the arabic language," in 2016 11th International Conference on Computer Engineering & Systems (ICCES). IEEE, 2016, pp. 241-247.
  17. H. M. Alghamdi, A. Selamat, and N. S. A. Karim, "Arabic web pages clustering and annotation using semantic class features," Journal of King Saud University-Computer and Information Sciences, vol. 26, no. 4, pp. 388-397, 2014.
  18. B. J. Jansen, M. Zhang, K. Sobel, and A. Chowdury, "Twitter power: Tweets as electronic word of mouth," Journal of the American society for information science and technology, vol. 60, no. 11, pp. 2169-2188, 2009.
  19. D. Jatnika, M. A. Bijaksana, and A. A. Suryani, "Word2vec model analysis for semantic similarities in english words," Procedia Computer Science, vol. 157, pp. 160-167, 2019.
  20. N. Peinelt, D. Nguyen, and M. Liakata, "tbert: Topic models and bert joining forces for semantic similarity detection," in Proceedings of the 58th annual meeting of the association for computational linguistics, 2020, pp. 7047-7055.
  21. Y. Cai, Q. Zhang, W. Lu, and X. Che, "A hybrid approach for measuring semantic similarity based on ic-weighted path distance in wordnet," Journal of intelligent information systems, vol. 51, no. 1, pp. 23-47, 2018.
  22. L. Gutiérrez and B. Keith, "A systematic literature review on word embeddings," in International Conference on Software Process Improve- ment. Springer, 2018, pp. 132-141.
  23. A. Saif, N. Omar, U. Z. Zainodin, and M. J. Ab Aziz, "Building sense tagged corpus using wikipedia for supervised word sense disambigua- tion," Procedia Computer Science, vol. 123, pp. 403-412, 2018.
  24. H. A. Abdeljaber, "Automatic arabic short answers scoring using longest common subsequence and arabic wordnet," IEEE Access, vol. 9, pp. 76 433-76 445, 2021.
  25. N. Altuwairesh, "Successful translation students' use of dictionaries," International Journal of English Linguistics, vol. 12, no. 2, 2022.
  26. N. Sabbah and R. Alsalem, "Female translation students' knowledge and use of online dictionaries and terminology data banks: A case study," AWEJ for Translation & Literary Studies, vol. 2, no. 2, 2018.
  27. Google, "Google," https://developers.google.com/custom-search/, July 2022.

Related papers

Automatic Measurement of Semantic Similarity among Arabic Short Texts
Fatma Elghannam

Communications on Applied Electronics, 2016

Documents that are dealing with the same topic include normally many identical words. Accordingly, surface words co-occurrence similarity measures has been applied successfully to measure the similarity between these documents. However, the problem is not a trivial task when dealing with short texts that carry the same or close meaning but with different vocabularies. Toward solving this problem, researchers have been investigating methods for word analysis at the semantic level. We introduce a new method to measure the semantic similarity between short texts. In the proposed method, semantic distribution and lexical similarity measures are combined to determine the degree of similarity between two words. The similarity between two words is measured as the lexical similarity between the vectors of similar words extracted from corpus as a second order word vector. The proposed method was applied to measure the semantic similarity between Arabic short texts. The experiments performed showed that the best accuracy achieved by the proposed method was 97% compared to 93% recorded for the second order distribution similarity.

View PDFchevron_right
SEMANTIC SIMILARITY MEASURES BETWEEN WORDS: A BRIEF SURVEY
Ashraf Ali

Science International, 2018

The semantic similarity measure is the ability to determine the similarity between various terms such as words, sentences, documents, concepts or instances. The aim of determining the semantic similarity measures between two sets of words is to find the degree of relevance by matching the words, which are conceptually similar but not necessarily lexicographically similar. Semantic similarity measure has great importance in many computer applications related field such as information retrieval, educational system, text summarization and natural language processing (NLP). There are several challenges to compute the semantic similarity between the words such as complexity of natural languages, the ambiguity of words and so on. One of the major challenges is the words are similar in meaning but they are not lexicographically similar. Traditional approaches for computing the semantic similarity is the major obstacle as they are not appropriate for many circumstances, many of the existing traditional approaches fail to deal with the term, which is not covered by synonyms and not able to handle with abbreviations, acronyms, brand names and so on. To overcome these problems, we present and evaluate the various promising methodologies that utilize several kinds of search engine based intelligence to determine the degree of similarity between the words. The objective of these types of methodologies is to utilize an assortment of paradigm including the study of text snippet comparison, frequent pattern finding, co-occurrence measures, trend analysis, and so on. The key objective is to replace the traditional methodologies where necessary.

View PDFchevron_right
Measures to Calculate Semantic Similarity: A Survey
Tanuja Lonhari

International Journal of Modern Trends in Engineering & Research, 2017

Semantic similarity is a metric used to measure extent of similarity of meaning between two concepts. The concepts can be two words, sentences, or paragraphs. It tries to find the distance between two concepts in the semantic space, lesser the distance greater the similarity. Semantic similarity techniques compute similarity between two concepts which are lexicographically different. The methods used to find semantic similarity between two words can be extended to find similarity between sentences, phrases, or paragraphs. Finding semantic similarity between two concepts has many practical applications. It plays increasingly important role in the fields of Natural Language Processing (NLP), Information Retrieval (IR), Text Mining, etc. Text similarity techniques can be effectively employed for tasks such as text summarization [14], text classification [15], redundancy removal, document retrieval [16], question generation, question answering [17], etc. Effectiveness of these tasks can be immensely improved if semantic similarity measures are used to determine text similarity.

View PDFchevron_right
A Review on WordNet and Vector Space Analysis for Short-text Semantic Similarity
khushi C

International Journal of Innovations in Engineering and Technology, 2017

Meaningful sentences are the combination of meaning words, if a system wants to process natural language it should have essential knowledge regarding words and their meanings. The assessment of semantic similarity between the words of a short text is one of the challenging task knowledge based tasks and the tasks in NLP like text summarization, information retrieval, search, categorization of text and machine learning etc. which uses the sentence similarity measures for assessing the similarity between the short-text or sentences. In this paper the survey of two techniques is done which are helpful in generating the extractive text summaries WordNet and Vector space analysis. In vector space model words can be represented as numeric vectors based on different semantic similarity measures, the similarity between the word numeric vectors can be calculated with the semantic measures called WordNet. The information regardin the word and teir meaning in earlier days was provided with the help of traditional dictionaries, but these dictionaries were only helpful for human readers not for machine, WordNet provide combination of traditional lexicographic information and modern information. It is a online lexical database designed for use under the program control, it uses the measure like for calculating the semantic similarity between the concepts. Nouns, verbs, adjectives, adverbs are organized into set of synonyms and semantic relationship between the synonym sets called as Synset.

View PDFchevron_right
Arabic Semantic-Based Textual Similarity
Shimaa Ismail

Benha Journal of Applied Sciences

Textual similarity is one of the most important aspects of information retrieval. This paper proposes several techniques of semantic textual similarity as well as the factors that influence them. Two-hybrid approaches for measuring the degree of similarity between two Arabic snipped texts are presented. The first proposed approach combined the word-based and vectorbased similarity methods to construct semantic word spaces for each word of the input text. These words are represented in their lemma forms to capture all semantically related words. In this approach, the semantic word spaces are used to find the best matching between the input text words, and hence, the degree of similarity between the two snipped texts is computed. The second proposed approach combined semantic and syntactic based approaches. The basic Levenshtein concept represents the main structure for this approach. It has been modified to measure the edit cost at the token level not at the character level. In addition, the semantic word spaces are added to this approach to include the semantic features to the syntactic features. Some techniques are embedded to overcome the syntactic approach problems such as the word sequence. Pearson correlation coefficient is used to measure the degree of correctness of the two proposed approaches as compared to two benchmark datasets. The experiments achieved 0.7212 and 0.7589 for the two proposed approaches on two different datasets.

View PDFchevron_right

Related topics

  • Computer Science
  • Artificial Intelligence
  • Natural Language Processing
  • Semantic similarity
  • Semantics (Computer Science)
  • Semantic Computing
  • Distributional Semantics
  • Cosine Similarity
  • Similarity Geometry
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved