Academia.eduAcademia.edu

Outline

Title
Abstract
INTRODUCTION
Background
Research Analysis and Discussion
References
All Topics
Computer Science
Natural Language Processing

Similarity Evaluation Based on Contextual Modelling

Profile image of Mohamed HaggagMohamed Haggag

2019, Future Computing and Informatics Journal

https://doi.org/10.54623/FUE.FCIJ.4.1.5
visibility

…

description

6 pages

link

1 file

Abstract

Measuring Text similarity problem still one of opened fields for research area in natural language processing and text related research such as text mining, Web page retrieval, information retrieval and textual entailment. Several measures have been developed for measuring similarity between two texts: such as Wu and Palmer, Leacock and Chodorow measure and others . But these measures do not take into consideration the contextual information of the text .This paper introduces new model for measuring semantic similarity between two text segments. This model is based on building new contextual structure for extracting semantic similarity. This approach can contribute in solving many NLP problems such as te xt entailment and information retrieval fields.

Related papers

A Survey of Text Similarity Approaches
Wael Gomaa

International Journal of Computer Applications, 2013

Measuring the similarity between words, sentences, paragraphs and documents is an important component in various tasks such as information retrieval, document clustering, word-sense disambiguation, automatic essay scoring, short answer grading, machine translation and text summarization. This survey discusses the existing works on text similarity through partitioning them into three approaches; String-based, Corpus-based and Knowledgebased similarities. Furthermore, samples of combination between these similarities are presented.

View PDFchevron_right
Semantic Textual Similarity Methods, Tools, and Applications: A Survey
GOUTAM MAJUMDER

Computación y Sistemas

Measuring Semantic Textual Similarity (STS), between words/ terms, sentences, paragraph and document plays an important role in computer science and computational linguistic. It also has many applications over several fields such as Biomedical Informatics and Geoinformation. In this paper, we present a survey on different methods of textual similarity and we also reported about the availability of different software and tools those are useful for STS. In natural language processing (NLP), STS is a important component for many tasks such as document summarization, word sense disambiguation, short answer grading, information retrieval and extraction. We split out the measures for semantic similarity into three broad categories such as (i) Topological/Knowledge-based (ii) Statistical/ Corpus Based (iii) String based. More emphasis is given to the methods related to the WordNet taxonomy. Because topological methods, plays an important role to understand intended meaning of an ambiguous word, which is very difficult to process computationally. We also propose a new method for measuring semantic similarity between sentences. This proposed method, uses the advantages of taxonomy methods and merge these information to a language model. It considers the WordNet synsets for lexical relationships between nodes/words and a uni-gram language model is implemented over a large corpus to assign the information content value between the two nodes of different classes.

View PDFchevron_right
mented with Semantic Similarity for Text Mining Similarity for Text Mining Similarity for Text Mining Similarity for Text Mining
Dr. T Nalini

2013

Semantic similarity is a way of analyzing the perfect synonym t hat exists between wordpairs. This measure is necessary to detect the degree of relationship that persists within wordpairs. To compute the semantic similarity that lies between a wordpair, clustering and classification augmented with semantic similarity (CCASS) was developed. CCASS is a novel method that uses page counts and text snippets returned by search engine. Several similarity measures are defined using the page counts of word� pairs. Lexical pattern clustering is applied on text snippets, obtained from search engine. These are fed to the support vector machine (SVM) which computes the semantic similarity that exists between wordpairs. Based on this value obtained from the support vector machine, Simple KMeans clustering algorithm is used to form clusters. Upcoming wordpairs can be classified, after computation of its semantic similarity measure. If it does match with the existing clusters, a new cluster may be ...

View PDFchevron_right
A Comprehensive Comparative Study of Word and Sentence Similarity Measures
Issa Atoum

International Journal of Computer Applications, 2016

Sentence similarity is considered the basis of many natural language tasks such as information retrieval, question answering and text summarization. The semantic meaning between compared text fragments is based on the words' semantic features and their relationships. This article reviews a set of word and sentence similarity measures and compares them on benchmark datasets. On the studied datasets, results showed that hybrid semantic measures perform better than both knowledge and corpus based measures.

View PDFchevron_right

References (21)

  1. E. W. Frank, and M. a. Hall. "Data Mining: Practical Machine Learning Tools and Techniques", 3 rd Edition Textbook, 54(2), 2011.
  2. V. Ilamathi, "Preprocessing Techniques for Text Mining -an Overview.", International Journal on Computer Science and Communication Networks, 5(1):7-16, 2015.
  3. G. Sahaj. "Stock Market Prediction Using Data Mining", in 2017 International Journal on Intelligent Sustainable Systems 2(2):2780-2784, 2017.
  4. M. F. Patrick Uhr, and J. Zenkert. " Sentiment analysis in Financial Markets", IEEE International Conference on System Management, 912-917, 2014.
  5. A. Søgaard, "Sentiment analysis and opinion mining", Synthesis Lectures on Human Language Technologies , 5(1):1- 167, 2012.
  6. K. S. Loke. "Impact of Financial Ratios and Technical analysis on Stock Price Prediction Using Random Forests", 2017 IEEE International Conference on Computer and Drone Applications , 8-42, 2017.
  7. L. I. Bing, C.Chan and C. Ou. "Public Sentiment analysis in Twitter Data for Prediction of A Company`s Stock Price Movements", IEEE 11th International Conference on E- business, Engineering, 232-239, 2014.
  8. A. Assaf, and E. Alnagi" Predicting Stock Prices Using Data Mining Techniques.", International Arab Conference for. Information Technology, 1-8, 2013.
  9. S. Kannan, P. S. Sekar, "Financial Stock Market Forecast using Data Mining Techniques", International Multi Conference Engineering. Computer Science, 4-8, 2010.
  10. M. K. =Alkhatib, H. Najadat, and I. Hmeidi,"Stock Price Prediction Using K -Nearest Neighbor ( k NN ) Algorithm", International Journal of Business And Humanities Technology., 3(3):32-44, 2013.
  11. S. M. Price, J. Shriwas, and S. Farzana. "Using Text Mining and Rule Based Technique for Prediction of Stock Market Price", International Journal Emerging. Technology and Advanced Engineering, 4(1):246-250, 2014,
  12. V. S. Pagolu, K. N. R. Challa, G. Panda, and B. Majhi., "Sentiment analysis of Twitter Data for Predicting Stock Market Movements", International conference on Signal Processing, Communication, Power and Embedded System, 1345-1350, 2016
  13. N. Sharma and A. Juneja. "Combining of random forest estimates using LSboost for Stock Market Index Prediction" , 2017 2 nd International Confernece on Convergence Technology, 1199-1202, 2017
  14. M. N. Elagamy, C. Stanier, and B. Sharp, "Stock Market Random Forest-Text Mining System Mining Critical Indicators of Stock Market Movements", International. Conference Natural Language and Speech Processing , 1-8, 2018.
  15. A. E. Khedr, S. E. Salama, and N. Yaseen, " Predicting Stock Market Behavior using Data Mining Technique and News Sentiment analysis", International Journal of Intelligent Systems and Applications, 9(7):22-30, 2017.
  16. M. Granik and V. Mesyura, "Fake News Detection Using Naive Bayes Classifier", First International Conference on Electrical and Computer Engineering , Ukrain , 900-903, 2017.
  17. S. Kogan, T. J. Moskowitz, and M. Niessner., "Fake News in Financial Markets", 2017.
  18. R. Desai. "Stock Market Prediction Using Data Mining", 2017 International Conference on Intelligent Sustainable Systems 2780-2784, 2017.
  19. D. Lyon and B. Cedex., "N-grams based feature selection and Text Representation for Chinese Text Classification.", International Journal on Computer Intelligent Systems, 2(4):365-374, 2009.
  20. Y. Shynkevichl, T. M. Mcginnityl, S. Colemanl, and A. Belatrechel., "Stock Price Prediction based on Stock-Specific and Sub-Industry-Specific News Articles", 2015 International Joint Conference on Neural networks, 1-8, 2015.
  21. B. D. Trisedya, and Y. E. Cakra. "Stock Price Prediction using Linear Regression based on Sentiment analysis", International Conference on Advancement of Computer Science and Information Systems, 147-154, 2015

Related papers

Identification of Text Similarity Based On Context
shreya verma

2021

1Student, Dept. of IT Engineering, Pillai College of Engineering, New Panvel, Maharashtra, India 2Student, Dept. of IT Engineering, Pillai College of Engineering, New Panvel, Maharashtra, India 3Student, Dept. of IT Engineering, Pillai College of Engineering, New Panvel, Maharashtra, India ---------------------------------------------------------------------------***---------------------------------------------------------------------------AbstractText similarity computing plays an important role in natural language processing. The similarity calculation of short text is influenced by the small feature of text words and the accuracy is low. so it is a common improvement method to calculate the similarity of short texts with word semantic similarity. The word similarity calculation method combines two word semantic similarity by some strategies. Instead of doing a word for word comparison, we also need to pay attention to context in order to capture more of the semantics. Calculating...

View PDFchevron_right
IRJET- Identification of Text Similarity Based On Context
IRJET Journal

IRJET, 2021

Text similarity computing plays an important role in natural language processing. The similarity calculation of short text is influenced by the small feature of text words and the accuracy is low. so it is a common improvement method to calculate the similarity of short texts with word semantic similarity. The word similarity calculation method combines two word semantic similarity by some strategies. Instead of doing a word for word comparison, we also need to pay attention to context in order to capture more of the semantics. Calculating similarities between texts that have been written in English language is still one of the most important challenges facing natural language processing. The proposed system will find the similarity between two English texts by using similarity measures techniques: Semantic similarity measure, Cosine similarity measure and N-gram. In our proposed system we will design English Semantic Net that stores the keywords for a specific field, by this network we can find semantic similarity between words according to specific equations.

View PDFchevron_right
Measures to Calculate Semantic Similarity: A Survey
Tanuja Lonhari

International Journal of Modern Trends in Engineering & Research, 2017

Semantic similarity is a metric used to measure extent of similarity of meaning between two concepts. The concepts can be two words, sentences, or paragraphs. It tries to find the distance between two concepts in the semantic space, lesser the distance greater the similarity. Semantic similarity techniques compute similarity between two concepts which are lexicographically different. The methods used to find semantic similarity between two words can be extended to find similarity between sentences, phrases, or paragraphs. Finding semantic similarity between two concepts has many practical applications. It plays increasingly important role in the fields of Natural Language Processing (NLP), Information Retrieval (IR), Text Mining, etc. Text similarity techniques can be effectively employed for tasks such as text summarization [14], text classification [15], redundancy removal, document retrieval [16], question generation, question answering [17], etc. Effectiveness of these tasks can be immensely improved if semantic similarity measures are used to determine text similarity.

View PDFchevron_right
Measuring Semantic Textual Similarity of Sentences Using Modified Information Content and Lexical Taxonomy
Goutam Majumder

2016

In this paper, we present a survey and comparative studies on semantic textual similarity methods, those are based on WordNet taxonomy. We also proposed a new method for measuring semantic similarity between sentences. This proposed method, uses the advantages of taxonomy methods and merge these information to a language model. It considers the WordNet synsets for lexical relationships between nodes/words and uni-gram language model is implemented over a large corpus to assign the information content value between the two nodes of different classes. Finally, a similarity score is generated by considering the maximum weight and shortest distance of the graph. To evaluate and compare the method, SemEval 2015 English STS task 2 training dataset is considered.

View PDFchevron_right
Semantic text similarity using corpus-based word similarity and string similarity
Aminul Islam

ACM Transactions on Knowledge Discovery From Data, 2008

We present a method for measuring the semantic similarity of texts using a corpus-based measure of semantic word similarity and a normalized and modified version of the Longest Common Subsequence (LCS) string matching algorithm. Existing methods for computing text similarity have focused mainly on either large documents or individual words. We focus on computing the similarity between two sentences or two short paragraphs. The proposed method can be exploited in a variety of applications involving textual knowledge representation and knowledge discovery. Evaluation results on two different data sets show that our method outperforms several competing methods.

View PDFchevron_right

Related topics

  • Computer Science
  • Information Retrieval
  • Artificial Intelligence
  • Computer Engineering
  • Natural Language Processing
  • Semantic similarity
  • Word Net
  • Text Similarity
  • Similarity Geometry
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved