Academia.eduAcademia.edu

Outline

Title
Abstract
Experimental Results
Experiments and Results
Related Work
Conclusion
References
All Topics
Computer Science

HyKSS: Hybrid keyword and semantic search

Profile image of Del ScottDel Scott

2011

Abstract

Keyword search suffers from a number of issues: ambiguity, synonymy, and an inability to handle semantic constraints. Semantic search helps resolve these issues but is limited by the quality of annotations which are likely to be incomplete or imprecise. Hybrid search, a search technique that combines the merits of both keyword and semantic search, appears to be a promising solution. In this paper we describe and evaluate HyKSS, a hybrid search system driven by extraction ontologies for both annotation creation and query interpretation. For displaying results, HyKSS uses a dynamic ranking algorithm. We show that over data sets of short topical documents, the HyKSS ranking algorithm outperforms both keyword and semantic search in isolation, as well as a number of other non-HyKSS hybrid approaches to ranking. 1 Introduction Keyword search for documents on the web works well-often surprisingly well. Can semantic search, added to keyword search, make the search for relevant documents even better? Clearly, the answer should be yes, and researchers are pursuing this initiative (e.g., [1]). The real question, however, is not whether adding semantic search might help, but rather how can we, in a cost-effective way, identify the semantics both in documents in the search space and in the free-form queries users wish to ask. Keyword search has a number of limitations: (1) Polysemy: Ambiguous keywords may result in the retrieval of irrelevant documents. (2) Synonymy: Document publishers may use words that are synonymous with, but not identical to, terms in user queries causing relevant documents to be missed. (3) Constraint satisfaction: Keyword search is incapable of recognizing semantic constraints. If a query specifies "Hondas for under 12 grand", a keyword search will treat each word as a keyword (or stopword) despite the fact that many, if not most, relevant documents likely do not contain any of these words-not even "Hondas" since the plural is relatively rare in relevant documents. Semantic search can resolve polysemy by placing words in context, synonymy by allowing for alternatives, and constraint satisfaction by recognizing specified conditions. Thus, for example, semantic search can interpret the query "Hondas

Related papers

Using SKOS vocabularies for improving web search
Flávio Martins

Knowledge organization systems such as thesauri or taxonomies are increasingly being expressed using the Simple Knowledge Organization System (SKOS) and published as structured data on the Web. Search engines can exploit these vocabularies and improve search by expanding terms at query or document indexing time. We propose a SKOS-based term expansion and scoring technique that leverages labels and semantic relationships of SKOS concept definitions. We also implemented this technique for Apache Lucene and Solr. Experiments with the Medical Subject Headings vocabulary and an early evaluation with Library of Congress Subject Headings indicated gains in precision when using SKOS-based expansion compared to pseudo relevance feedback and no expansion. Our findings are important for publishers and consumer of Web vocabularies who want to use them for improving search over Web documents.

View PDFchevron_right
ЛОГИКО-СЕМАНТИЧЕСКОЕ МОДЕЛИРОВАНИЕ ЛЕКСИКИ ЗАПРОСОВ В ДОКУМЕНТАЛЬНЫХ ИПС ● LOGICAL AND SEMANTIC MODELLING OF VOCABULARY QUERIES IN DOCUMENTAL SEARCH ENGINES (INFORMATION RETRIEVAL SYSTEMS)
STRUCTURAL AND APPLIED LINGUISTICS (SPBU) ● СТРУКТУРНАЯ И ПРИКЛАДНАЯ ЛИНГВИСТИКА (СПбГУ), Victor Zakharov, АЛЕКСАНДР СЕРГЕЕВИЧ ГЕРД ● ALEXANDER SERGEEVICH HEARD

СТРУКТУРНАЯ И ПРИКЛАДНАЯ ЛИНГВИСТИКА (СПбГУ), 2010

JIOrHKO-CEMAHTH'tJECKOE MO~JIHPOBAHHE JIEKCHKH 3AilPOCOB B ~OKYMEHTAJibHhIX HilC K.nroqeehle c.noea. 3anpoc, noucxosoe npe~uC8.lille, JlOI'HKO-ceMaHTH'lecK.&H MQ,D;eJib, ~CTpH6YTHBHO-CT8THCTH'lecKHA MeTO,ll, OHTOJlOI'HH. ABBOT~. B HHcPoPMaD;HOHHo-noucKOBblX cucreMax 38.lIJ>OC Bblcrynaer KaK J10mKO-JleKCHKO-ceM8HTH'lecK8Jl MO,lleJib HHci>opM~OHHOA nOTpe6HOCTH. Ilpe.ll.IJ&-raK>TCH KpHTepHH H a.nropHTM 001.e,quRemra TepMHHOB B KJ18CCbI ycJIOBHOA 3KBH-BaJieHTHOCTH Ra OCHOBe ,li;HCTJ>H6yrHBHO-Cl'a.THCI'H'lecKOI'O MeTO,lla c yqeTOM JlOrH-"lecKHX <t>oPMYJl 3allpOCOB H3 apXHBa 3&1lpOCOB. Cnosapu ycJIOBHoA, noHCKosoA 3K-BHB8JieHTHOCTH MO)f(HO npHMefUITb K8.K HHCTpyMeHT COCT&BHTeJl.ll llOHCKOBhIX npe,llrmcamdl:. KpoMe roro, OHH MOcyT 6b1Tb HCllOJlb30B8.Hbl H ,LVlH C03,llaHWI JlHHrBHCTH-"lecKHX CJIOBapeA H KOMllblOTepHbIX OHTOJIOndt.

View PDFchevron_right
Using semantic components to search for domain-specific documents: An evaluation from the system perspective and the user perspective
Peter Vedsted

Information Systems, 2009

We seek to leverage an expert user's knowledge about how information is organized in a domain and how information is presented in typical documents within a particular domain-specific collection, to effectively and efficiently meet the expert's targeted information needs. We have developed the semantic components model to describe important semantic content within documents. The semantic components model for a given collection (based on a general understanding of the type of information needs expected) consists of a set of document classes, where each class has an associated set of semantic components. Each semantic component instance consists of segments of text about a particular aspect of the main topic of the document and may not correspond to structural elements in the document. The semantic components model represents document content in a manner that is complementary to full text and keyword indexing. This paper describes how the semantic components model can be used to improve an information retrieval system. We present experimental evidence from a large interactive searching study that compared the use of semantic components in a system with full text and keyword indexing, where we extended the query language to allow users to search using semantic components, to a base system that did not have semantic components. We evaluate the systems from a system perspective, where semantic components were shown to improve document ranking for precision-oriented searches, and from a user perspective. We also evaluate the systems from a sessionbased perspective, evaluating not only the results of individual queries but also the results of multiple queries during a single interactive query session.

View PDFchevron_right
A modular approach to document indexing and semantic search
Krishnaprasad Thirunarayan

2005

This paper develops a modular approach to improving effectiveness of searching documents for information by reusing and integrating mature software components such as Lucene APIs, WORDNET, LSA techniques, and domain-specific controlled vocabulary. To evaluate the practical benefits, the prototype was used to query MEDLINE database, and to locate domain-specific controlled vocabulary terms in Materials and Process Specifications. Its extensibility has been demonstrated by incorporating a spell-checker for the input query, and by structuring the retrieved output into hierarchical collections for quicker assimilation. It is also being used to experimentally explore the relationship between LSA and document clustering using 20-mini-newsgroups and Reuters data. In future, this prototype will be used as experimental testbed for expressive, context-aware and scalable searches.

View PDFchevron_right
ENRICHING SEARCH RESULTS USING ONTOLOGY
iaeme iaeme

The contents of World Wide Web increases dynamically every day. Keyword based search is used for finding documents that are relevant to search query. Due to tremendous amount of information available on internet, it becomes very difficult to get relevant documents by using only keyword based search. The search results are based solely upon the frequency of keywords alone without any extra intelligence. The meaning of keywords is not considered in traditional search techniques.

View PDFchevron_right
Search Query Extension Semantics
Natalia Tuchkova

2021

The problems of extracting the most complete information from the semantic library by accounting for related documents are considered. Expert knowledge encrypted in the subject area can be made available when the user obtains additional information from linked documents. A feature of the approach is the use of a shallow neural network algorithm to expand the search query in mathematical subject areas, where expert knowledge is available with a significant scientific background of users. The solution to this problem can be achieved by means of semantic analysis in the knowledge space using machine learning algorithms. The paper investigates the construction of a vector representation of documents based on paragraphs in relation to the data array of the digital semantic library LibMeta. Each piece of text is labelled. Both the whole document and its separate parts can be marked. Since the problem of enriching user queries with synonyms was solved, when building a search model in conju...

View PDFchevron_right
Search Engines going beyond Keyword Search: A Survey
Mahmudur Rahman, Ph.D.

In order to solve the problem of information overkill on the web or large domains, current information retrieval tools especially search engines need to be improved. Much more intelligence should be embedded to search tools to manage the search and filtering processes effectively and present relevant information. As the web swells with more and more data, the predominant way of sifting through all of that data -keyword search -will one day break down in its ability to deliver the exact information people want at our fingertips. Hence search engines are trying to break the shackles of the concept of keyword search what typically most search engines do. This paper tries to identify the major challenges for today's keyword search engines to adapt with the fast growth of web and support comprehensive user demands in quick time. Then it surveys different non-keyword based paradigms proposed, developed or implemented by researchers and different search engines and also classifies those approaches according to the features focused by the different search engines to deliver results.

View PDFchevron_right
Searching the Web: From Keywords to Semantic Queries
Arantza Illarramendi, Eduardo Mena

Third International Conference on Information Technology and Applications (ICITA'05), 2005

Within the emergent Semantic Web framework, the use of traditional web search engines based on keywords provided by the users is not adequate anymore. Instead, new methods based on the semantics of user keywords must be defined to search in the vast Web space without incurring in an undesirable loss of information.

View PDFchevron_right
The Role of Explicit Semantics in Search and Browsing
Michiel Hildebrand

Multimedia …, 2011

In recent years several Semantic Web applications have been developed that support some form of search. These applications provide different types of search functionality and make use of the explicit semantics present in the data in various ways. The aim of this chapter is to give an overview of the semantic search functionalities provided by the current state of the art in Semantic Web applications. Excluding search based on structured query languages such as SPARQL (Prud'homme and Seaborne 2007), we focus on queries based on simple textual entry forms and queries constructed by navigation (e.g. faceted browsing). We provide a systematic understanding of the different design dimensions that play a role in supporting search on Semantic Web data. Using the required insights, we describe the design decisions made in two of our own tools with practical use cases.

View PDFchevron_right

References (21)

  1. R. Bhagdev, S. Chapman, F. Ciravegna, V. Lanfranchi, and D. Petrelli. Hybrid search: Effectively combining keywords and ontology-based searches. In Proceed- ings of the 5th European Semantic Web Conference (ESWC'08), pages 554-568, Tenerife, Canary Islands, Spain, June 2008.
  2. D.W. Embley, S.W. Liddle, D.W. Lonsdale, J.S. Park, B.-J. Shin, and A. Zitzel- berger. Cross-language hybrid keyword and semantic search. In Proceedings of the 31st International Conference on Conceptual Modeling (ER 2012), pages 190-203, Florence, Italy, October 2012.
  3. D.W. Embley and A. Zitzelberger. Theoretical foundations for enabling a web of knowledge. In Proceedings of the Sixth International Symposium on Foundations of Information and Knowledge Systems (FoIKS'10), pages 211-229, Sophia, Bulgaria, February 2010.
  4. P. Buitelaar, P. Cimiano, P. Haase, and M. Sintek. Towards linguistically grounded ontologies. In Proceedings of the 6th European Semantic Web Conference (ESWC'09), pages 111-125, Heraklion, Greece, May/June 2009.
  5. D.W. Embley. Programming with data frames for everyday data items. In Proceed- ings of the 1980 National Computer Conference, pages 301-305, Anaheim, Califor- nia, May 1980.
  6. D.W. Embley, D.M. Campbell, Y.S. Jiang, S.W. Liddle, D.W. Lonsdale, Y.-K. Ng, and R.D. Smith. Conceptual-model-based data extraction from multiple-record web pages. Data & Knowledge Engineering, 31(3):227-251, 1999.
  7. V. Rus. A first evaluation of logic form identification systems. In R. Mihalcea and P. Edmonds, editors, Senseval-3: Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text, pages 37-40, Barcelona, Spain, March 2004.
  8. C. Tao, D.W. Embley, and S.W. Liddle. FOCIH: Form-based ontology creation and information harvesting. In Proceedings of the 28th International Conference on Conceptual Modeling (ER2009), pages 346-359, Gramado, Brazil, November 2009.
  9. M. Fernandez, V. Lopez, M. Sabou, V. Uren, D. Vallet, E. Motta, and P. Castells. Semantic search meets the web. In Proceedings of the Second IEEE International Conference on Semantic Computing (ICSC'08), pages 253-260, Santa Clara, Cal- ifornia, 2008.
  10. C.D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Re- trieval. Cambridge University Press, New York, New York, July 2008.
  11. T.-Y. Liu. Learning to Rank for Information Retrieval. Springer, Berlin, Germany, 1st edition, 2011.
  12. A.C. Rencher and W.F. Christensen. Methods of Multivariate Analysis. Wiley, 3rd edition, July, 2012.
  13. P. Castells, M. Fernandez, and D. Vallet. An adaptation of the vector-space model for ontology-based information retrieval. IEEE Transactions on Knowedge and Data Engineering, 19(2):261-272, February 2007.
  14. B. Fazzinga, G. Gianforme, G. Gottlob, and T. Lukasiewicz. Semantic web search based on ontological conjunctive queries. In Proceedings of the Sixth International Symposium on Foundations of Information and Knowledge Systems (FoIKS10), pages 153-172, Sophia, Bulgaria, February 2010.
  15. G. Giannopoulos, N. Bikakis, T. Dalamagas, and T.K. Sellis. GoNTogle: A tool for semantic annotation and search. In Proceedings of the Seventh European Semantic Web Conference (ESWC'10), pages 376-380, May/June 2010.
  16. J. Pound, I.F. Ilyas, and G. Weddell. Expressive and flexible access to web- extracted data: A keyword-based structured query language. In Proceedings of the 2010 International Conference on Management of Data (SIGMOD'10), pages 423-434, Indianapolis, Indiana, June 2010.
  17. H. Wang, T. Tran, and C. Liu. CE 2 : Towards a large scale hybrid search engine with integrated ranking support. In Proceedings of the 17th ACM Conference on Information and Knowledge Management (CIKM'08), pages 1323-1324, Napa Valley, California, October 2008.
  18. L. Zhang, Q. Liu, J. Zhang, H. Wang, Y. Pan, and Y. Yu. Semplore: An IR approach to scalable hybrid query of semantic web data. In Proceedings of the 6th International Semantic Web Conference and 2nd Asian Semantic Web Conference (ISWC/ASWC'07), pages 652-665, Busan, Korea, November 2007.
  19. V. Lopez, V. Uren, M.R. Sabou, and E. Motta. Cross ontology query answering on the semantic web: An initial evaluation. In Proceedings of the Fifth Inter- national Conference on Knowledge Capture (K-CAP'09), pages 17-24, Redondo Beach, California, September 2009.
  20. D. Damljanovic, M. Agatonovic, and H. Cunningham. Natural language interfaces to ontologies: Combining syntactic analysis and ontology-based lookup through the user interaction. In Proceedings of the 7th Extended Semantic Web Conference (ESWC10), pages 106-120, Heraklion, Greece, May/June 2010.
  21. O. Egozi, S. Markovitch, and E. Gabrilovich. Concept-based information retrieval using explicit semantic analysis. ACM Transactions on Information Systems, 29(2):1-34, April 2011.

Related papers

Hybrid Search: Effectively Combining Keywords and Semantic Searches
Ravish Bhagdev, Daniela Petrelli

2008

This paper describes hybrid search, a search method supporting both document and knowledge retrieval via the flexible combination of ontology-based search and keyword-based matching. Hybrid search smoothly copes with lack of semantic coverage of document content, which is one of the main limitations of current semantic search methods. In this paper we define hybrid search formally, discuss its compatibility with the current semantic trends and present a reference implementation: K-Search. We then show how the method outperforms both keyword-based search and pure semantic search in terms of precision and recall in a set of experiments performed on a collection of about 18.000 technical documents. Experiments carried out with professional users show that users understand the paradigm and consider it very powerful and reliable. K-Search has been ported to two applications released at Rolls-Royce plc for searching technical documentation about jet engines.

View PDFchevron_right
A Comparative Study between Keyword and Semantic Based Search Engines
Boll Xu

Keyword based Search engines are not able to provide relevant search result because they suffer from the fact that they do not know the meaning of the terms and expression used in the web pages and the relationship between them. This paper compares the semantic search performance of both keyword-based and semantic web based search engines. Initially, two keyword based search engines (Google and Yahoo) and three semantic search engines (Hakia, DuckDuckGo and Bing) are selected to compare their search performance on the basis of precision ratio and how they handle natural language queries. Ten queries, from various topics was run on each search engine, the first twenty documents on each retrieval output was classified as being "relevant" or "non-relevant". Afterwards, precision ratios were calculated for the first 20 document retrieved to evaluate performance of these search engines. Also, comparison of some popular Semantic search engines is provided with their features.

View PDFchevron_right
Ontology-based interpretation of keywords for semantic search
Sebastian Rudolph

The Semantic Web, 2007

Current information retrieval (IR) approaches do not formally capture the explicit meaning of a keyword query but provide a comfortable way for the user to specify information needs on the basis of keywords. Ontology-based approaches allow for sophisticated semantic search but impose a query syntax more diAEcult to handle. In this paper, we present an approach for translating keyword queries to DL conjunctive queries using background knowledge available in ontologies. We present an implementation which shows that this interpretation of keywords can then be used for both exploration of asserted knowledge and for a semantics-based declarative query answering process. We also present an evaluation of our system and a discussion of the limitations of the approach with respect to our underlying assumptions which directly points to issues for future work.

View PDFchevron_right
Integrating Keywords and Semantics on Document Annotation and Search
Giorgos Giannopoulos, Nikos Bikakis

9th International Conference on Ontologies, DataBases, and Applications of Semantics (ODBASE '10)

This paper describes GoNTogle, a framework for document annotation and retrieval, built on top of Semantic Web and IR technologies. GoNTogle supports ontology-based annotation for documents of several formats, in a fully collaborative environment. It provides both manual and automatic annotation mechanisms. Automatic annotation is based on a learning method that exploits user annotation history and textual information to automatically suggest annotations for new documents. GoNTogle also provides search facilities beyond the traditional keyword-based search. A flexible combination of keyword-based and semantic-based search over documents is proposed in conjunction with advanced ontology-based search operations. The proposed methods are implemented in a fully functional tool and their effectiveness is experimentally validated.

View PDFchevron_right
Comparative Study of Semantic and Keyword Based Search Engines
bzar hussan

Advances in Science, Technology and Engineering Systems Journal

Day by day, the data on the web becomes very huge which makes it difficult to find relevant information. Search engines are one of the successful factors that can retrieve information from the Web. The process of seeking information by search engines helps users find information on the internet, however it is not an easy task to find the exact information from this massive data available on the Web. Semantic Web technology has an ability to focus on metadata rather than syntax, which made the semantic search engines to search for the meaning of keywords instead of the keyword syntax. Consequently, an effective role of performance in conventional search engines can be achieved by rising the accuracy of information returned by a search query. In this paper, a survey for syntactic-based search engines and semantic-based search engines are studied, a comprehensive comparison between the two is presented, finally, their technologies are compared and discussed.

View PDFchevron_right

Related topics

  • Computer Science
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved