An Overview of Web Content Mining Tools

Web data mining became an easy and important platform for retrieval of useful information. Users prefer World Wide Web more to upload and download data. As increasing growth of data over the internet, it is getting difficult and time consuming for discovering informative knowledge and patterns. Digging knowledgeable and user queried information from unstructured and inconsistent data over the web is not an easy task to perform. Different mining techniques are used to fetch relevant information from web (hyperlinks, contents, web usage logs). Web data mining is a sub discipline of data mining which mainly deals with web. Web data mining is divided into three different types: web structure, web content and web usage mining. All these types use different techniques, tools, approaches, algorithms for discover information from huge bulks of data over the web.

The World Wide Web is a popular and interactive medium to disseminate information today. It is a system of interlinked hypertext documents accessed via the Internet. With a web browser, one can view web pages that may contain text, images, videos, and other multimedia, and navigate between them via hyperlinks. With the recent explosive growth of the amount of content on the Internet, it has become increasingly difficult for users to find and utilize information and for content providers to classify and catalog documents on the World Wide Web. Traditional web search engines often return hundreds or thousands of results for a search, which is time consuming for users to browse. On-line libraries, search engines, and other large document repositories (e.g. customer support databases, product specification databases, press release archives, news story archives, etc.) are growing so rapidly that it is difficult and costly to categorize every document manually. To deal with these problems web mining is used. Web mining is the use of data mining techniques to automatically discover and extract information from the web documents and services. This paper presents an overview of web mining, its methodologies, algorithms and applications.

International Journal of Advanced Computer Science and Applications

In recent years, the emergence of WWW (World Wide Web) led to the accumulation of huge amount of information and data. Hence the web is found to consist of unstructured and structured information that impacts the day to day life of the society. Because of such availability of huge information, utilization of the required information becomes more challenging. This paper provided a comprehensive survey on the current situation and recent trends on web content mining (WCM) and its applications thereby contributing to the enhancement of the upcoming research in WCM. The paper focused mainly on the mining and retrieval techniques, various WCM approaches, challenges and process of information retrieval and information extraction. The paper describes the four major tasks of web content mining that is information retrieval, information extraction, generalization and validation in detail. WCM concentrates on orchestrating, sorting, classifying, collecting, congregating of web data and provide the improved data which can be easily accessed by the users. Web content mining tools were needed to scan text, images and HTML documents and provide results to the search engine. It guides the search engine to provide better productive results for every search based on their importance. The paper also analysed different web content mining tools for the extraction of relevant information from the corresponding web page.

International Journal of Computer Applications, 2012

This study presents the role of Web mining an explosive growth of the World Wide Web; websites are providing an information and knowledge to the end users. This is the review paper which show deep and intense study of various technologies available for web mining and it is the application of data mining techniques to extract knowledge from web. Current advances in each of the three different types of web mining are reviewed in the categories of web content mining, web usage mining, and web structure mining. Index Terms—web mining, web content mining, web usage mining, web structure mining.

International Journal of Engineering Sciences & Research Technology, 2013

The hunt for knowledge has led to new discoveries and inventions. With the materialization of World Wide Web, it became a core for all these discoveries and inventions. Web browsers became a tool to make the information available at our finger tips. WWW stands for World Wide Web, and it is an advanced information retrieval system. As years passed World Wide Web became weighed down with information and it became hard to retrieve data according to the need. Web mining came as salvage for the above problem. Web content mining is a subdivision under web mining. This paper deals with a study of different techniques and pattern of content mining and the areas which has been influenced by content mining. The web contains structured, unstructured, semi structured and multimedia data. This survey focuses on how to apply content mining on the above data. It also points out how web content mining can be utilized in web usage mining.

International Journal on Advanced Science, Engineering and Information Technology

Information on Internet and especially on Web sites increasing rapidly day by day, Web sites play an important role in this manner where a lot of Web users are always upload, download and brows a lot of contents based on their needs. Web server provide a way to browse these contents that scattered in many Web sites that reside in it by assigning an Internet Protocol (IP) address or Domain Name System (DNS) to be accessed around the world. Server log the requests that made by users to access their interesting content then store this information in the form of log file. Log file size can be growth from some kilobytes to several megabytes in few days depending on data traffic and the popularity of Web sites. With the fast growth of the data and information in Web environment made a necessity to use sophisticated techniques that have never used in other domains to extract knowledge and significant Web patterns. Web Mining is an extension of Data Mining that integrated various technology in research fields including Artificial Intelligence (AI), statistics, informatics, knowledge discovery and computational linguistics. The aim of Web Mining is to provide a algorithm or technique to make data accesses more efficient and convenient. Web Mining techniques are categorized into three classes depend on which part to be mined which are: Web Content Mining (WCM), Web Structure Mining (WSM) and Web Usage Mining (WSM), in this paper a survey of Web Mining techniques and application are discussed briefly.

2017

Today the evolution of the World Wide Web has brought us enormous and ever growing amounts of data and information.. The web is full of structured or unstructured information which is directly or indirectly influencing society or people in every day life. Due to huge data available with the web it has become a challenge for people with interest in utilizing this information. For mining the huge available data on web in the form of frequently used patterns and log files for meaning use is considered in this paper. The paper presents a preliminary review of Web content mining contributions in the field of web mining and the prominent successful algorithms and some tools.

Web Mining is a natural combination of two active areas of current research, the Data mining and the World Wide Web. It can be classified into three different types i.e. web content mining, web structure mining and web usage mining. In this paper, we focused on some major aspects of web mining like Link Analysis - a data-analysis technique used to evaluate relationships between nodes by evaluating content, Web Crawling - a system that visits Web sites and reads their pages and other information in order to create entries for a search engine index and understand the structure of the web and Recommendation Systems - systems that produce a list of recommendations from web usage patterns. Through this paper, a detailed study of these techniques, algorithms and their future scopes are discussed.

2014

Web Mining is extracting information from the web resources and finding interesting patterns that can be useful from ever expanding database of World Wide Web. One of the subfield of Web mining is Web Content Mining. The objective of this paper is four folds. Firstly, this paper introduces Web Mining, Secondly, it tries to explain the interrelationship of Web mining with various other areas, thirdly, it explains various Web Content Mining techniques and finally the paper concludes with the analysis of these various techniques.