Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Interacting with the Database
Requirement Analysis
Related Work
Summary and Future Work
References
All Topics
Mathematics
Statistics

3D visual data mining—goals and experiences

Profile image of Peter MusaeusPeter Musaeus

2003, Computational Statistics & Data Analysis

Abstract

The visual exploration of large databases raises a number of unresolved inference problems and calls for new interaction patterns between multiple disciplines-both at the conceptual and technical level. We present an approach that is based on the interaction of four disciplines: database systems, statistical analyses, perceptual and cognitive psychology, and scientific visualization. At the conceptual level we offer perceptual and cognitive insights to guide the information visualization process. We then choose cluster surfaces to exemplify the data mining process, to discuss the tasks involved, and to work out the interaction patterns.

Related papers

Role of Human Perception in Cluster-based Visual Analysis of Multidimensional Data Projections
Robson Motta

Proceedings of the 5th International Conference on Information Visualization Theory and Applications, 2014

Visualization of high-dimensional data requires a mapping to a visual space. Whenever the goal is to preserve similarity relations, multidimensional projections or other dimension reduction techniques are commonly used to project high-dimensional data point to a 2D point using a certain strategy for the 2D layout.Typical analysis tasks for projected multidimensional data do not necessarily match the expectations of human perception. Learning more about the effectiveness of projection layouts from a users perspective is an important step towards consolidating their role in supporting visual analytics tasks. Those tasks often involve detecting and correlating clusters. To understand the role of orientation and cluster properties of size, shape and density, we first conducted a study with synthetic 2D scatter plots, where we can set the respective properties manually. Then we picked five projection methods representative of different approaches to generate layouts of high dimensional data for two domains, image and document data. The users were asked to identify the clusters on real-world data and answers to questions were compared for correctness against ground truth computed directly from the data. Our results offer interesting insight on the use of projection layouts in data visualization tasks.

View PDFchevron_right
Visual data mining: integrating machine learning with information visualization
Ian T Nabney

2006

Today, the data available to tackle many scientific challenges is vast in quantity and diverse in nature. The exploration of heterogeneous information spaces requires suitable mining algorithms as well as effective visual interfaces. Most existing systems concentrate either on mining algorithms or on visualization techniques. Though visual methods developed in information visualization have been helpful, for improved understanding of a complex large high-dimensional dataset, there is a need for an effective projection of such a dataset onto a lower-dimension (2D or 3D) manifold. This paper introduces a flexible visual data mining framework which combines advanced projection algorithms developed in the machine learning domain and visual techniques developed in the information visualization domain. The framework follows Shneiderman’s mantra to provide an effective user interface. The advantage of such an interface is that the user is directly involved in the data mining process. We in...

View PDFchevron_right
An overview of interactive visual data mining techniques for knowledge discovery
Bogdan Gabrys

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2013

In the past decade the field of data mining has faced the challenge of dealing with very large and complex datasets and the real time generation of data. Technologies to store and access these complex and large datasets are in place. However, robust and scalable data mining technologies are needed in order to extract meaningful information from these datasets. The research field of Information Visualisation and the upcoming field of Visual Data Analytics address this need. Both fields are often coalescent in the data mining literature, as their common objective is to access the powerful image processing capabilities of the human brain in order to facilitate the extraction of meaningful information from complex and possibly large data. This paper highlights the basic ideas comprising this field of research from a data mining perspective. Furthermore we highlight existing techniques, systems and applications including a perspective on the field from the chemical process industry.

View PDFchevron_right
Conventional displays of structures in data compared with interactive projection-based clustering (IPBC)
Michael Thrun

International Journal of Data Science and Analytics, 2021

Clustering is an important task in knowledge discovery with the goal to identify structures of similar data points in a dataset. Here, the focus lies on methods that use a human-in-the-loop, i.e., incorporate user decisions into the clustering process through 2D and 3D displays of the structures in the data. Some of these interactive approaches fall into the category of visual analytics and emphasize the power of such displays to identify the structures interactively in various types of datasets or to verify the results of clustering algorithms. This work presents a new method called interactive projection-based clustering (IPBC). IPBC is an open-source and parameter-free method using a human-in-the-loop for an interactive 2.5D display and identification of structures in data based on the user’s choice of a dimensionality reduction method. The IPBC approach is systematically compared with accessible visual analytics methods for the display and identification of cluster structures us...

View PDFchevron_right
Visualization for knowledge discovery
Georges Grinstein

International Journal of Intelligent Systems, 1992

Although the fields of data visualization and automated knowledge discovery (AKD) share many goals, workers in each field have been reluctant to adopt the tools and methods of the other field. Many AKD researchers discourage the use of visualization tools because they believe that dependence on human steering will impede the development of numerical or analytical descriptions of complex data. Many visualization researchers are concerned that their present platforms are being pushed to the limits of their performance by the most advanced visualization techniques and are therefore unwilling to incur the perceived overhead of having a database system mediate access to the data. We argue that these attitudes are somewhat short-sighted and that the techniques of these two communities are complementary. We discuss a specific visualization system that we have developed and describe the obstacles that must be overcome in integrating it into an AKD system. © 1992 John Wiley & Sons, Inc.

View PDFchevron_right
Data mining and visualization: some strategies
Edward Wegman

Bull Int Statist Inst, 1999

View PDFchevron_right
Evaluating Multidimensional Visualization Techniques in Data Mining Tasks
Dorina Rajanen (Marghescu)

Visual data mining (VDM) tools employ information visualization techniques in order to represent large amounts of high-dimensional data graphically and to involve the user in exploring data at different levels of detail. The users are looking for outliers, patterns and models -in the form of clusters, classes, trends, and relationships -in different categories of data, i.e., financial, business information, etc.

View PDFchevron_right
A Framework for Exploring Multidimensional Data with 3D Projections
Tran Long, Jorge L Poco, Paul Rosenthal

Computer Graphics Forum, 2011

Visualization of high-dimensional data requires a mapping to a visual space. Whenever the goal is to preserve similarity relations a frequent strategy is to use 2D projections, which afford intuitive interactive exploration, e.g., by users locating and selecting groups and gradually drilling down to individual objects. In this paper, we propose a framework for projecting high-dimensional data to 3D visual spaces, based on a generalization of the Least-Square Projection (LSP). We compare projections to 2D and 3D visual spaces both quantitatively and through a user study considering certain exploration tasks. The quantitative analysis confirms that 3D projections outperform 2D projections in terms of precision. The user study indicates that certain tasks can be more reliably and confidently answered with 3D projections. Nonetheless, as 3D projections are displayed on 2D screens, interaction is more difficult. Therefore, we incorporate suitable interaction functionalities into a framework that supports 3D transformations, predefined optimal 2D views, coordinated 2D and 3D views, and hierarchical 3D cluster definition and exploration. For visually encoding data clusters in a 3D setup, we employ color coding of projected data points as well as four types of surface renderings. A second user study evaluates the suitability of these visual encodings. Several examples illustrate the framework's applicability for both visual exploration of multidimensional abstract (non-spatial) data as well as the feature space of multi-variate spatial data.

View PDFchevron_right
Visual Data-Mining Techniques
Mihael Ankerst, Mike Sips

Visualization Handbook, 2005

Never before in history has data been generated at such high volumes as it is today. Exploring and analyzing the vast volumes of data has become increasingly difficult. Information visualization and visual data mining can help to deal with the flood of information. The advantage of visual data exploration is that the user is directly involved in the data mining process. There are a large number of information visualization techniques that have been developed over the last two decades to support the exploration of large data sets. In this paper, we propose a classification of information visualization and visual data mining techniques based on the data type to be visualized, the visualization technique, and the interaction technique. We illustrate the classification using a few examples, and indicate some directions for future work.

View PDFchevron_right
Information Visualization in Data Mining and Knowledge Discovery
Andreas Wierse

2000

View PDFchevron_right

References (35)

  1. A. Aboulnaga and S. Chaudhuri. Self-tuning histograms: building histograms without look- ing at data. In Proceedings of the ACM SIGMOD 1999 International Conference on Man- agement of Data, June, Philadephia, Pennsylvania, pages 181-192, 1999.
  2. S. Berchtold, D. A. Keim, and H.-P. Kriegel. The X-tree : An Index Structure for High- Dimensional Data. In T. M. Vijayaraman, A. P. Buchmann, C. Mohan, and N. L. Sarda, editors, VLDB'96, Proceedings of 22th International Conference on Very Large Data Bases, September 3-6, 1996, Mumbai (Bombay), India, pages 28-39. Morgan Kaufmann, 1996.
  3. B. Blohsfeld, D. Korus, and B. Seeger. A Comparison of Selectivity Estimators for Range Queries on Metric Attributes. In A. Delis, C. Faloutsos, and S. Ghandeharizadeh, editors, Proceedings ACM SIGMOD 1999 International Conference on Management of Data, June, Philadephia, Pennsylvania, USA, pages 239-250. ACM Press, 1999.
  4. A. Buja, D. F. Swayne, and D. Cook. Interactive high-dimensional data visualization. Journal of Computational and Graphical Statistics, Vol. 5(No. 1):78-99, 1996.
  5. M. P. Consens and A. O. Mendelzon. Hy+: A Hygraph-based Query and Visualization System. In P. Buneman and S. Jajodia, editors, Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, Washington, D.C., May 26-28, 1993, pages 511-516. ACM Press, 1993.
  6. G. C. Van den Eijkel, J. C. A. Van der Lubbe, and E. Backer. A Modulated Parzen-Windows Approach for Probability Density Estimation. In IDA, 1997.
  7. L. Devroy and L. Gyorfi. Nonparametric Density Estimation. Jon Wiley & Sons, 1984.
  8. M. Farmen and J. S. Marron. An Assesment of Finite Sample Performace of Adaptive Meth- ods inDensity Estimation. In Computational Statistics and Data Analysis, 1998.
  9. C. Glymour, D. Madigan, D. Pregibon, and P. Smyth. Statistical Inference and Data Mining. Communications of the ACM, 39(11), November 1996.
  10. A. Guttman. R-Trees: A Dynamic Index Structure for Spatial Searching. In B. Yormark, editor, SIGMOD'84, Proceedings of Annual Meeting, Boston, Massachusetts, June 18-21, 1984, pages 47-57. ACM Press, 1984.
  11. A. Henrich. The LSD h -Tree: An Access Structure for Feature Vectors. In Proceedings of the Fourteenth International Conference on Data Engineering, February 23-27, 1998, Orlando, Florida, USA, pages 362-369. IEEE Computer Society, 1998.
  12. R. Jackendoff. The architecture of the linguistic-spatial interface. In P. Bloom, M. A. Pe- terson, L. Nadel, and M. F. Garrett, editors, Language and Space, pages 1-30. MIT Press, 1996.
  13. N. Katayama and S. Satoh. The SR-tree: An Index Structure for High-Dimensional Nearest Neighbor Queries. In J. Peckham, editor, Proceedings ACM SIGMOD 1997 International Conference on Management of Data, May 13-15, 1997, Tucson, Arizona, USA, pages 369- 380. ACM Press, 1997.
  14. V. Katkovnik and I. Shmulevich. Nonparametric Density Estimation with Adaptive Vary- ing Window Size. In Conference on Image and Signal Processing for Remote Sensing VI, European Symposium on Remote Sensing, Barcelona, Spain, September 25-29, 2000.
  15. D. A. Keim. Visual data mining. tutorial notes, Athens, Greece 1997.
  16. D. A. Keim and H.-P. Kriegel. Visdb: A system for visualizing large databases. In M. J. Carey and D. A. Schneider, editors, Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data, San Jose, California, May 22-25, 1995, page 482. ACM Press, 1995.
  17. J. Lee, D. Kim, and C. Chung. Multi-dimensional Selectivity Estimation Using Compressed Histogram Information. In A. Delis and C. Faloutsos and S. Ghandeharizadeh, editor, Pro- ceedings of the ACM SIGMOD 1999 International Conference on Management of Data, June, Philadephia, Pennsylvania, USA, pages 205-214. ACM Press, 1999.
  18. W. Lorensen and H. Cline. Marchine cubes: A high resolution 3d surface construction algorithm, 1987.
  19. A. Mažeika, M. Böhlen, and P. Mylov. Density Surfaces for Immersive Explorative Data Analyses. Proceedings of the Workshop on Visual Data Mining, in conjunction with Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2001.
  20. H. R. Nagel, E. Granum, and P. Musaeus. Methods for Visual Mining of Data in Virtual Reality. Proceedings of the International Workshop on Visual Data Mining, in conjunction with ECML/PKDD2001 -2th European Conference on Machine Learning (ECML'01) and 5th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD'01), 2001.
  21. J. T. Robinson. The K-D-B-Tree: A Search Structure For Large Multidimensional Dynamic Indexes. In Y. Edmund Lien, editor, Proceedings of the 1981 ACM SIGMOD International Conference on Management of Data, Ann Arbor, Michigan, April 29 -May 1, 1981, pages 10-18. ACM Press, 1981.
  22. S. Sain. Adaptive Kernel Density Estimation, 1994.
  23. S. Šaltenis, C. S. Jensen, S. T. Leutenegger, and M. A. Lopez. Indexing the Positions of Continuously Moving Objects. In W. Chen, J. F. Naughton, and P. A. Bernstein, editors, Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, May 16-18, 2000, Dallas, Texas, USA, volume 29, pages 331-342. ACM, 2000.
  24. N. Sawant, C. Scharver, J. Leigh, A. Johnson, G. Reinhart, E. Creel, S. Batchu, S. Bailey, and R. Grossman. The Tele-Immersive Data Explorer: A Distributed Architecture for Collabora- tive Interactive Visualization of Large Data-sets. In Proceedings of the Fourth International Immersive Projection Technology Workshop, Ames, June 2000.
  25. B. J. Scholl. Objects and attention: the state of the art. Cognition, 80:1-46, 2001.
  26. D. W. Scot. Multivariate Density Estimation. Wiley & Sons, New York, 1992.
  27. H. Shen and C. Johnson. Sweeping Simplicies: A Fast Isosurface Extraction Algorithm for Unstructured Grids. In Proceedings of Visualization 1995, pages 143-150, Atlanta, GA, October 1995. IEEE Computer Society Press.
  28. B. W. Silverman. Density Estimation for Statistics and Data Analysis. Chapman & Hall, London, 1986.
  29. C. C. Taylor. Bootstrap Choice of the Smoothing Parameter in Kernel Density Estimation. Biometrika, 76(4):705-12, 1989.
  30. S. Ullman. High-level Vision. Object Recognition and Visual Cognition. Cambridge, Mas- sachusetts, The MIT Press, 1996.
  31. M. P. Wand and M. C. Jones. Kernel Smoothing. Chapman & Hall, London, 1985.
  32. C. Ware. Information Visualization: Perception for Design. Morgan Kaufmann Publishers, 2000.
  33. E. J. Wegman and Q. Luo. Visualizing Densities. Technical Report Report No. 100, Center for Computational Statistics, George Mason University, 1994.
  34. D. A. White and R. Jain. Similarity Indexing with the SS-tree. In S. Y. W. Su, editor, Proceedings of the Twelfth International Conference on Data Engineering, February 26 - March 1, 1996, New Orleans, Louisiana, pages 516-523. IEEE Computer Society, 1996.
  35. J. Wilhelms and A. Van Gelder. Octrees for Faster Isosurface Generation. ACM Transactions on Graphics, 11(3):201-227, 1992.

Related papers

An Overview of Interaction Techniques and 3D Representations for Data Mining
Fabrice Guillet

Applications of Virtual Reality, 2012

View PDFchevron_right
Towards the development of environments for designing visualisation support for visual data mining
Simeon Simoff

2001

John W. Tukey, who made unparalleled contributions to statistics and to science in general, during his long career at Bell Labs and Princeton University, emphasized that seeing may be believing or disbelieving, but above all, data analysis involves visual, as well as statistical, understanding. Perhaps the most famous and certainly one of the oldest visual explanations in mathematics is the visual proof of the Pythagorean theorem. This proof is unusual in its brevity and its complete appropriateness to the problem. Pictures and diagrams are also used in non-geometrical parts of mathematics, mostly for psychological reasons: harnessing our ability to reason "visually" with the elements of a diagram in order to assist our more purely logical or analytical thought processes. Thus, visual reasoning approach to the area of data mining and machine learning promises to overcome some of the difficulties experienced in the comprehension of the information encoded in data sets and the models derived by other quantitative data mining methods.

View PDFchevron_right
Evaluating the Effectiveness of Projection Techniques in Visual Data Mining
Dorina Rajanen (Marghescu)

When dealing with large amounts of high-dimensional data, one approach is to reduce the number of data dimensions by applying a projection technique. The later reduces the data dimensionality by combining the original variables into a smaller number of new dimensions, in a linear or nonlinear manner. The projection methods are particularly useful because they lend themselves to visual representations of data, when the number of new dimensions is one, two or three. In this paper, we compare different visualization techniques based on projection techniques with respect to their effectiveness for solving a data-mining task such as clustering. We investigate the use of cluster validity measures in order to judge the effectiveness of the projection techniques in visual data mining. The results show that cluster validity is a successful approach to evaluate objectively the visualization techniques.

View PDFchevron_right
Visual Techniques for the Interpretation of Data Mining Outcomes
Ioannis Kopanakis

Lecture Notes in Computer Science, 2005

The visual senses for humans have a unique status, offering a very broadband channel for information flow. Visual approaches to analysis and mining attempt to take advantage of our abilities to perceive pattern and structure in visual form and to make sense of, or interpret, what we see. Visual Data Mining techniques have proven to be of high value in exploratory data analysis and they also have a high potential for mining large databases. In this work, we try to investigate and expand the area of visual data mining by proposing a new 3-Dimensional visual data mining technique for the representation and mining of classification outcomes and association rules.

View PDFchevron_right
Coupling clustering and visualization for knowledge discovery from data
Guenael Cabanes

2011

The exponential growth of data generates terabytes of very large databases. The growing number of data dimensions and data objects presents tremendous challenges for effective data analysis and data exploration methods and tools. One solution commonly proposed is the use of a condensed description of the properties and structure of data. Thus, it becomes crucial to have visualization tools capable of representing the data structure, not from the data themselves, but from these condensed descriptions. The purpose of our work described in this paper is to develop and put a synergistic visualization of data and knowledge into the knowledge discovery process. We propose here a method of describing data from enriched and segmented prototypes using a clustering algorithm. We then introduce a visualization tool that can enhance the structure within and between groups in data. We show, using some artificial and real databases, the relevance of the proposed method.

View PDFchevron_right

Related topics

  • Cognitive Psychology
  • Computer Science
  • Scientific Visualization
  • Econometrics
  • Perception
  • Statistics
  • Visualization
  • Information Visualization
  • Data Science
  • Data Exploration
  • Statistics and Data Analysis
  • Computational Statistics and Dat...
  • Interaction Pattern
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved