Academia.eduAcademia.edu

Outline

Visualization of search results

1999, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '99

https://doi.org/10.1145/312624.312634

Abstract

Although there have been many prototypes of visualization in support of information retrieval, there has been little systematic evaluation that distinguishes the benefits of the visualization per se from that of various accompanying features. The current study focuses on such an evaluation of NIRVE, a tool that supports visualization of search results. Insofar as possible, functionally equivalent 3D, 2D, and text versions of NIRVE were implemented. Nine novices and six professional users completed a series of information-seeking tasks on a set of retrieved documents. There were high interface costs for the 3D visualization, although those costs decreased substantially with experience. Performance was best when the tool's properties matched task demands; only under the right combination of task, user, and interface did 3D visualization result in performance comparable to functionally matched 2D and textual tools.

References (18)

  1. REFERENCES
  2. Allen, R.B., Obry, P. Littman, M. An Interface for Navigating Clustered Document Sets Returned by Queries. Proceedings of SIGOIS 203-208, Milpitas CA, June 1993.
  3. Benford, S., Snowdon, D., Greenhalgh, C., Ingram, R., Knox, I., Brown, C. VR-VIBE: A Virtual Environment for Co-operative Information Retrieval. Eurographics '95, Maastricht, The Netherlands, August 1995, 349-360.
  4. Cugini, J., Piatko, C., Laskowski, S. Interactive 3D Visualization for Document Retrieval. Proceedings of the Workshop on New Paradigms in Information Visualization and Manipulation, ACM Conference on Information and Knowledge Management (CIKM '96), November 1996. See http://zing.ncsl.nist.gov/~cugini/uicd/viz.html.
  5. Cugini, J., Laskowski, S., Piatko, C. Document Clustering in Concept Space: The NIST Information Retrieval Visualization Engine (NIRVE). CODATA Euro-American Workshop on Visualization of Information and Data, Paris France, June 1997. S e e http://zing.ncsl.nist.gov/~cugini/uicd/concept-clusters.html and http://www.nist.gov/itl/div894/vvrg/VACD.html.
  6. Fowler, R., Wilson, B., Fowler, W. Information Navigator: An information system using associative networks for display and retrieval, Report NAG9-551, No. 92-1, Univ. of Texas -Pan American, Edinburg, TX. See http://bahia.cs.panam.edu/info_vis/inf_nav/info_nav_tr_92.html.
  7. Hearst, M., Karadi, C. Cat-a-Cone: An Interactive Interface for Specifying Searches and Viewing Retrieval Results using a Large Category Hierarchy. Proceedings 20th Annual International ACM/SIGIR Conference, Phil PA, July 1997. See: http://www.parc.xerox.com/istl/projects/ia/papers/cac- sigir97/sigir97.html.
  8. Kominek, J., Kazman, R. Accessing Multimedia through Concept Clustering, CHI'97 Conference Proceedings, Atlanta GA, March 1997.
  9. Lamping, J., Rao, R., Pirolli, P. A Focus+Context Technique Based on Hyperbolic Geometry for Visualizing Large Hierarchies. CHI '95 Proceedings: Conference on Human Factors in Computing Systems: Mosaic of Creativity, Denver, CO, May, 1995.
  10. Nowell, L.T., France, R.K., Hix, D., Heath, L.S., Fox, E.A. Visualizing Search Results: Some Alternatives to Query Document Similarity. Proceedings of SIGIR'96, Zurich Switzerland, August 1996.
  11. Miller, M., Sebrechts, M., Vasilakis, J., Laskowski, S., Cugini, J. Preliminary Task Analysis of a 3D Information Visualization Tool: Implications for Interface Design. Unpublished manuscript, 1999.
  12. NIST PRISE Search Engine: http://www.itl.nist.gov/div894/894.02/works/papers/zp2/zp2.html
  13. Rennison, E. Galaxy of News: An Approach to Visualizing and Understanding Expansive News Landscapes. Proceedings of UIST'94.
  14. Swan, R.C., Allan, J. Aspect Windows, 3D Visualizations, and Indirect Comparisons of Information Retrieval Systems. Proceedings of the 21st Annual International ACM/SIGIR Conference, Melbourne Australia, August 1998.
  15. Veerasamy, A., Belkin, N. Evaluation of a Tool for Visualization of Information Retrieval Results. Proceedings of SIGIR'96, Zurich Switzerland, August 1996.
  16. Veerasamy, A., and Ileikes, R. Effectiveness of a graphical display of retrieval results. Proceedings of SIGIR'97, Philadelphia, PA, 1997, 236-243.
  17. Wise, J. The Ecological Approach to Text Visualization. JASIS, Sept. 1998.
  18. *Footnote: All statistical analyses are based on standard Analysis of Variance techniques. This approach determines the ratio of variances based on the effects of interest to variance associated with error. The format is F(degrees of freedom for effect, degrees of freedom for error) = value of F for the data, p = probability that a value as large or larger than the obtained F could occur by chance alone. A probability value of less than .05 is normally taken as indicating that the effect is reliable or not due to solely to chance.