Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Designing Interactions for Immersive Analytics
Conclusion
References
All Topics
Computer Science
Human-Computer Interaction

Interaction for Immersive Analytics

Profile image of Steven DruckerSteven Drucker

2018, Immersive Analytics

https://doi.org/10.1007/978-3-030-01388-2_4
visibility

…

description

45 pages

link

1 file

Abstract

In this chapter, we briefly review the development of natural user interfaces and discuss their role in providing human-computer interaction that is immersive in various ways. Then we examine some opportunities for how these technologies might be used to better support data analysis tasks. Specifically, we review and suggest some interaction design guidelines for immersive analytics. We also review some hardware setups for data visualization that are already archetypal. Finally, we look at some emerging system designs that suggest future directions.

Related papers

The Data Visualisation and Immersive Analytics Research Lab at Monash University
Sarah Goodwin

Visual Informatics, 2020

The lab has been influential with contributions in algorithms, interaction techniques and experimental results in Network Visualisation, Interactive Optimisation and Geographic and Cartographic visualisation. It has also been a leader in the emerging topic of Immersive Analytics, which explores natural interactions and immersive display technologies in support of data analytics. We reflect on advances in these areas but also sketch our vision for future research and developments in data visualisation more broadly.

View PDFchevron_right
Involve Me and I Will Understand!–Abstract Data Visualization in Immersive Environments
Bernd Hamann

Lecture Notes in Computer Science, 2011

Literature concerning the visualization of abstract data in immersive environments is sparse. This publication is intended to (1) stimulate the application of abstract data visualization in such environments and to (2) introduce novel concepts involving the user as an active part of the interactive exploratory visualization process. To motivate discussion, requirements for the visualization of abstract data are reviewed and then related to the properties of immersive environments in order to show its potential for data visualization. This leads to the introduction of a novel concept for immersive visualization based on the involvement of the viewers into the data display. The usefulness of the concept is shown by two examples demonstrating that immersive environments are far more than tools to create visually appealing data representations. 1 Introduction Visualization has been quite successful for data analysis, but limitations still exist. One limiting factor is the widely used two-dimensional (2D) display and interaction technology. Although we live and interact in a three-dimensional (3D) environment, most data visualizations use only two dimensions and neglect depth. This is often reasonable as the display of 3D data on 2D desktop screens imposes many drawbacks, such as occlusion, cumbersome interaction, and missing depth cues. First attempts to overcome these problems in data visualization were made by presenting data in immersive environments (IE). IEs are able to provide a synthetic 3D display and interaction space, which is rendered in the rst-person viewpoint [1]. Due to the use of stereoscopic-vision and motion parallax, IEs are able to mimic our natural 3D viewing environment and thus can provide a high level of physical immersion (see Figure 1, left). Early IEs relied on costly hardware, but with the recent boost in 3D display hardware, the technology now becomes much more aordable. Research to visualization in IES mainly focusses on spatial data. Not much is known about abstract data. This might be due to the fact that the natural representation of available spatial components is often considered to be the The author gratefully acknowledges the support of Deutsche Forschungsgemeinschaft (DFG) for funding this research (#RO3755/1-1) Compared to the immersive visualization of spatial data, often referred to as scientic data, not much is known about iAV. Existing approaches can be mainly subdivided into two groups-strategies with or without using the virtual world metaphor. Approaches applying the virtual world metaphor use visuals that mimic principles and behavior of the real world. Most strategies create a virtual world

View PDFchevron_right
Back to the Future: Revisiting Mouse and Keyboard Interaction for HMD-based Immersive Analytics
Jens Grubert

2020

With the rise of natural user interfaces, immersive analytics applications often focus on novel forms of interaction modalities such as mid-air gestures, gaze or tangible interaction utilizing input devices such as depth-sensors, touch screens and eye-trackers. At the same time, traditional input devices such as the physical keyboard and mouse are used to a lesser extent. We argue, that for certain work scenarios, such as conducting analytic tasks at stationary desktop settings, it can be valuable to combine the benefits of novel and established input devices as well as input modalities to create productive immersive analytics environments.

View PDFchevron_right
Visualization, Interaction and Simulation Lab
Anderson Maciel

2021

The Visualization, Interaction, and Simulation Laboratory (VISLab) at UFRGS is majorly concerned with data visualization and human-computer interaction research. Research on data visualization focuses on the development of information visualization techniques and their application to different domains. Studies on interaction emphasize non-conventional, 3D interaction and haptics in the context of virtual (VR) and augmented reality (AR) applications. We integrate these two areas into immersive analytics research and develop data visualization and novel interaction techniques based on VR and AR technologies. The main goal of our projects is to enhance the human with computers, extending the perception capabilities and improving the human power of action in a natural way. In this paper, we present our research focus and strategy to move towards that goal. We also briefly describe and illustrate some recent works developed in the lab.

View PDFchevron_right
Immersive Human-Centered Computational Analytics
Gerik Scheuermann

Immersive Analytics, 2018

In this chapter we seek to elevate the role of the human in human-machine cooperative analysis through a careful consideration of immersive design principles. We consider both strategic immersion through more accessible systems as well as enhanced understanding and control through immersive interfaces that enable rapid workflows. We extend the classic sensemaking loop from visual analytics to incorporate multiple views, scenarios, people, and computational agents. We consider both sides of machine/human collaboration: allowing the human to more fluidly control the machine process; and also allowing the human to understand the results, derive insights and continue the analytic cycle. We also consider system and algorithmic implications of enabling realtime control and feedback in immersive human-centered computational analytics.

View PDFchevron_right
Multimodal interaction for data visualization
Vidya Setlur

Proceedings of the 2018 International Conference on Advanced Visual Interfaces, 2018

Multimodal interaction offers many potential benefits for data visualization. It can help people stay in the flow of their visual analysis and presentation, with the strengths of one interaction modality offsetting the weaknesses of others. Furthermore, multimodal interaction offers strong promise for leveraging data visualization on diverse display hardware including mobile, AR/VR, and large displays. However, prior research on visualization and interaction techniques has mostly explored a single input modality such as mouse, touch, pen, or more recently, natural language. The unique challenges and opportunities of synergistic multimodal interaction for data visualization have yet to be investigated. This workshop will bring together researchers with expertise in visualization, interaction design, and natural user interfaces. We aim to build a community of researchers focusing on multimodal interaction for data visualization, explore opportunities and challenges in our research, and establish an agenda for multimodal interaction research specifically for data visualization.

View PDFchevron_right
Immersive Insights: A Hybrid Analytics System forCollaborative Exploratory Data Analysis
Kenneth Ocheltree

25th ACM Symposium on Virtual Reality Software and Technology on - VRST '19

Figure 1: Immersive Insights is a collaborative, hybrid analytics system for exploratory data analysis. The application, implemented in a Dataspace environment [18], leverages multimodal interaction and combines the use of technologies such as 1) high-resolution movable screens to visualize statistical information, 2) a central projection table providing an overview of the current analysis, and 3) an augmented reality view to visualize and interact with high-dimensional data.

View PDFchevron_right
Immersive Methods for Exploratory Analysis
Edward Wegman
View PDFchevron_right
Personalized Views for Immersive Analytics
Santiago Bonada

2016

In this paper we present work-in-progress toward a vision of personalized views of visual analytics interfaces in the context of collaborative analytics in immersive spaces. In particular, we are interested in the sense of immersion, responsiveness, and personalization afforded by gaze-based input. Through combining large screen visual analytics tools with eye-tracking, a collaborative visual analytics system can become egocentric while not disrupting the collaborative nature of the experience. We present a prototype system and several ideas for real-time personalization of views in visual analytics.

View PDFchevron_right
Immersive Analytics 2.0: Spatial and Embodied Sensemaking
Jiazhou Liu

CHI Conference on Human Factors in Computing Systems Extended Abstracts

Immersive Analytics is now a fully emerged research topic that spans several research communities, including Human-Computer Interaction, Data Visualisation, Virtual Reality and Augmented Reality. Immersive Analytics research has identifed and validated benefts of using embodied, 3D spatial immersive environments for visualisation and have shown benefts in the efective use of space and 3D interaction to explore complex data. As of today, most studies in Immersive Analytics have focused on exploring novel visualisation techniques in 3D embodied immersive environments. Thus far, there is a lack of fundamental study in this feld that clearly compares immersive versus non immersive platforms for analytics purposes, and frmly delineates the benefts of immersive environments for analytic tasks. We feel that it is time to establish an agenda to assess the benefts and potential of immersive technologies, spatial interfaces, and embodied interaction to support sensemaking, data understanding, and collaborative analytics. This workshop will aim at putting this agenda together, by gathering international experts from Immersive Analytics and related felds to defne which studies need to be conducted to assess the efect of embodied interaction on cognition in data analytics.

View PDFchevron_right

References (159)

  1. Adams, N., Witkowski, M., Spence, R.: The inspection of very large images by eye-gaze control. In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI). pp. 111-118. ACM, New York(2008) doi: 10.1145/1385569 .1385589
  2. Amar, R., Eagan, J., Stasko, J.: Low-level components of analytic activity in information visualization. In: Proceedings of the IEEE Symposium on Information Visualization (InfoVis). pp. 111-117. IEEE Computer Society, Los Alamitos(2005) doi: 10.1109/INFVIS.2005.1532136
  3. Andrews, C., Endert, A., North, C.: Space to think: Large high-resolution displays for sensemaking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 55-64. ACM, New York(2010) doi: 10.1145/
  4. Argelaguet, F., Andujar, C.: A survey of 3D object selection techniques for virtual environments. Computers & Graphics 37(3), 121-136(2013) doi: 10.1016/j.cag. 2012.12.003
  5. Arif, A.S., Stuerzlinger, W.: User adaptation to a faulty unistroke-based text entry technique by switching to an alternative gesture set. In: Proceedings of Graphics Interface (GI). pp. 183-192. Canadian Information Processing Society, Toronto(2014) doi: 10.20380/GI2014.24
  6. Bach, B., Sicat, R., Beyer, J., Cordeil, M., Pfister, H.: The hologram in my hand: how effective is interactive exploration of 3D visualizations in immersive tangible augmented reality? IEEE Transactions on Visualization and Computer Graphics 24(1), 457-467(2018) doi: 10.1109/TVCG.2017.2745941
  7. Badam, S.K., Amini, F., Elmqvist, N., Irani, P.: Supporting visual exploration for multiple users in large display environments. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST). pp. 1-10. IEEE Computer Society, Los Alamitos(2016) doi: 10.1109/VAST.2016.7883506
  8. Ball, R., North, C.: Effects of tiled high-resolution display on basic visualization and navigation tasks. In: Extended Abstracts on Human Factors in Computing Systems (CHI EA). pp. 1196-1199. ACM, New York(2005) doi: 10.1145/1056808. 1056875
  9. Ball, R., North, C., Bowman, D.A.: Move to improve: Promoting physical nav- igation to increase user performance with large displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 191-200. ACM, New York(2007) doi: 10.1145/1240624.1240656
  10. Ballmer, S.: CES 2010: A transforming trend-the natural user interface. The Huffington Post (2010), http://www.huffingtonpost.com/steve-ballmer/ces-2010- a-transformingt_b_416598.html/
  11. Beaudouin-Lafon, M., Huot, S., Nancel, M., Mackay, W., Pietriga, E., Primet, R., Wagner, J., Chapuis, O., Pillias, C., Eagan, J., Gjerlufsen, T., Klokmose, C.: Multisurface interaction in the WILD room. Computer 45(4), 48-56(Apr 2012) doi: 10.1109/MC.2012.110
  12. Benko, H., Ishak, E.W.: Cross-dimensional gestural interaction techniques for hybrid immersive environments. In: Proceedings of the IEEE Conference on Virtual Reality (VR). pp. 209-216, 327. IEEE Computer Society, Los Alamitos(2005) doi: 10.1109/VR.2005.1492776
  13. Besançon, L., Issartel, P., Ammi, M., Isenberg, T.: Hybrid tactile/tangible interac- tion for 3D data exploration. IEEE Transactions on Visualization and Computer Graphics 23(1), 881-890(Jan 2017) doi: 10.1109/TVCG.2016.2599217
  14. Bier, E.A., Stone, M.C., Pier, K., Fishkin, K., Baudel, T., Conway, M., Buxton, W., DeRose, T.: Toolglass and magic lenses: The see-through interface. In: Conference Companion on Human Factors in Computing Systems. pp. 445-446. ACM, New York(1994) doi: 10.1145/259963.260447
  15. Billinghurst, M., Clark, A., Lee, G.: A survey of augmented reality. Foundations and Trends ® in Human-Computer Interaction 8(2-3), 73-272(2015) doi: 10.1561/ 1100000049
  16. Bjork, S., Holopainen, J.: Patterns in Game Design (Game Development Series). Charles River Media, Inc., Rockland, MA, USA (2004)
  17. Bolt, R.A.: "Put-that-there": Voice and gesture at the graphics interface. ACM SIGGRAPH Computer Graphics 14(3), 262-270(Jul 1980) doi: 10.1145/965105. 807503
  18. Bolt, R.A.: Gaze-orchestrated dynamic windows. ACM SIGGRAPH Computer Graphics 15(3), 109-119(1981) doi: 10.1145/965161.806796
  19. Branit, B.: World Builder. Online video(2009), https://vimeo.com/3365942
  20. Brown, M.A., Stuerzlinger, W.: Exploring the throughput potential of in-air pointing. In: Proceedings of the International Conference on Human-Computer Interaction (HCI). pp. 13-24. Springer, Berlin/Heidelberg(2016) doi: 10.1007/978 -3-319-39516-6_2
  21. Brown, M.A., Stuerzlinger, W., Mendonça Filho, E.J.: The performance of un- instrumented in-air pointing. In: Proceedings of Graphics Interface (GI). pp. 59-66. Canadian Information Processing Society, Toronto(2014) doi: 10.20380/GI2014. 08
  22. Bruder, G., Steinicke, F., Stuerzlinger, W.: Effects of visual conflicts on 3D selection task performance in stereoscopic display environments. In: Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI). pp. 115-118. IEEE Computer Society, Los Alamitos(2013) doi: 10.1109/3DUI.2013.6550207
  23. Bruder, G., Steinicke, F., Stuerzlinger, W.: To touch or not to touch? Comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces. In: Proceedings of the 1st Symposium on Spatial User Interaction (SUI). pp. 9-16. ACM, New York(2013) doi: 10.1145/2491367.2491369
  24. Bruder, G., Steinicke, F., Stuerzlinger, W.: Touching the void revisited: Anal- yses of touch behavior on and above tabletop surfaces. In: Proceedings of Human-Computer Interaction (INTERACT). pp. 278-296. Springer, Berlin/Hei- delberg(2013) doi: 10.1007/978-3-642-40483-2_19
  25. Büschel, W., Mitschick, A., Dachselt, R.: Here and now: Reality-based information retrieval. In: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval. pp. 171-180. CHIIR '18, ACM, New York, NY, USA(2018) doi: 10. 1145/3176349.3176384
  26. Büschel, W., Reipschläger, P., Langner, R., Dachselt, R.: Investigating the use of spatial interaction for 3D data visualization on mobile devices. In: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. pp. 62-71. ISS '17, ACM, New York, NY, USA(2017) doi: 10.1145/3132272.3134125
  27. Bush, V.: As we may think. The Atlantic Monthly 176(1), 101-108(July 1945), https: //www.theatlantic.com/magazine/archive/1945/07/as-we-may-think/303881/
  28. Butscher, S., Hubenschmid, S., Müller, J., Fuchs, J., Reiterer, H.: Clusters, trends, and outliers: How immersive technologies can facilitate the collaborative analysis of multidimensional data. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. pp. 90:1-90:12. CHI '18, ACM, New York, NY, USA(2018) doi: 10.1145/3173574.3173664
  29. Buxton, B.: Multi-touch systems that I have known and loved. Tech. rep., Microsoft Research(2007), http://www.billbuxton.com/multitouchOverview.html
  30. Card, S.K., Robertson, G.G., Mackinlay, J.D.: The information visualizer, an information workspace. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 181-186. ACM, New York(1991) doi: 10 .1145/108844.108874
  31. EVL CAVE2 homepage, https://www.evl.uic.edu/entry.php?id=2016
  32. Cernea, D., Kerren, A.: A survey of technologies on the rise for emotion-enhanced interaction. Journal of Visual Languages and Computing 31, Part A, 70-86(Dec 2015) doi: 10.1016/j.jvlc.2015.10.001
  33. Chen, J., Bowman, D.A.: Effectiveness of cloning techniques for architectural vir- tual environments. In: IEEE Virtual Reality Conference. pp. 103-110. IEEE(2006) doi: 10.1109/VR.2006.57
  34. Chen, J., Bowman, D.A.: Domain-specific design of 3D interaction techniques: An approach for designing useful virtual environment applications. Presence: Teleoperators and Virtual Environments 18(5), 370-386(2009) doi: 10.1162/pres. 18.5.370
  35. Chen, J., Bowman, D.A., Lucas, J.F., Wingrave, C.A.: Interfaces for Cloning in Immersive Virtual Environments. In: Eurographics Symposium on Virtual Environments. The Eurographics Association(2004) doi: 10.2312/EGVE/EGVE04/ 091-098
  36. Chen, J., Narayan, M.A., Manuel, Pérez-Quiñones, A.: The use of hand-held devices for search tasks in virtual environments. The IEEE Symposium on 3D User Interfaces pp. 15-18 (2005)
  37. Claes, S., Moere, A.V.: The role of tangible interaction in exploring information on public visualization displays. In: Proceedings of the International Symposium on Pervasive Displays (PerDis). pp. 201-207. ACM, New York(2015) doi: 10. 1145/2757710.2757733
  38. Coffey, D., Malbraaten, N., Le, T., Borazjani, I., Sotiropoulos, F., Erdman, A.G., Keefe, D.F.: Interactive Slice WIM: Navigating and interrogating volume datasets using a multi-surface, multi-touch VR interface. IEEE Transactions on Visualiza- tion and Computer Graphics 18(10), 1614-1626(2012) doi: 10.1109/TVCG.2011. 283
  39. Cordeil, M., Cunningham, A., Dwyer, T., Thomas, B.H., Marriott, K.: ImAxes: Immersive axes as embodied affordances for interactive multivariate data visuali- sation. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. pp. 71-83. UIST '17, ACM, New York, NY, USA(2017) doi: 10.1145/3126594.3126613
  40. Cordeil, M., Dwyer, T., Klein, K., Laha, B., Marriott, K., Thomas, B.H.: Immer- sive collaborative analysis of network connectivity: CAVE-style or head-mounted display? IEEE Transactions on Visualization and Computer Graphics 23(1), 441- 450(2017) doi: 10.1109/TVCG.2016.2599107
  41. Cruz-Neira, C., Sandin, D.J., DeFanti, T.A., Kenyon, R.V., Hart, J.C.: The CAVE: audio visual experience automatic virtual environment. Communications of the ACM 35(6), 64-72(Jun 1992) doi: 10.1145/129888.129892
  42. Cummings, J.J., Bailenson, J.N.: How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychology 19(2), 272-309(2016) doi: 10.1080/15213269.2015.1015740
  43. van Dam, A.: Post-WIMP user interfaces. Communications of the ACM 40(2), 63-67(Feb 1997) doi: 10.1145/253671.253708
  44. Dostal, J., Hinrichs, U., Kristensson, P.O., Quigley, A.: Spidereyes: Designing attention-and proximity-aware collaborative interfaces for wall-sized displays. In: Proceedings of the International Conference on Intelligent User Interfaces (IUI). pp. 143-152. ACM, New York(2014) doi: 10.1145/2557500.2557541
  45. Dourish, P.: Where the Action Is: The Foundations of Embodied Interaction. MIT Press (2001)
  46. Drucker, S.M., Fisher, D., Sadana, R., Herron, J., schraefel, m.c.: TouchViz: A case study comparing two interfaces for data analytics on tablets. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 2301-2310. ACM, New York(2013) doi: 10.1145/2470654.2481318
  47. Elmqvist, N., Vande Moere, A., Jetter, H.C., Cernea, D., Reiterer, H., Jankun-Kelly, T.J.: Fluid interaction for information visualization. Information Visualization 10(4), 327-340(Oct 2011) doi: 10.1177/1473871611413180
  48. Febretti, A., Nishimoto, A., Mateevitsi, V., Renambot, L., Johnson, A., Leigh, J.: Omegalib: A multi-view application framework for hybrid reality display environ- ments. In: Proceedings of the IEEE Conference on Virtual Reality (VR). pp. 9-14. IEEE Computer Society, Los Alamitos(2014) doi: 10.1109/VR.2014.6802043
  49. Fikkert, W., D'Ambros, M., Bierz, T., Jankun-Kelly, T.: Interacting with visual- izations. In: Kerren, A., Ebert, A., Meyer, J. (eds.) Human-Centered Visualization Environments, LNCS, vol. 4417, chap. 3, pp. 77-162. Springer, Berlin/Heidel- berg(2007) doi: 10.1007/978-3-540-71949-6_3
  50. Follmer, S., Leithinger, D., Olwal, A., Hogge, A., Ishii, H.: inFORM: Dynamic physical affordances and constraints through shape and object actuation. In: Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST). pp. 417-426. ACM, New York(2013) doi: 10.1145/2501988. 2502032
  51. Frisch, M., Heydekorn, J., Dachselt, R.: Diagram editing on interactive displays using multi-touch and pen gestures. In: Proceedings of the International Conference on Diagrammatic Representation and Inference (Diagrams). pp. 182-196. Springer, Berlin/Heidelberg(2010) doi: 10.1007/978-3-642-14600-8_18
  52. Fu, C.W., Goh, W.B., Ng, J.A.: Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 2213-2222. ACM, New York(2010) doi: 10.1145/1753326.1753661
  53. Gillet, A., Sanner, M., Stoffler, D., Olson, A.: Tangible interfaces for structural molecular biology. Structure 13(3), 483-491(Mar 2005) doi: 10.1016/j.str.2005.01 .009
  54. Harrison, C., Sato, M., Poupyrev, I.: Capacitive fingerprinting: Exploring user differentiation by sensing electrical properties of the human body. In: Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST). pp. 537-544. ACM, New York(2012) doi: 10.1145/2380116.2380183
  55. Heer, J., Shneiderman, B.: Interactive dynamics for visual analysis. Communica- tions of the ACM 55(4), 45-54(Apr 2012) doi: 10.1145/2133806.2133821
  56. Hess, R.F., To, L., Zhou, J., Wang, G., Cooperstock, J.R.: Stereo vision: The haves and have-nots. i-Perception 6(3)(Jun 2015) doi: 10.1177/2041669515593028
  57. Hincapié-Ramos, J.D., Guo, X., Moghadasian, P., Irani, P.: Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 1063- 1072. ACM, New York(2014) doi: 10.1145/2556288.2557130
  58. Hinckley, K., Pausch, R., Goble, J.C., Kassell, N.F.: Passive real-world interface props for neurosurgical visualization. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 452-458. ACM, New York(1994) doi: 10.1145/191666.191821
  59. Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., Buxton, B.: Pen + touch = new tools. In: Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST). pp. 27-36. ACM, New York(2010) doi: 10.1145/1866029.1866036
  60. Hoffman, D.M., Girshick, A.R., Akeley, K., Banks, M.S.: Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8(3), 33:1-33:30(2008) doi: 10.1167/8.3.33
  61. Horak, T., von Zadow, U., Kalms, M., Dachselt, R.: Discussing the state of the art for "in the wild" mobile device localization. In: Proceedings of the ISS Workshop on Interacting with Multi-Device Ecologies "in the wild"(2016), http: //cross-surface.com/papers/Cross-Surface_2016-2_paper_2.pdf
  62. Huang, F.C., Chen, K., Wetzstein, G.: The light field stereoscope: immersive computer graphics via factored near-eye light field displays with focus cues. ACM Transactions on Graphics 34(4), 60:1-60:12(2015) doi: 10.1145/2766922
  63. Hutchins, E.L., Hollan, J.D., Norman, D.A.: Direct manipulation interfaces. Hu- man-Computer Interaction 1(4), 311-338(1985) doi: 10.1207/s15327051hci0104_2
  64. Hutchinson, T.E., White, K.P., Martin, W.N., Reichert, K.C., Frey, L.A.: Human- computer interaction using eye-gaze input. IEEE Transactions on Systems, Man, and Cybernetics 19(6), 1527-1534(1989) doi: 10.1109/21.44068
  65. Isenberg, P., Dragicevic, P., Willett, W., Bezerianos, A., Fekete, J.D.: Hybrid-image visualization for large viewing environments. IEEE Transactions on Visualization and Computer Graphics 19(12), 2346-2355(Dec 2013) doi: 10.1109/TVCG.2013. 163
  66. Isenberg, P., Isenberg, T.: Visualization on interactive surfaces: A research overview. i-com 12(3), 10-17(Nov 2013) doi: 10.1524/icom.2013.0020
  67. Isenberg, T.: Interactive exploration of three-dimensional scientific visualizations on large display surfaces. In: Anslow, C., Campos, P., Jorge, J. (eds.) Collaboration Meets Interactive Spaces, chap. 6, pp. 97-123. Springer, Berlin/Heidelberg(2016) doi: 10.1007/978-3-319-45853-3_6
  68. Isenberg, T., Hancock, M.: Gestures vs. postures: 'Gestural' touch interaction in 3D environments. In: Proceedings of the CHI Workshop on "The 3 rd Dimension of CHI: Touching and Designing 3D User Interfaces" (3DCHI). pp. 53-61(2012), https://hal.inria.fr/hal-00781237
  69. Ishii, H., Ratti, C., Piper, B., Wang, Y., Biderman, A., Ben-Joseph, E.: Bring- ing clay and sand into digital design-Continuous tangible user interfaces. BT Technology Journal 22(4), 287-299(Oct 2004) doi: 10.1023/B:BTTJ.0000047607 .16164.16
  70. Ishii, H.: The tangible user interface and its evolution. Communications of the ACM 51(6), 32-36(Jun 2008) doi: 10.1145/1349026.1349034
  71. Ishii, H., Ullmer, B.: Tangible bits: Towards seamless interfaces between people, bits and atoms. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 234-241. ACM, New York(1997) doi: 10.1145/258549.258715
  72. Jackson, B., Schroeder, D., Keefe, D.F.: Nailing down multi-touch: Anchored above the surface interaction for 3D modeling and navigation. In: Proceedings of Graphics Interface (GI). pp. 181-184. Canadian Information Processing Society, Toronto(2012) doi: 10.20380/GI2012.23
  73. Jacob, R.J., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zigelbaum, J.: Reality-based interaction: A framework for post-WIMP interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Sys- tems (CHI). pp. 201-210. ACM, New York(2008) doi: 10.1145/1357054.1357089
  74. Jakobsen, M.R., Haile, Y.S., Knudsen, S., Hornbaek, K.: Information visualization and proxemics: Design opportunities and empirical findings. IEEE Transactions on Visualization and Computer Graphics 19(12), 2386-2395(Dec 2013) doi: 10. 1109/TVCG.2013.166
  75. Jang, S., Stuerzlinger, W., Ambike, S., Ramani, K.: Modeling cumulative arm fatigue in mid-air interaction based on perceived exertion and kinetics of arm motion. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 3328-3339. ACM, New York(2017) doi: 10.1145/3025453. 3025523
  76. Jankowski, J., Hachet, M.: Advances in interaction with 3D environments. Com- puter Graphics Forum 34(1), 152-190(Jan 2015) doi: 10.1111/cgf.12466
  77. Jansen, Y.: Physical and tangible information visualization. Ph.D. thesis, Univer- sité Paris Sud -Paris XI, France(Mar 2014), https://tel.archives-ouvertes.fr/tel- 00981521
  78. Jansen, Y., Dragicevic, P.: An interaction model for visualizations beyond the desktop. IEEE Transactions on Visualization and Computer Graphics 19(12), 2396-2405(Dec 2013) doi: 10.1109/TVCG.2013.134
  79. Jansen, Y., Dragicevic, P., Isenberg, P., Alexander, J., Karnik, A., Kildal, J., Subramanian, S., Hornbaek, K.: Opportunities and challenges for data physicaliza- tion. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 3227-3236. ACM, New York(2015) doi: 10.1145/2702123. 2702180
  80. Johnson, R., O'Hara, K., Sellen, A., Cousins, C., Criminisi, A.: Exploring the potential for touchless interaction in image-guided interventional radiology. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 3323-3332. ACM, New York(2011) doi: 10.1145/1978942.1979436
  81. Jota, R., Nacenta, M.A., Jorge, J.A., Carpendale, S., Greenberg, S.: A comparison of ray pointing techniques for very large displays. In: Proceedings of Graphics Inter- face (GI). pp. 269-276. Canadian Information Processing Society, Toronto(2010) doi: 10.20380/GI2010.36
  82. Karam, M., schraefel, m.c.: A taxonomy of gestures in human computer interactions. Tech. Rep. 261149, University of Southampton(2005), http: //eprints.soton.ac.uk/261149/, ISBN 0854328335
  83. Keefe, D.F.: Integrating visualization and interaction research to improve scientific workflows. IEEE Computer Graphics and Applications 30(2), 8-13(Mar/Apr 2010) doi: 10.1109/MCG.2010.30
  84. Keefe, D.F., Isenberg, T.: Reimagining the scientific visualization interaction paradigm. IEEE Computer 46(5), 51-57(May 2013) doi: 10.1109/MC.2013.178
  85. Kerren, A., Schreiber, F.: Toward the role of interaction in visual analyt- ics. In: Proceedings of the Winter Simulation Conference (WSC). pp. 420:1- 420:13. Winter Simulation Conference(2012), http://dl.acm.org/citation.cfm?id= 2429759.2430303 doi: 10.1109/WSC.2012.6465208
  86. Kim, K., Elmqvist, N.: Embodied lenses for collaborative visual queries on table- top displays. Information Visualization 11(4), 319-338(Apr 2012) doi: 10.1177/ 1473871612441874
  87. Kirmizibayrak, C., Radeva, N., Wakid, M., Philbeck, J., Sibert, J., Hahn, J.: Evaluation of gesture based interfaces for medical volume visualization tasks. In: Proceedings of the International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI). pp. 69-74. ACM, New York(2011) doi: 10. 1145/2087756.2087764
  88. Kister, U., Klamka, K., Tominski, C., Dachselt, R.: GraSp: Combining spatially- aware mobile devices and a display wall for graph visualization and interaction. Computer Graphics Forum 36(3), 503-514(Jun 2017) doi: 10.1111/cgf.13206
  89. Kister, U., Reipschläger, P., Dachselt, R.: MultiLens: Fluent interaction with multi-functional multi-touch lenses for information visualization. In: Proceedings of the ACM Conference on Interactive Surfaces and Spaces (ISS). pp. 139-148. ACM, New York(2016) doi: 10.1145/2992154.2992168
  90. Kister, U., Reipschläger, P., Matulic, F., Dachselt, R.: BodyLenses: Embodied magic lenses and personal territories for wall displays. In: Proceedings of the International Conference on Interactive Tabletops & Surfaces (ITS). pp. 117-126. ACM, New York(2015) doi: 10.1145/2817721.2817726
  91. Klamka, K., Siegel, A., Vogt, S., Göbel, F., Stellmach, S., Dachselt, R.: Look & pedal: Hands-free navigation in zoomable information spaces through gaze- supported foot input. In: Proceedings of the International Conference on Mul- timodal Interaction (ICMI). pp. 123-130. ACM, New York(2015) doi: 10.1145/ 2818346.2820751
  92. Klapperstuck, M., Czauderna, T., Goncu, C., Glowacki, J., Dwyer, T., Schreiber, F., Marriott, K.: ContextuWall: Peer collaboration using (large) displays. In: Proceedings of the International Symposium on Big Data Visual Analytics (BDVA). pp. 1-8. IEEE, Red Hook, NY, USA(2016) doi: 10.1109/BDVA.2016.7787047
  93. Klum, S., Isenberg, P., Langner, R., Fekete, J.D., Dachselt, R.: Stackables: Com- bining tangibles for faceted browsing. In: Proceedings of the International Working Conference on Advanced Visual Interfaces. pp. 241-248. AVI '12, ACM, New York, NY, USA(2012), http://doi.acm.org/10.1145/2254556.2254600 doi: 10.1145/ 2254556.2254600
  94. Konchada, V., Jackson, B., Le, T., Borazjani, I., Sotiropoulos, F., Keefe, D.F.: Supporting internal visualization of biomedical datasets via 3D rapid prototypes and sketch-based gestures. In: Proceedings of the Symposium on Interactive 3D Graphics and Games (I3D). pp. 214-214. ACM, New York(2011) doi: 10.1145/ 1944745.1944794
  95. Kruszyński, K.J., van Liere, R.: Tangible props for scientific visualization: Concept, requirements, application. Virtual Reality 13(4), 235-244(Nov 2009) doi: 10. 1007/s10055-009-0126-1
  96. Kulik, A., Kunert, A., Beck, S., Reichel, R., Blach, R., Zink, A., Froehlich, B.: C1x6: a stereoscopic six-user display for co-located collaboration in shared virtual environments. ACM Transactions on Graphics 30(6), 188:1-188:12(2011) doi: 10. 1145/2070781.2024222
  97. Kurzhals, K., Fisher, B., Burch, M., Weiskopf, D.: Evaluating visual analytics with eye tracking. In: Proceedings of the Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV). pp. 61-69. ACM, New York(2014) doi: 10.1145/2669557.2669560
  98. LaViola, J., Kruijff, E., Bowman, D., McMahan, R., Poupyrev, I.: 3D user interfaces: theory and practice. Usability Series, Pearson Education, Limited (2017)
  99. Le Goc, M.: Supporting versatility in tangible user interfaces using collections of small actuated objects. Ph.D. thesis, Université Paris-Saclay, France(Dec 2016), https://tel.archives-ouvertes.fr/tel-01453175
  100. Lee, B., Isenberg, P., Riche, N.H., Carpendale, S.: Beyond mouse and keyboard: Expanding design considerations for information visualization interactions. IEEE Transactions on Visualization and Computer Graphics 18(12), 2689-2698(Dec 2012) doi: 10.1109/TVCG.2012.204
  101. Lee, B., Kazi, R.H., Smith, G.: SketchStory: Telling more engaging stories with data through freeform sketching. IEEE Transactions on Visualization and Computer Graphics 19(12), 2416-2425(2013) doi: 10.1109/TVCG.2013.191
  102. Leithinger, D., Lakatos, D., DeVincenzi, A., Blackshaw, M., Ishii, H.: Direct and gestural interaction with relief: A 2.5D shape display. In: Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST). pp. 541-548. ACM, New York(2011) doi: 10.1145/2047196.2047268
  103. López, D., Oehlberg, L., Doger, C., Isenberg, T.: Towards an understanding of mobile touch navigation in a stereoscopic viewing environment for 3D data exploration. IEEE Transactions on Visualization and Computer Graphics 22(5), 1616-1629(May 2016) doi: 10.1109/TVCG.2015.2440233
  104. Lucas, J., Bowman, D., Chen, J., Wingrave, C.: Design and evaluation of 3D multiple object selection techniques. In: ACM Interactive 3D graphics (2005)
  105. Lundström, C., Rydell, T., Forsell, C., Persson, A., Ynnerman, A.: Multi-touch table system for medical visualization: Application to orthopedic surgery planning. IEEE Transactions on Visualization and Computer Graphics 17(12)(Dec 2011) doi: 10.1109/TVCG.2011.224
  106. Lv, Z., Halawani, A., Feng, S., Li, H., Réhman, S.U.: Multimodal hand and foot gesture interaction for handheld devices. ACM Transactions on Multimedia Computing, Communications, and Applications 11(1s), 10:1-10:19(Sep 2014) doi: 10.1145/2645860
  107. MacKenzie, I.S.: Evaluating eye tracking systems for computer input. In: Majaranta, P., Aoki, H., Donegan, M., Hansen, D.W., Hansen, J.P., Hyrskykari, A., Räihä, K.J. (eds.) Gaze Interaction and Applications of Eye Tracking: Advances in Assistive Technologies: Advances in Assistive Technologies, pp. 205-225. IGI Global, Hershey, PA, USA(2011) doi: 10.4018/978-1-61350-098-9.ch015
  108. Majaranta, P., Bulling, A.: Eye tracking and eye-based human-computer interac- tion. In: Fairclough, S.H., Gilleade, K. (eds.) Advances in Physiological Computing, pp. 39-65. Springer, London(2014) doi: 10.1007/978-1-4471-6392-3_3
  109. Malik, S., Ranjan, A., Balakrishnan, R.: Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In: Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST). pp. 43-52. ACM, New York(2005) doi: 10.1145/1095034.1095042
  110. McMahan, A.: Immersion, engagement, and presence: A method for analyzing 3-D video games. In: Wolf, M., Perron, B. (eds.) The Video Game Theory Reader, chap. 3, pp. 67-86. Routledge(2003), http://www.alisonmcmahan.com/node/277
  111. McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press(1992), http: //press.uchicago.edu/ucp/books/book/chicago/H/bo3641188.html
  112. Mohr, P., Kerbl, B., Donoser, M., Schmalstieg, D., Kalkofen, D.: Retargeting technical documentation to augmented reality. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 3337-3346. ACM, New York(2015) doi: 10.1145/2702123.2702490
  113. Myers, B.A.: A brief history of human-computer interaction technology. ACM Interactions 5(2), 44-54(Mar/Apr 1998) doi: 10.1145/274430.274436
  114. Ni, T., Bowman, D.A., Chen, J.: Increased display size and resolution improve task performance in information-rich virtual environments. In: Proceedings of Graphics Interface. pp. 139-146 (2006)
  115. Nilsson, S., Gustafsson, T., Carleberg, P.: Hands free interaction with virtual information in a real environment: Eye gaze as an interaction tool in an augmented reality system. PsychNology Journal 7(2), 175-196 (2009)
  116. Norman, D.A.: THE WAY I SEE IT: Signifiers, not affordances. ACM Interactions 15(6), 18-19(Nov/Dec 2008) doi: 10.1145/1409040.1409044
  117. Norman, D.A.: Natural user interfaces are not natural. interactions 17(3), 6- 10(May/Jun 2010) doi: 10.1145/1744161.1744163
  118. Norman, D.A.: The design of everyday things: Revised and expanded edition. Basic books, New York(2013), https://www.jnd.org/books/design-of-everyday- things-revised.html
  119. Piper, B., Ratti, C., Ishii, H.: Illuminating clay: A 3-D tangible interface for landscape analysis. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 355-362. ACM, New York(2002) doi: 10. 1145/503376.503439
  120. Pirolli, P., Card, S.: Information foraging. Psychological review 106(4), 643- 675(Oct 1999) doi: 10.1037/0033-295X.106.4.643
  121. Preim, B., Dachselt, R.: Interaktive Systeme -Band 2: User Interface Engineering, 3D-Interaktion, Natural User Interfaces, vol. 2. Springer/Vieweg, Berlin/Heidel- berg(2015) doi: 10.1007/978-3-642-45247-5
  122. Pretorius, A.J., Purchase, H.C., Stasko, J.T.: Tasks for multivariate network analysis. In: Kerren, A., Purchase, H.C., Ward, M.O. (eds.) Multivariate Network Visualization: Dagstuhl Seminar #13201, Dagstuhl Castle, Germany, May 12-17, 2013, Revised Discussions, pp. 77-95. Springer International Publishing, Cham, Switzerland(2014) doi: 10.1007/978-3-319-06793-3_5
  123. Rädle, R., Jetter, H.C., Butscher, S., Reiterer, H.: The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces. In: Proceedings of the International Conference on Interactive Tabletops and Surfaces (ITS). pp. 23-32. ACM, New York(2013) doi: 10.1145/2512349. 2512811
  124. Ragan, E.D., Endert, A., Sanyal, J., Chen, J.: Characterizing provenance in visualization and data analysis: An organizational framework of provenance types and purposes. IEEE Transactions on Visualization and Computer Graphics 22(1), 31-40(Jan 2016), https://doi.org/10.1109/TVCG.2015.2467551 doi: 10.1109/TVCG .2015.2467551
  125. Rashid, U., Nacenta, M.A., Quigley, A.: The cost of display switching: A comparison of mobile, large display and hybrid UI configurations. In: Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI). pp. 99- 106. ACM, New York(2012) doi: 10.1145/2254556.2254577
  126. Rekimoto, J., Green, M.: The information cube: Using transparency in 3D information visualization. In: Proceedings of the Annual Workshop on Information Technologies & Systems (WITS). pp. 125-132(1993), https: //www.sonycsl.co.jp/person/rekimoto/cube/
  127. Renambot, L., Marrinan, T., Aurisano, J., Nishimoto, A., Mateevitsi, V., Bharad- waj, K., Long, L., Johnson, A., Brown, M., Leigh, J.: SAGE2: a collaboration portal for scalable resolution displays. Future Generation Computer Systems 54, 296-305(2016) doi: 10.1016/j.future.2015.05.014
  128. Roberts, J.C., Ritsos, P.D., Badam, S.K., Brodbeck, D., Kennedy, J., Elmqvist, N.: Visualization beyond the desktop-The next big thing. IEEE Computer Graphics and Applications 34(6), 26-34(Nov/Dec 2014) doi: 10.1109/MCG.2014.82
  129. Robles-De-La-Torre, G.: The importance of the sense of touch in virtual and real environments. IEEE MultiMedia 13(3), 24-30(Jul 2006) doi: 10.1109/MMUL. 2006.69
  130. Roth, V., Schmidt, P., Güldenring, B.: The IR ring: Authenticating users' touches on a multi-touch display. In: Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST). pp. 259-262. ACM, New York(2010) doi: 10.1145/1866029.1866071
  131. Samsung introduces 2007 LCD, plasma, DLP and CRT lineup(2007 (accessed 11th April 2017)), https://www.engadget.com/2007/01/07/samsung-introduces- 2007-lcd-plasma-dlp-and-crt-lineup/
  132. Scheurich, D., Stuerzlinger, W.: A one-handed multi-touch method for 3D rotations. In: Human-Computer Interaction -INTERACT 2013. pp. 56-69. Springer(2013) doi: 10.1007/978-3-642-40483-2
  133. Shaer, O., Hornecker, E.: Tangible user interfaces: past, present, and future directions. Foundations and Trends ® in Human-Computer Interaction 3(1-2), 4-137(2010) doi: 10.1561/1100000026
  134. Shneiderman, B.: The eyes have it: A task by data type taxonomy for information visualizations. In: Proceedings of the IEEE Symposium on Visual Languages (VL). pp. 336-343. IEEE Computer Society, Los Alamitos(1996) doi: 10.1109/VL.1996. 545307
  135. Slater, M., Wilbur, S.: A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoper- ators and virtual environments 6(6), 603-616(1997) doi: 10.1162/pres.1997.6.6. 603
  136. Facebook shows how it's gonna make virtual reality social, https: //www.cnet.com/au/news/facebook-mark-zuckerberg-shows-off-live-vr-virtual- reality-chat-with-oculus-rift/
  137. Spindler, M., Tominski, C., Schumann, H., Dachselt, R.: Tangible views for infor- mation visualization. In: Proceedings of the International Conference on Interactive Tabletops and Surfaces (ITS). pp. 157-166. ACM, New York(2010) doi: 10.1145/ 1936652.1936684
  138. Stasko, J., Görg, C., Liu, Z.: Jigsaw: Supporting investigative analysis through interactive visualization. Information Visualization 7(2), 118-132(Apr 2008) doi: 10.1145/1466620.1466622
  139. Stellmach, S., Dachselt, R.: Look & touch: Gaze-supported target acquisition. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). pp. 2981-2990. ACM, New York(2012) doi: 10.1145/2207676.2208709
  140. Stellmach, S., Stober, S., Nürnberger, A., Dachselt, R.: Designing gaze-supported multimodal interactions for the exploration of large image collections. In: Pro- ceedings of the Conference on Novel Gaze-Controlled Applications (NGCA). pp. 1:1-1:8. ACM, New York(2011) doi: 10.1145/1983302.1983303
  141. Stuerzlinger, W., Wingrave, C.: The value of constraints for 3D user interfaces. In: Virtual Realities: Dagstuhl Seminar 2008. pp. 203-224. Springer(2011) doi: 10. 1007/978-3-211-99178-7
  142. Sun, J., Stuerzlinger, W., Shuralyov, D.: Shift-sliding and depth-pop for 3D positioning. In: Proceedings of the 2016 Symposium on Spatial User Interaction. pp. 69-78. ACM (2016)
  143. Sutherland, I.E.: Sketchpad: A man-machine graphical communication system. In: Proceedings of the Spring Joint Computer Conference (AFIPS, Spring). pp. 329-346. ACM, New York(1963) doi: 10.1145/1461551.1461591
  144. Sutherland, I.E.: The ultimate display. In: Proceedings of the IFIP Congress. pp. 506-508 (1965)
  145. Sutherland, I.E.: A head-mounted three dimensional display. In: Proceedings of the Fall Joint Computer Conference (AFIPS, Fall, part I). pp. 757-764. ACM, New York(1968) doi: 10.1145/1476589.1476686
  146. Teather, R.J., Stuerzlinger, W.: Pointing at 3D targets in a stereo head-tracked virtual environment. In: Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI). pp. 87-94. IEEE Computer Society, Los Alamitos(2011) doi: 10.1109/3DUI .2011.5759222
  147. Cluster rendering, Unity user manual, https: //docs.unity3d.com/Manual/ClusterRendering.html
  148. Vertegaal, R.: Attentive user interfaces. Communications of the ACM 46(3), 30-33(Mar 2003) doi: 10.1145/636772.636794
  149. Wai, J., Lubinski, D., Benbow, C.P.: Spatial ability for STEM domains: aligning over 50 years of cumulative psychological knowledge solidifies its importance. Journal of Educational Psychology 101(4), 817(2009) doi: 10.1037/a0016127
  150. Walny, J., Carpendale, S., Henry Riche, N., Venolia, G., Fawcett, P.: Visual thinking in action: Visualizations as used on whiteboards. IEEE Transactions on Visualization and Computer Graphics 17(12), 2508-2517(Dec 2011) doi: 10. 1109/TVCG.2011.251
  151. Walter, R., Bailly, G., Valkanova, N., Müller, J.: Cuenesics: Using mid-air gestures to select items on interactive public displays. In: Proceedings of the International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI). pp. 299-308. ACM, New York(2014) doi: 10.1145/2628363.2628368
  152. Wigdor, D., Wixon, D.: Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier/Morgan Kaufmann, Amsterdam(2011) doi: 10.1016/ B978-0-12-382231-4.00037-X
  153. Wither, J., DiVerdi, S., Höllerer, T.: Annotation in outdoor augmented reality. Computers & Graphics 33(6), 679-689(Dec 2009) doi: 10.1016/j.cag.2009.06. 001
  154. Yi, J.S., Kang, Y.a., Stasko, J., Jacko, J.: Toward a deeper understanding of the role of interaction in information visualization. IEEE Transactions on Visualization and Computer Graphics 13(6), 1224-1231(Nov/Dec 2007) doi: 10.1109/TVCG. 2007.70515
  155. Ynnerman, A., Rydell, T., Antoine, D., Hughes, D., Persson, A., Ljung, P.: Inter- active visualization of 3D scanned mummies at public venues. Communications of the ACM 59(12), 72-81(Dec 2016) doi: 10.1145/2950040
  156. Yu, L., Efstathiou, K., Isenberg, P., Isenberg, T.: Efficient structure-aware selection techniques for 3D point cloud visualizations with 2DOF input. IEEE Transactions on Visualization and Computer Graphics 18(12), 2245-2254(Dec 2012) doi: 10. 1109/TVCG.2012.217
  157. Yu, L., Svetachov, P., Isenberg, P., Everts, M.H., Isenberg, T.: FI3D: Direct- touch interaction for the exploration of 3D scientific visualization spaces. IEEE Transactions on Visualization and Computer Graphics 16(6), 1613-1622(Nov/Dec 2010) doi: 10.1109/TVCG.2010.157
  158. von Zadow, U., Reipschläger, P., Bösel, D., Sellent, A., Dachselt, R.: YouTouch! Low-cost user identification at an interactive display wall. In: Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI). pp. 144-151. ACM, New York(2016) doi: 10.1145/2909132.2909258
  159. Zaroff, C.M., Knutelska, M., Frumkes, T.E.: Variation in stereoacuity: Normative description, fixation disparity, and the roles of aging and gender. Investigative Ophthalmology & Visual Science 44(2), 891(Feb 2003) doi: 10.1167/iovs.02-0361

Related papers

Grand Challenges in Immersive Analytics
Tica Lin

Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Immersive Analytics is a quickly evolving field that unites several areas such as visualisation, immersive environments, and humancomputer interaction to support human data analysis with emerging technologies. This research has thrived over the past years with multiple workshops, seminars, and a growing body of publications, spanning several conferences. Given the rapid advancement of interaction technologies and novel application domains, this paper aims toward a broader research agenda to enable widespread adoption. We present 17 key research challenges developed over multiple sessions by a diverse group of 24 international experts, initiated from a virtual scientific workshop at ACM CHI 2020. These challenges aim to coordinate future work by providing a systematic roadmap of current directions and impending hurdles to facilitate productive and effective applications for Immersive Analytics.

View PDFchevron_right
Exploration and Assessment of Interaction in an Immersive Analytics Module: A Software-Based Comparison
Parker Jones

Applied Sciences

The focus of computer systems in the field of visual analytics is to make the results clear and understandable. However, enhancing human-computer interaction (HCI) in the field is less investigated. Data visualization and visual analytics (VA) are usually performed using traditional desktop settings and mouse interaction. These methods are based on the window, icon, menu, and pointer (WIMP) interface, which often results in information clutter and is difficult to analyze and understand, especially by novice users. Researchers believe that introducing adequate, natural interaction techniques to the field is necessary for building effective and enjoyable visual analytics systems. This work introduces a novel virtual reality (VR) module to perform basic visual analytics tasks and aims to explore new interaction techniques in the field. A pilot study was conducted to measure the time it takes students to perform basic tasks for analytics using the developed VR module and compares it to ...

View PDFchevron_right
Multisensory Immersive Analytics
Kim Marriott

Immersive Analytics, 2018

While visual cues are traditionally used for visual analytics, multimodal interaction technologies offer many new possibilities. This chapter explores the opportunities and challenges for developers and users to utilize and represent data through non-visual sensory channels to help them understand and interact with data. Users are able to experience data in new ways: variables from complex datasets can be conveyed through different senses; presentations are more accessible to people with vision impairment and can be personalized to specific user needs; interactions can involve multiple senses to provide natural and transparent methods. All these techniques enable users to obtain a better understanding of the underlying information. While the emphasis of this chapter is towards non-visual immersive analytics, we include a discussion on how visual presentations are integrated with different modalities, and the opportunities of mixing several sensory signals, including the visual domain.

View PDFchevron_right
Leveraging Body Interactions to Support Immersive Analytics
herry herry

2019

New immersive devices (e.g., virtual or augmented reality) enable displaying large amounts of data in space to better support data analysis. Manipulating this data efficiently is crucial, but challenging because the user must be able to activate various commands or adjust various values while remaining free to move. Using the whole body offers several valuable advantages: 1) The body provides a physical support as an interactive surface, which improves accuracy and makes it less tiring to interact; 2) Using the body does not impair mobility and avoids handling devices; 3) Proprioception makes it possible to interact eyes-free, including for choosing values in a range; 4) By leveraging spatial memory, the body helps memorizing commands, thus interacting in expert mode (i.e., perform quick actions without visual feedback). In this position paper, we analyze various ways of interacting with the body and discuss their advantages and challenges for immersive analytics.

View PDFchevron_right
Immersive Analytics: An Introduction
Kim Marriott

Immersive Analytics, 2018

Immersive Analytics is a new research initiative that aims to remove barriers between people, their data and the tools they use for analysis and decision making. Here we clarify the aims of immersive analytics research, its opportunities and historical context, as well as providing a broad research agenda for the field. In addition, we review how the term immersion has been used to refer to both technological and psychological immersion, both of which are central to immersive analytics research.

View PDFchevron_right

Related topics

  • Computer Science
  • Human Computer Interaction
  • Visualization
  • Natural User Interfaces
  • Embodied Interaction

    • Cited by

    The State of the Art of Spatial Interfaces for 3D Visualization
    Anders Ynnerman

    Computer Graphics Forum, 2021

    We survey the state of the art of spatial interfaces for 3D visualization. Interaction techniques are crucial to data visualization processes and the visualization research community has been calling for more research on interaction for years. Yet, research papers focusing on interaction techniques, in particular for 3D visualization purposes, are not always published in visualization venues, sometimes making it challenging to synthesize the latest interaction and visualization results. We therefore introduce a taxonomy of interaction technique for 3D visualization. The taxonomy is organized along two axes: the primary source of input on the one hand and the visualization task they support on the other hand. Surveying the state of the art allows us to highlight specific challenges and missed opportunities for research in 3D visualization. In particular, we call for additional research in: (1) controlling 3D visualization widgets to help scientists better understand their data, (2) 3D interaction techniques for dissemination, which are under-explored yet show great promise for helping museum and science centers in their mission to share recent knowledge, and (3) developing new measures that move beyond traditional time and errors metrics for evaluating visualizations that include spatial interaction.

    View PDFchevron_right
    580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved