Academia.eduAcademia.edu

Outline

Title
Abstract
Figures
Chapter 1 Introduction
Thesis Objectives
Chapter 2 Previous & Related Work
Chapter 4 Preliminary Study
Hypotheses Hypothesis 1: 3D Positioning Technique
Hypothesis 2: Stereoscopic Graphics
Hypothesis 3: Head-Coupled Perspective
Demographic Analysis
Discussion
Orientation and Support Study
Hypotheses Hypothesis 1: Supporting Surface
Hypothesis 2: Display/Device Orientation
Participants
Discussion of Device and Display Orientation
Mouse and 3D Tracker Study
Procedure
Design
Results
Overall Discussion
Chapter 6 Conclusion
Future Work
References

COMPARING 2D AND 3D DIRECT MANIPULATION INTERFACES

Profile image of Robert TeatherRobert Teather

Abstract
sparkles

AI

This paper explores the efficiency and performance of 2D versus 3D direct manipulation interfaces in virtual environments. It highlights the significant challenges novice users face when using higher-dimensional input devices compared to traditional 2D graphical interfaces. Experimental results indicate that 2D techniques outperformed 3D techniques in terms of completion time and accuracy, suggesting that improvements in interaction interfaces are necessary for broader usability in virtual reality.

Figures (25)
Figure 3-1 : Mouse motion to 3D movement mapping in SESAME.
Figure 3-1 : Mouse motion to 3D movement mapping in SESAME.
Figure 3-3 : “Wand3D” movement - full 3DOF motion with the wand. technique as well, to provide a useful constraint.
Figure 3-3 : “Wand3D” movement - full 3DOF motion with the wand. technique as well, to provide a useful constraint.
Figure 4-1 : The cubes task, starting and target scenes.
Figure 4-1 : The cubes task, starting and target scenes.
Figure 4-2 : The chair task, starting and target scenes.
Figure 4-2 : The chair task, starting and target scenes.
Figure 4-3 : Experimental equipment setup for preliminary study.
Figure 4-3 : Experimental equipment setup for preliminary study.
times was not found for per-object completion times (F2,22=0.94, ns).
times was not found for per-object completion times (F2,22=0.94, ns).
for mono.
for mono.
Figure 4-7: Box plot for chair task completion times by gamer experience. Higher values are worse.
Figure 4-7: Box plot for chair task completion times by gamer experience. Higher values are worse.
displays, since this could affect stereo viewing. were used for stereo viewing. Room lights were dimmed to equalize glare across both
displays, since this could affect stereo viewing. were used for stereo viewing. Room lights were dimmed to equalize glare across both
Figure 5-2 : Hand tracker and mouse for support study. nylon glove worn in all conditions. Figure 5-2 depicts the position of tracker and mouse
Figure 5-2 : Hand tracker and mouse for support study. nylon glove worn in all conditions. Figure 5-2 depicts the position of tracker and mouse
Figure 5-4 : The eight experimental conditions. The left four represent the unsupported conditions, and the right four represent the supported conditions. The top four represent the vertical display, and the bottom four represent the horizontal display. respectively. Figure 5-4 depicts all 8 combinations of the independent variables.
Figure 5-4 : The eight experimental conditions. The left four represent the unsupported conditions, and the right four represent the supported conditions. The top four represent the vertical display, and the bottom four represent the horizontal display. respectively. Figure 5-4 depicts all 8 combinations of the independent variables.
Figure 5-5 : Mean task completion times by condition, with standard deviations. However, if the first trial from each condition is excluded, this difference was not
Figure 5-5 : Mean task completion times by condition, with standard deviations. However, if the first trial from each condition is excluded, this difference was not
condition, and 3.57 for the “HV” configuration.
condition, and 3.57 for the “HV” configuration.
non-gamers. Figure 5-7 summarizes these results, and is also broken down by the type of
non-gamers. Figure 5-7 summarizes these results, and is also broken down by the type of
A significant difference was found in accuracy between the five conditions
A significant difference was found in accuracy between the five conditions
emulation” technique. There was no significant difference in preference between the significantly higher than all other techniques, with the exception of the “mous
emulation” technique. There was no significant difference in preference between the significantly higher than all other techniques, with the exception of the “mous
Figure 5-11 : Mean task completion times and standard deviations by gamer and usage of 2D art software demographics
Figure 5-11 : Mean task completion times and standard deviations by gamer and usage of 2D art software demographics
groups based on use of 2D artistic software.
groups based on use of 2D artistic software.

Related papers

Interaction techniques in desktop virtual environment: the study of visual feedback and precise manipulation method
Meng Chun Lam

Multimedia Tools and Applications

Gesture-based systems allow users to interact with a virtual reality application in a natural way. Visual feedback for the gesture-based interaction technique has an impact on the performance and the hand instability making the manipulation of the object less precise. This paper investigated two new interaction techniques in a virtual environment. It describes the influence of natural and non-natural virtual feedback in the selection process using the GITDVR-G interaction technique, which consists of a grasping visual feedback. The GITDVR-G was evaluated in a virtual knee surgery training system. The results showed that it was effective in terms of the task completion time, and that the participants preferred the natural grasping visual feedback. Besides that, the precise manipulation in a newly-designed interaction technique (Precise GITDVR-G) was evaluated. The Precise GITDVR-G includes a normal manipulation mode and a precise manipulation mode that can be triggered by hand gestures. During the precise manipulation mode, an inset view will appear and move with the selected object to provide a better view to users, while the movements of the virtual hand are scaled down to improve the precision. Four different configurations of the precise manipulation technique were evaluated, and the results showed that the unimanual control method with an inset view performed better in terms of the task performance time and the subjective feedback. The finding suggested that the realistic virtual grasping visual feedback can be applied in a virtual hand interaction technique, and that the inset view feature is helpful in the precise manipulation.

View PDFchevron_right
Short paper: 3-hand manipulation of virtual objects
Thierry Duval

2009

In this paper we introduce a new 3D interaction technique called "3-Hand Manipulation", for multiuser collaborative manipulation of 3D objects. The 3-Hand Manipulation relies on the use of three manipulation points that can be used simultaneously by three different "hands" of two or three users. Interestingly, the three translation motions of the manipulation points can fully determine the resulting 6 degrees of freedom motion of the manipulated object. We describe the implementation of the 3-Hand Manipulation, its graphical representations and an illustration of its use by two or three users on an insertion task in immersive virtual environment. This technique could be used in various applications of collaborative VR such as for virtual prototyping, training simulations, assembly and maintenance simulations.

View PDFchevron_right
Unconventional 3D User Interfaces for Virtual Environments
Ernst Kruijff

In this dissertation, the potential of the human body will be investigated, with the aim to design, develop, and analyze new spatial interaction methods which surpass performance or application possibilities of currently available techniques. In contrast to desktop interfaces, spatial interaction methods potentially make use of all six degrees of freedom and are generally referred to as 3D user interfaces (3DUIs). These interfaces find wide applicability in a multitude of different kinds of Virtual Environments, ranging from those techniques that allow for free movement through a room with large, possibly stereoscopic displays, up to the usage of helmet-like or full-encompassing ("immersive") display systems. Due to the experimental characteristics, most of the presented techniques can be labeled as being unconventional, even though many of the techniques can find great applicability in the more traditional work environments. Hence, through investigation of human potential, the design space of 3DUIs can be broadened. More specifically, the basics of 3D User Interfaces and related terminology will be explored (chapter 1), after which an extensive and detailed look will be taken at the possibilities of the different human "input and output channels," relating the psychophysiological possibilities to technology that is currently existent, or will be developed in the foreseeable future. A reflection on possible applications is included (chapter 2). In chapter 3, issues that are specific to designing and developing unconventional 3DUIs are investigated, ranging from the boundaries of human performance, specific humancomputer interface matters, to social and technical issues. Following (chapter 4), a total of seven case studies illuminate multiple sides of designing, developing, and analyzing unconventional techniques, looking at both pure spatial and unconventional setups, and so called hybrid interface techniques. More specifically, Shockwaves and BioHaptics explore the usage of alternative haptic feedback, either through usage of audio and airbased shockwaves, or neuromuscular stimulation. Also dealing with haptics, Tactylus explores multisensory binding factors of a device using coupled visual, auditory, and vibrotactile feedback. The fourth study, Cubic Mouse, explores a prop output (control) device, resembling a coordinate system, in order to find specific performance advantages or flaws in comparison to generally used spatial controllers. It, thereby, makes use of a new spatial trajectory analysis method. The final three studies all focus on hybrid interfaces, integrating 2D and 3D I/O methods. ProViT deals with integrating a PenPC with a spatial pen device, and the Cubic Mouse to control engineering applications, focusing, foremost, on flow of action factors. Capsa Arcana are two consoles used in museum applications that integrate MIDI controllers and desktop devices to allow for more interesting and potentially unconventional control. Finally, with Eye of Ra, a new input device form is presented. The Eye of Ra has been specifically designed for closely combining the control of 2D and spatial actions for use in medical scenarios. The final chapter concludes this dissertation by providing a short summary and reflection, including a road map of open issues and fields of further research.

View PDFchevron_right
Tangible Interfaces in Virtual Environments
Johann Habakuk Israel

Proc. Informatik, 2006

Integrating Tangible User Interfaces(TUIs) in Virtual Environments is a promising approach to overcome the rigidity of Tangible User Interfaces (TUI) and to ease Virtual Reality (VR) interaction techniques. Advantages and problems of the integration are being described,e specially occlusion, focal displacement and shifting.

View PDFchevron_right
Cubic-Mouse-based interaction in virtual environments
Martin Göbel, Jürgen Wind

IEEE Computer Graphics and Applications, 2000

View PDFchevron_right
Demonstration: 3-hand manipulation of virtual objects
Thierry Duval

2009

This demonstration introduces a new 3D interaction technique called "3-Hand Manipulation", for multiuser collaborative manipulation of 3D objects. This technique relies on the use of three manipulation points that can be used simultaneously by three different "hands" of two or three users. The three translation motions of the manipulation points fully determine the resulting 6 DOF motion of an object. We describe the graphical representations of the 3-Hand Manipulation and an illustration of its use by two or three users on an insertion task.

View PDFchevron_right
The effect of 3D widget representation and simulated surface constraints on interaction in virtual environments
James Templeman

Proceedings IEEE Virtual Reality 2001

This paper reports empirical results from two studies of effective user interaction in immersive virtual environments. The use of 2D interaction techniques in 3D environments has received increased attention recently. We introduce two new concepts to the previous techniques: the use of 3D widget representations; and the imposition of simulated surface constraints. The studies were identical in terms of treatments, but differed in the tasks performed by subjects. In both studies, we compared the use of two-dimensional (2D) versus threedimensional (3D) interface widget representations, as well as the effect of imposing simulated surface constraints on precise manipulation tasks. The first study entailed a drag-and-drop task, while the second study looked at a slider-bar task. We empirically show that using 3D widget representations can have mixed results on user performance. Furthermore, we show that simulated surface constraints can improve user performance on typical interaction tasks in the absence of a physical manipulation surface. Finally, based on these results, we make some recommendations to aid interface designers in constructing effective interfaces for virtual environments.

View PDFchevron_right
Hand-held windows: towards effective 2D interaction in immersive virtual environments
James Hahn

Proceedings IEEE Virtual Reality (Cat. No. 99CB36316), 1999

The study of human-computer interaction within immersive virtual environments requires us to balance what we have learned from the design and use of desktop interfaces with novel approaches to allow us to work effectively in three dimensions. While some researchers have called for revolutionary interfaces for these new environments, devoid of two-dimensional (2D) desktop widgets, others have taken a more evolutionary approach. Windowing within immersive virtual environments is an attempt to apply 2D interface techniques to three-dimensional (3D) worlds. 2D techniques are attractive because of their proven acceptance and widespread use on the desktop. With current methods of performing 2D interaction in immersive virtual environments, however, it is difficult for users of 3D worlds to perform precise manipulations, such as dragging sliders, or precisely positioning or orienting objects.

View PDFchevron_right
A practical vision based approach to unencumbered direct spatial manipulation in virtual worlds
Andrea Giachetti

2007

We present a practical approach for developing interactive environments that allows humans to interact with large complex 3D models without them having to manually operate input devices. The system provides support for scene manipulation based on hand tracking and gesture recognition and for direct 3D interaction with the 3D models in the display space if a suitably registered 3D display is used. Being based on markerless tracking of a user's two hands, the system does not require users to wear any input or output devices. 6DOF input is provided by using both hands simultaneously, making the tracker more robust since only tracking of position information is required. The effectiveness of the method is demonstrated with a simple application for model manipulation on a large stereo display, in which rendering constraints are met by employing state-of-the-art multiresolution techniques.

View PDFchevron_right
Mixed-dimension interaction in virtual environments
Rudy Darken

Proceedings of the ACM symposium on Virtual reality software and technology - VRST '05, 2005

In this paper, we present a study to show that matching the dimensionality of interaction techniques with the dimensional demands of the task results in an interface that facilitates superior performance on interaction tasks without sacrificing performance on 2D tasks in favor of 3D tasks and vice versa. We describe the concept of dimensional congruence and how to identify the dimensional characteristics of a task so that appropriate interaction techniques can be applied. We constructed a prototypical application in a Virtual Environment Enclosure (VEE) using a hand-held device to show how this might be done in this type of apparatus. We then describe a study that evaluates both 2D and 3D tasks as performed using typical 2D and 3D interaction techniques. Results show that an appropriate mix of 2D and 3D interaction techniques is preferred over exclusive use of one or the other. The challenge lies not in selecting independent interaction techniques for specific tasks, but rather in constructing an overall interface that mixes 2D and 3D interactions appropriately.

View PDFchevron_right

References (50)

  1. Balakrishnan, R., and MacKenzie, I. S. (1997). Performance Differences in the Fingers, Wrist, and Forearm in Computer Input Control. Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '99. 303-310.
  2. Bier, E. (1987). Skitters and Jacks: Interactive 3D Positioning Tools. Proceedings of Interactive 3D Graphics, I3D '86. 183-196.
  3. Boritz, J. and Booth, K. (1997). A Study of Interactive 3D Point Location in a Computer Simulated Virtual Environment. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST '97. 181-187.
  4. Boritz, J. and Booth, K. (1998). A Study of Interactive 6 DOF Docking in a Computerised Virtual Environment. Proceedings of the Virtual Reality Annual International Symposium. 139-146.
  5. Bowman, and D. Hodges, L. (1997). An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. Proceedings of ACM Symposium on Interactive 3D Graphics '97. 35-38.
  6. Bowman, D., Johnson, D., and Hodges, L. (1999). Testbed Evaluation of Virtual Environment Interaction Techniques. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST '99, ACM Press. 26-33.
  7. Chen, J., Narayan, M.A. and Perez-Quinones, M.A. (2005). The Use of Hand-held Devices for Search Tasks in Virtual Environments. Proceedings of the IEEE Virtual Reality 2005 workshop on New Directions in 3DUI. 15-18.
  8. Conner, D.B., Snibbe, S., Hemdon, K., Robbins, D., Zeleznik, R. and van Dam, A. (1992). Three Dimensional Widgets. Proceedings of Symposium on Interactive 3D Graphics, I3D '92. 183 -188.
  9. Cruz-Neira, C., Sandin, D., DeFanti, T., Kenyon, R., and Hart, J. (1992). The CAVE: Audio Visual Experience Automatic Virtual Environment. Communications of the ACM, 35, 6. 64-72.
  10. FakeSpace Systems. (2007). Pinch Gloves®. Available: http://www.fakespacesystems.com/pinch.htm. Accessed December 7, 2007.
  11. Hsu, J., Pizlo, Z., Chelberg, D., Babbs, C. and Delp, E. (1996) Issues in the Design of Studies to Test the Effectiveness of Stereo Imaging. IEEE Transactions on Systems, Man and Cybernetics, Part A, 26, 6. 810-819.
  12. Immersion Corporation. (2007). CyberGlove®. Avalable: http://www.immersion.com /3d/products/cyber_glove.php. Accessed December 7, 2007.
  13. Intersense Inc. (2007). IS-900 Motion Tracking System Technical Overview. Available: http://www.isense.com/uploadedFiles/Products/White_Papers/IS900_Tech_Over view_Enhanced.pdf. Accessed December 7, 2007.
  14. Jay, C., and Hubbold, R. (2003). Amplifying Head Movements with Head-Mounted Displays. In Presence: Teleoperators and Virtual Environments, 12, 3. 268 -276.
  15. Kitamura, Y., Yee, A. and Kishino, F. (1998). A Sophisticated Manipulation Aid in a Virtual Environment Using Dynamic Constraints Among Object Faces. In PRESENCE, 7 (5). 460-477.
  16. Kohli, L. and Whitton, M. (2005). The Haptic Hand: Providing User Interface Feedback with the Non-Dominant Hand in Virtual Environments. Proceedings of Graphics Interface. 1-8.
  17. Konami of America. (2007). Elebits. Available: http://www.konami- data.com/officialsites/elebits. Accessed December 7, 2007.
  18. Lindeman, R.W., Sibert, J.L., Hahn, J.K. (1999a). Towards Usable VR: an empirical study of user interfaces for immersive virtual environments. Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '99. 64-71.
  19. Lindeman, R.W., Sibert, J.L., Hahn, J.K. (1999b). Hand-Held Windows: Towards Effective 2D Interaction in Immersive Virtual Environments. Proceedings of IEEE Virtual Reality, VR'99. 205-212.
  20. Lionhead Studios. (2006). Black and White 2. Available: http://www.lionhead.com/bw2/.
  21. Accessed December 7, 2007.
  22. Logitech. (2007). Logitech MX518 Gaming-Grade Optical Mouse. Available: http://www.logitech.com/index.cfm/mice_pointers/mice/devices/187&cl=ca,en. Accessed December 7, 2007.
  23. MacKenzie, I.S. and Riddersma, S. (1994). Effects of output display and control-display gain on human performance in interactive systems. Behaviour & Information Technology, 13, 328-337.
  24. Mine, M., Brooks, F. and Sequin, C. (1997). Moving Objects in Space: Exploiting Proprioception in Virtual-Environment Interaction. Proceedings of the 24 th annual conference on computer graphics and interactive techniques. 19-26.
  25. Mulder, J. and van Liere, R. (2000). Enhancing Fish Tank VR. Proceedings of IEEE Virtual Reality, VR2000. 91-98.
  26. Nintendo of America. (2007). Nintendo Wii. Available : http://wii.nintendo.com/.
  27. Accessed December 7, 2007.
  28. Oh, J.-Y. (2005). Desktop 3D Conceptual Design Systems. Doctoral dissertation, York University.
  29. Oh, J.-Y. and Stuerzlinger, W. (2004). A System for Desktop 3D Conceptual Design. In Virtual Reality, 7. 198-211.
  30. Oh, J.-Y. and Stuerzlinger, W. (2005). Moving Objects with 2D Input Devices in CAD Systems and Desktop Virtual Environments. In proceedings of Graphics Interface. 195-202.
  31. Pagano, R. (2007). Understanding Statistics in the Behavioural Sciences, 8 th Edition. Thomsom Wadsworth, Belmont, California, USA. Chapter 17.
  32. Polhemus (2007). Polhemus corporate website. Available : www.polhemus.com. Accessed December 7, 2007.
  33. Poupyrev, I., Billinghurst, M., Weghosrt, S., and Ichikawa, T. (1996). The Go-Go Interaction Technique: Non-linear Mapping for Direct Manipulation in VR. Proceedings of the ACM Symposium on User Interface Software and Technology, UIST '96. 79-80.
  34. Poupyrev, I., Weghorst, S., Billinghurst M. and T. Ichikawa. (1998a). Egocentric object manipulation in virtual environments: empirical evaluation of interaction techniques. Proceedings of Eurographics, 41-52.
  35. Poupyrev, I., Tomokazu, N. and Weghorst, S. (1998b) Virtual Notepad: handwriting in immersive VR. Proceedings of IEEE VR'98. 126-132.
  36. Smith, G., Salzman T. and Stuerzlinger, W. (2001). 3D Scene Manipulation with 2D Devices and Constraints. Proceedings of Graphics Interface. 135-142.
  37. Strauss, P. and Carey, R. (2002). An Object-Oriented 3D Graphics Toolkit. Proceedings of SIGGRAPH. 341-349.
  38. Sutherland, I. (1965). The Ultimate Display. Proceedings of International Federation of Information Processing IFIP '65, 2, 506-508.
  39. Szalavári, Z. and Gervautz, M. (1997). The Personal Interaction Panel, A Two-Handed Interface for Augmented Reality. Proceedings of Eurographics '97. 335-346.
  40. R. Teather. Constraining VR: An Evaluation of Constraints in 3D Scene Assembly, Course Project, York University, Dept. of Computer Science and Engineering. May 2006. Available: http://www.cse.yorku.ca/~rteather/constraints.pdf.
  41. Accessed March 19, 2008.
  42. Teather, R. and Stuerzlinger, W. (2007). Guidelines for 3D Positioning Techniques. Proceedings of ACM FuturePlay 2007, 61-68.
  43. Wang, Y. and MacKenzie, C. L. (2000). The Role of Contextual Haptic and Visual Constraints on Object Manipulation in Virtual Environments. Proceedings of the SIGCHI conference on Human factors in computing systems. 532-539.
  44. Ware, C., Arthur, K. and Booth, K. (1993). Fish Tank Virtual Reality. Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '93. 37-42.
  45. Ware, C. and Jessome, D. R. (1988). Using the Bat: A Six-Dimensional Mouse for Object Placement. Proceedings of Graphics Interface '88. 119-124.
  46. Ware, C. and Lowther, K. 1997. Selection Using a One-Eyed Cursor in a Fish Tank VR Environment. ACM Transactions on Computer-Human Interaction, 4, 4, 309-322.
  47. Wigdor, D., Shen, C., Forlines, C. and Balakrishnan, R. (2006). Effects of display position and control space orientation on user preference and performance. Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '06. 309-318.
  48. Zhai, S., Milgram, P., and Buxton, W. (1996). The Influence of Muscle Groups on Performance of Multiple Degree-of-Freedom Input. Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '96. 308-315.
  49. Zhai, S., Buxton, W. and Milgram, P. (1994). The "Silk Cursor": Investigating Transparency for 3D Target Acquisition. Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '94. 459-464.
  50. Zhai, S. and MacKenzie, I. S. (1998). Teaching old mice new tricks: Innovations in computer mouse design. Proceedings of Ergon-Axia '98 -the First World Congress on Ergonomics for Global Quality and Productivity. 80-83.

Related papers

A new direct manipulation technique for immersive 3d virtual environments
Huyen T T Nguyen, C. Pontonnier, Thierry Duval

In this paper, we introduce a new 7-Handle manipulation technique for 3D objects in immersive virtual environments and its evaluation. The 7-Handle technique includes a set of seven points which are flexibly attached to an object. There are three different control modes for these points including configuration, manipulation and locking / unlocking modes. We have conducted an experiment to compare the efficiency of this technique with the traditional 6-DOF direct manipulation technique in terms of time, discomfort metrics and subjective estimation for precise manipulations in an immersive virtual environment in two consecutive phases: an approach phase and a refinement phase. The statistical results showed that the completion time in the approach phase of the 7-Handle technique was significantly longer than the completion time of the 6-DOF technique. Nevertheless, we found a significant interaction effect between the two factors (the manipulation technique and the object size) on the completion time of the refinement phase. In addition, even though we did not find any significant differences between the two techniques in terms of intuitiveness, ease of use and global preference in the result of subjective data, we obtained a significantly better satisfaction feedback from the subjects for the efficiency and fatigue criteria.

View PDFchevron_right
Usability of Hybrid, Physical and Virtual Objects for Basic Manipulation Tasks in Virtual Environments
Johann Habakuk Israel

Integrating physical and virtual environments has been shown to improve usability of Virtual Reality (VR) applications. Objects within these mixed realities (MR [1]) can be hybrid physical/virtual objects that are physically manipulatable and have flexible shape and texture.

View PDFchevron_right
Moving objects with 2D input devices in CAD systems and Desktop Virtual Environments
Wolfgang Stuerzlinger

2005

Part assembly and scene layout are basic tasks in 3D design in Desktop Virtual Environment (DVE) systems as well as Computer Aided Design (CAD) systems. 2D input devices such as a mouse or a stylus are still the most common input devices for such systems. With such devices, a notably difficult problem is to provide an efficient and predictable object motion in 3D based on their 2D motion. This paper presents a new technique to move objects in CAD/DVE using 2D input devices.

View PDFchevron_right
Direct manipulation of virtual objects
Long Nguyen

2009

Interacting with a Virtual Environment (VE) generally requires the user to correctly perceive the relative position and orientation of virtual objects. For applications requiring interaction in personal space, the user may also need to accurately judge the position of the virtual object relative to that of a real object, for example, a virtual button and the user's real hand. This is difficult since VEs generally only provide a subset of the cues experienced in the real world. Complicating matters further, VEs presented by currently available visual displays may be inaccurate or distorted due to technological limitations. Fundamental physiological and psychological aspects of vision as they pertain to the task of object manipulation were thoroughly reviewed. Other sensory modalities-proprioception, haptics, and audition-and their cross-interactions with each other and with vision are briefly discussed. Visual display technologies, the primary component of any VE, were canvassed and compared. Current applications and research were gathered and categorized by different VE types and object interaction techniques. While object interaction research abounds in the literature, pockets of research gaps remain. Direct, dexterous, manual interaction with virtual objects in Mixed Reality (MR), where the real, seen hand accurately and effectively interacts with virtual objects, has not yet been fully quantified. An experimental test bed was designed to provide the highest accuracy attainable for salient visual cues in personal space. Optical alignment and user calibration were carefully performed. The test bed accommodated the full continuum of VE types and sensory modalities for comprehensive comparison studies. Experimental designs included two sets, each measuring depth perception and object interaction. The first set addressed the extreme end points of the Reality-Virtuality (R-V) continuum-Immersive Virtual Environment (IVE) and Reality Environment (RE). This validated, linked, and extended several previous research findings, using one common test bed and participant pool. The results provided a proven method and solid reference points for further research. The second set of experiments leveraged the first to explore the full R-V spectrum and included additional, relevant sensory modalities. It consisted of two full-factorial experiments providing for rich data and key insights into the effect of each type of environment and each modality on accuracy and timeliness of virtual object interaction. The empirical results clearly showed that mean depth perception error in personal space was less than four millimeters whether the stimuli presented were real, virtual, or mixed. Likewise, mean error for the simple task of pushing a button was less than four millimeters whether the button was real or virtual. Mean task completion time was less than one second. Key to the high accuracy and quick task performance time observed was the correct presentation of the visual cues, including occlusion, stereoscopy, accommodation, and convergence. With performance results already near optimal level with accurate visual cues presented, adding proprioception, audio, and haptic cues did not significantly improve performance. Recommendations for future research include enhancement of the visual display and further experiments with more complex tasks and additional control variables. v In loving memory of my bà ngoại, Mai Thị Anh, who, through her jolly ways of living, taught me compassion and life vi ACKNOWLEDGEMENTS This dissertation work has been long and arduous. I would not have embarked on such an expedition without the encouragement of loved ones. I could not have completed this journey without the help of many around me. Words cannot adequately express the gratitude I owe. First and foremost, I thank the committee for their endless contribution. Dr. Linda Malone always put the student first and made sure I had the wherewithal to overcome every hurdle, whether it's research challenges or administrative obstacles. Dr. Jannick Rolland spent a great deal of resources and long hours to provide me with state-of-the-art visual display and continuous guidance. Dr. Bob Kennedy, whom I am so honored to have worked with even before I started this dissertation, never hesitated to spend the precious time to share his extensive knowledge and priceless research library. Dr. Kay Stanney, renowned in the field, never missed an opportunity to guide and encourage me. Dr. Kent Williams supported my studies long before this dissertation started and continued to guide me throughout the years. Dr. Karwowski selflessly came to the rescue, thankfully, when there was no other solution in sight. I am humbled and grateful to have learned from such well-known experts. Completing a dissertation while employed full time would be impossible if it weren't for support from the work place. Dr. Robert Breaux encouraged me to apply for the doctorate program. Dr. Jim Patrey, Dr. Joseph Cohn, and Dr. Andy Mead helped me to get started on my first human factors research efforts. My supervisors, Mr. Gary Fraas, Mr. Maynard Zettler, Mr. Ed Meyer, and Dr. Dan Dwyer encouraged higher education and have all been completely supportive of my studies. From NAS Jacksonville, Mr. Mike Muehlbauer, CDR Kevin Rasch, CDR Allen Crisp, and LCDR Michael Sypnewski went far out of their ways to provide me the vii ideal facility and participants for the experiments. My colleagues, Dr. Kelsey Henderson, Dr. Joan Johnston, and Mr. Curtis Conkey spent much time to help and more importantly, continuously urged me to push forward. Lastly, and most importantly, my family understands too well my insatiable thirst for academic knowledge. This has been a most selfish undertaking, indulging myself in scholarly studies while loved ones toiled without me day in and day out, year after year. Kids-Anthony, Thomas, Britney, and Victoria-you are my hope and sunshine. Anna, you are my everything. Thank you, Anna, for your unwavering support, sacrifice, and encouragement for my lavish hobby. The hardest part of this journey has been glimpses back at your hardship and my neglect for our family. This has been loads of fun for me and mighty tough for you. Yet, you hung on, continuously pushed, and climbed each step with me. We made it. You did it. viii

View PDFchevron_right
Human performance evaluation of manipulation schemes in virtual environments
Paul Milgram

Proceedings of IEEE Virtual Reality Annual International Symposium

This paper presents the results of one of the first experiments in a research programme aimed at systematically investigating manipulation schemes for spatial input, from a human factors point of view. A three dimensional design space model is proposed as a framework for such investigations and four options within this model are tested in a 6 degree-of-freedom target acquisition task within a virtual environment. Experimental results indicate strong performance advantages for isometric sensing combined with rate control and for isotonic sensing combined with position control. A strong interaction between sensing mode and mapping function is found. The findings are discussed in relation to the literature on spatial manipulation.

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved