Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Related Work
Multi-Device Data Networking
Conclusion
References
All Topics
Computer Science
Distributed Systems

Richly Connected Systems and Multi-Device Worlds

Profile image of Andrew CorreaAndrew CorreaProfile image of Joel RossJoel RossProfile image of Bill TomlinsonBill Tomlinson

2009, Presence: Teleoperators and Virtual Environments

https://doi.org/10.1162/PRES.18.1.54
visibility

…

description

18 pages

link

1 file

Abstract

Many human activities now take place in settings that include several computational devices—such as desktop computers, laptops, and mobile phones—in the same physical space. However, we lack interaction paradigms that support a coherent experience across these collocated technologies and enable them to work effec- tively as systems. This article presents a conceptual framework for building richly connected systems of collocated

Related papers

Designing a Framework to Support the Development of Smart Cross-device Applications Nuno Correia
Pedro Albuquerque Santos, Rui Neves Madeira

MUM 2018 - Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia , 2018

We live surrounded by computing devices, but applications are mostly confined to run on a single device. It should be possible to make better use of the multiple devices around us by coming up with ways of integrating and combining them, while leveraging the specific strengths of some devices and minimizing the individual weaknesses of others. We want to explore the possibility of building applications that have their user interface seamlessly distributed across co-located devices. We created the YanuX Framework to provide the guidelines and tools needed by developers to build those applications. This paper presents the framework and its architecture, which is outlined along with the description of its components. We end by presenting an early evaluation of YanuX and by discussing the status of our work along with directions for further research. CCS Concepts • Human-centered computing~User interface management systems • Human-centered computing~Ubiquitous and mobile computing theory, concepts and paradigms Author

View PDFchevron_right
What are we Interacting With?: Architectural Reflection for Technical Translucence in Ubiquitous Computing
Paul Dourish

2008

Abstract. A number of researchers have observed that ubiquitous applications pose new challenges to usability because their locus of interaction has moved away from the traditional computer desktop and been distributed through the everyday world. We argue that the distributed nature of ubicomp infrastructure also poses interaction challenges. Ubicomp systems are made up of collections of components only some of which the user may have access to or be able to control. We propose a solution to this problem based on ...

View PDFchevron_right
Hybrid interactions in pervasive computing settings
Hamed Vahdat-Nejad, Reza Javidan

2011

There are so many interactions in pervasive computing environments that should be done automatically. Sometimes even users don't know about some interactions that are done in his/her devices. It refers to a concept based on a vision described by Mark Weiser. "The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it". In this paper, interactions in pervasive computing environment and some classifications of interactions are discussed. Hybrid interaction initiated by users and hybrid interaction initiated by smart object are two sub set of interactions in the classifications that are explained in this paper by two concrete examples: an event interaction system, and a Location information sending system. These interaction patterns are analyzed in such a pervasive computing setting where information about user's context is derived by combination of active and passive tags present in user's environment. In this route, pervasive RFID technology and Bluetooth-enabled active tags that are augmented to everyday objects are used.

View PDFchevron_right
Multimodal Interaction in Distributed and Ubiquitous Computing
Luigi Ceccaroni

2010 Fifth International Conference on Internet and Web Applications and Services, 2010

This paper presents a multimodal, service-oriented architecture based on a distributed implementation of W3C's Multimodal Architecture and Interfaces applied to ubiquitous computing. The specific goal is to create a platform able to provide multimodal interactions between people with functional diversity and several semantic services developed by third-party companies and consumed through a display, in order to make content more accessible and interactive. The general purpose of this research is the development and deployment of urban, ubiquitous services for people living in or visiting a city. And the motivating scenario behind the design and development of the multimodal platform and semantic services is one in which people use media poles and confidently interoperate with the surrounding environment in a multimodal way.

View PDFchevron_right
Blended Interaction – Toward a Framework for the Design of Interactive Spaces
Harald Reiterer

2012

In this paper, we propose Blended Interaction as a conceptual framework for the design of interactive spaces. We argue that for realizing a natural computer-supported collaboration in smart environments or interactive spaces, designers must achieve a holistic understanding and design of the users' individual interactions, social interactions, workflows and their physical environment. To thoughtfully blend the power of the digital world with the users' pre-existing skills and practices, we propose and explain conceptual blending as a potential design methodology. We illustrate our framework by discussing related theoretical and conceptual work and by explaining the design decisions we made in recent projects. In particular, we highlight how Blended Interaction introduces a new and more accurate description of users' cognition and interaction in interactive spaces that can serve as a tool for HCI researchers and interaction designers.

View PDFchevron_right
Interaction primitives: Describing interaction capabilities of Smart Objects in ubiquitous computing environments
Jun Hu

2011

Abstract The design of ubiquitous computing environments introduces challenges on both infrastructure level and the level of interaction design. To support the transition from a device-oriented paradigm towards a system-oriented paradigm with increased interoperability, we need a framework to describe interactions and interactive objects in such a way that the physical and contextual meaning of the interaction is preserved.

View PDFchevron_right
Facilitating the Design of Multi-channel Interfaces for Ambient Computing
Jean-Claude Tarby

2010 Third International …, 2010

View PDFchevron_right
Ubiquitous Interaction: Adapting to the “User in Context”
Berardina Nadja De Carolis

Context-awareness is increasing of importance in achieving an effective communication of information and provision of services. Then, besides taking into account "classical" user-related features, other contextdependent factors (i.e. users' location, activity, emotional state and technical characteristics of the used device) have to be considered. In this paper, we present the Personalization component of a multiagent infrastructure that we have developed for supporting interaction between users and environments. This component establishes which information to present, how to organize it and how to set up the output layout according to "user in context" features.

View PDFchevron_right
Seamless Interaction Among Heterogeneous Devices in Support for Co-located Collaboration
Jesus Favela

Lecture Notes in Computer Science, 2006

In some working environments users experience a high level of mobility while requiring collaborating and coordinating their activities with colleagues involving the exchange and analysis of documents distributed in space or time. Medical workers stand out among others by the demands imposed by hospital work. These new forms of interaction pose new challenges for the design of pervasive computing environments aimed at seamlessly integrating heterogeneous devices. Based on workplace studies conducted in a hospital, we designed and implemented a mobile collaborative system aimed at supporting co-located collaboration, proximity-based application-sharing, and the remote control of heterogeneous devices. The results of a preliminary evaluation show that users perceive the services provided by the application to be useful and efficient, even though the manipulation of the remote display through the PDA was less efficient than with the keyboard and mouse.

View PDFchevron_right
Mixed Interaction Space — Expanding the Interaction Space with Mobile Devices
Eva Eriksson

Springer eBooks, 2007

Mobile phones are mainly interacted with through buttons, thumbwheels or pens. However, mobile devices are not just terminals into a virtual world; they are objects in a physical world. The concept of Mixed Interaction Space (MIXIS) expands the interaction with mobile phone into the physical world [Hansen et al. 2005]. MIXIS uses the camera in mobile devices to track a fixed-point and thereby establishes a 3 dimensional interaction space wherein the position and rotation of the phone can be tracked. In this paper we demonstrate that MIXIS opens up for new flexible ways of interacting with mobile devices. We present a set of novel, flexible applications built with MIXIS and we show that MIXIS is a feasible way of interacting with mobile devices by evaluating a MIXIS application against a traditional mobile interface. Finally, we discuss some design issues with MIXIS.

View PDFchevron_right

References (49)

  1. Baecker, R. M., Grudin, J., Buxton, W. A. S., & Greenberg, S. (Eds.). (1995). Readings in human-computer interaction. San Mateo, CA: Morgan Kaufmann.
  2. Barab, S., Thomas, M., Dodge, T., Carteaux, R., & Tuzun, H. (2005). Making learning fun: Quest Atlantis, a game without guns. Educational Technology Research and Develop- ment, 53(1), 86 -107.
  3. Barkhuus, L., Chalmers, M., Tennent, P., Hall, M., Bell, M., Sherwood, S., et al. (2005). Picking pockets on the lawn: The development of tactics and strategies in a mobile game. Ubiquitous Computing: Ubicomp 2005, 358 -374.
  4. Bates, J., Loyall, A. B., & Reilly, W. S. (1994). An architec- ture for action, emotion, and social behavior. Selected Papers from the 4th European Workshop on Modeling Autonomous Agents in a Multi-Agent World, Artificial Social Systems, 55-68.
  5. Biocca, F. (1997). The cyborg's dilemma: Embodiment in virtual environments. Humanizing the Information Age, Proceedings of the Second International Conference on Cogni- tive Technology, 12-26.
  6. Blumberg, B. M., & Galyean, T. A. (1995). Multi-level direc- tion of autonomous creatures for real-time virtual environ- ments. Proceedings of the 22nd Annual Conference on Com- puter Graphics and Interactive Techniques, 47-54.
  7. Borovoy, R., Martin, F., Vemuri, S., Resnick, M., Silverman, Tomlinson et al. 69
  8. B., & Hancock, C. (1998). Meme tags and community mir- rors: Moving from conferences to collaboration. Proceedings of the 1998 ACM Conference on Computer Supported Cooper- ative Work, 159 -168.
  9. Brumitt, B., Meyers, B., Krumm, J., Kern, A., & Shafer, S. A. (2000). EasyLiving: Technologies for intelligent environ- ments. Proceedings of the 2nd International Symposium on Handheld and Ubiquitous Computing, 12-29.
  10. Card, S., Moran, T., & Newell, A. (1983). The psychology of human-computer interaction, p. 488. Mahwah, NJ: Law- rence Erlbaum.
  11. Cheok, A. D., Fong, S. W., Goh, K. H., Yang, X., Liu, W., & Farzbiz, F. (2003). Human Pacman: A sensing-based mo- bile entertainment system with ubiquitous computing and tangible interaction. Proceedings of the 2nd Workshop on Net- work and System Support for Games, 106 -117.
  12. Drettakis, G., Roussou, M., Reche, A., & Tsingos, N. (2007). Design and evaluation of a real-world virtual environment for architecture and urban planning. Presence: Teleoperators and Virtual Environments, 16(3), 318 -332.
  13. Drucker, S. M., He, L., Cohen, M., Wong, C., & Gupta, A. (2003). Spectator games: A new entertainment modality for networked multiplayer games. Retrieved October 5, 2008. Available at http://research.microsoft.com/ϳsdrucker/ papers/spectator.pdf.
  14. El-Nasr, M. S., Zupko, J., & Miron, K. (2005). Intelligent lighting for a better gaming experience. CHI '05 Extended Abstracts on Human Factors in Computing Systems, 1140 - 1141.
  15. Friedman, D., Leeb, R., Guger, C., Steed, A., Pfurtscheller, G., & Slater, M. (2007). Navigating virtual reality by thought: What is it like? Presence: Teleoperators and Virtual Environments, 16(1), 100 -110.
  16. Gratch, J., Rickel, J., Andre, E., Cassell, J., Petajan, E., & Ba- dler, N. (2002). Creating interactive virtual humans: Some assembly required. Intelligent Systems, IEEE, 17(4), 54 -63.
  17. Grudin, J. (1988). Why CSCW applications fail: Problems in the design and evaluation of organizational interfaces. Pro- ceedings of the 1988 ACM Conference on Computer- Supported Cooperative Work, 85-93.
  18. Grudin, J., & Palen, L. (1995). Why groupware succeeds: Discretion or mandate? Proceedings of the Fourth European Conference on Computer-Supported Cooperative Work, 263- 278.
  19. He, L., Cohen, M. F., & Salesin, D. H. (1996). The virtual cinematographer. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, 217-224.
  20. Heath, C., Luff, P., Lehn, D. V., Hindmarsh, J., & Cleverly, J. (2002). Crafting participation: Designing ecologies, con- figuring experience. Visual Communication, (1), 9 -33.
  21. Hindmarsh, J., Heath, C., Lehn, D. V., & Cleverly, J. (2005). Creating assemblies in public environments: Social interac- tion, interactive exhibits and CSCW. Computer Supported Cooperative Work (CSCW), 14(1), 1-41.
  22. Hughes, C. E., Reinhard, E., Konttinen, J., & Pattanaik, S. (2004). Achieving interactive time realistic illumination in mixed reality. Army Science Conference.
  23. Ishii, H., Mazalek, A., & Lee, J. (2001). Bottles as a minimal interface to access digital information. CHI '01 Extended Abstracts on Human Factors in Computing Systems, 187- 188.
  24. Ishii, H., & Ullmer, B. (1997). Tangible bits: Towards seam- less interfaces between people, bits and atoms. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 234 -241.
  25. Khoo, E. T., Lee, S. P., Cheok, A. D., Kodagoda, S., Zhou, Y., & Toh, G. S. (2006). Age invaders: Social and physical inter-generational family entertainment. CHI '06 Extended Abstracts on Human Factors in Computing Systems, 243- 246.
  26. Lee, K. M., & Nass, C. (2003). Designing social presence of social actors in human computer interaction. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 289 -296.
  27. Lofland, J., & Lofland, L. (1995). Analyzing social settings: A guide to qualitative observation and analysis. Belmont, CA: Wadsworth.
  28. Maes, P. (1995). Artificial life meets entertainment: Lifelike autonomous agents. Communications of the ACM, 38(11), 108 -114.
  29. Mynatt, E. D., Back, M., Want, R., Baer, M., & Ellis, J. B. (1998). Designing audio aura. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 566 - 573. Naemura, T., Nitta, T., Mimura, A., & Harashima, H. (2002). Virtual shadows in mixed reality environment using flashlight-like devices. Transactions of the Virtual Reality Society of Japan, 7.
  30. Norman, D. (1988). The psychology of everyday things. New York: Basic Books.
  31. O'Hare, G. M. P., & Duffy, B. R. (2002). Agent chameleons: Migration and mutation within and between real and virtual spaces. The Society for the Study of Artificial Intelligence and the Simulation of Behaviour (AISB), 3-5.
  32. Ong, W. (1982). Orality and literacy (2nd ed., 2002). New York: Routledge.
  33. Perlin, K., & Goldberg, A. (1996). Improv: A system for scripting interactive actors in virtual worlds. Proceedings of the 23rd Annual Conference on Computer Graphics and In- teractive Techniques, 205-216.
  34. Rekimoto, J. (1997). Pick-and-drop: A direct manipulation technique for multiple computer environments. Proceedings of the 10th Annual ACM Symposium on User Interface Soft- ware and Technology, 31-39.
  35. Roussos, M., Johnson, A., Moher, T., Leigh, J., Vasilakis, C., & Barnes, C. (1999). Learning and building together in an immersive virtual world. Presence: Teleoperators and Virtual Environments, 8(3), 247-263.
  36. Sawhney, N., & Schmandt, C. (2000). Nomadic radio: Speech and audio interaction for contextual messaging in nomadic environments. ACM Transaction on Computer- Human Interaction, 7(3), 353-383.
  37. Stock, O., & Zancanaro, M. (2002). Intelligent interactive information presentation for cultural tourism. In Proceed- ings of the International CLASS Workshop on Natural Intel- ligent and Effective Interaction in Multimodal Dialogue Sys- tems, 28 -29.
  38. Sumi, Y., & Mase, K. (2001). AgentSalon: Facilitating face-to- face knowledge exchange through conversations among personal agents. Proceedings of the Fifth International Con- ference on Autonomous Agents, 393-400.
  39. Tomlinson, B. (2005). A heterogeneous animated platform for educational participatory simulations. Proceedings of the 2005 Conference on Computer Support for Collaborative Learning; Learning 2005: The Next 10 Years, 677-681.
  40. Tomlinson, B., Baumer, E., & Yau, M. L. (2006). The island metaphor. ACM SIGGRAPH 2006 Research Posters, 84.
  41. Tomlinson, B., Baumer, E., Yau, M. L., Carpenter, F. L., & Black, R. (2008). A participatory simulation for informal education in restoration ecology. E-Learning, 5(3), 238 - 255.
  42. Tomlinson, B., Blumberg, B., & Nain, D. (2000). Expressive autonomous cinematography for interactive virtual environ- ments. Proceedings of the Fourth International Conference on Autonomous Agents, 317-324.
  43. Tomlinson, B., Yau, M. L., & Baumer, E. (2006). Embodied mobile agents. Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, 969 -976.
  44. Tomlinson, B., Yau, M. L., Baumer, E., Goetz, S., Carpenter, L., Pratt, R., et al. (2006). The EcoRaft project: A multi- device interactive graphical exhibit for learning about resto- ration ecology. CHI'06 Extended Abstracts on Human Fac- tors in Computing Systems, 1445-1450.
  45. Tomlinson, B., Yau, M. L., & Gray, J. (2005). Heterogeneous character animation: How to make an interactive character jump between stationary and mobile graphical computing plat- forms. ACM SIGGRAPH 2005 Sketches, 18.
  46. Tomlinson, B., Yau, M. L., Gray, J., Baumer, E., O'Connell, J., Williams, K., et al. (2005). The virtual raft project: A network of mobile and stationary computer systems inhab- ited by communities of interactive animated agents. ACM SIGGRAPH 2005 Emerging Technologies, 30.
  47. Tomlinson, B., Yau, M. L., O'Connell, J., Williams, K., & Yamaoka, S. (2005). The virtual raft project: A mobile in- terface for interacting with communities of autonomous characters. CHI'05 Extended Abstracts on Human Factors in Computing Systems, 1150 -1151.
  48. Weiser, M., & Brown, J. S. (1996). Designing calm technol- ogy. PowerGrid Journal, 1(1), 75-85.
  49. Williams, M., Jones, O., Fleuriot, C., & Wood, L. (2005). Children and emerging wireless technologies: Investigating the potential for spatial practice. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 819 - 828.

Related papers

Cross-Device Interaction Definition, Taxonomy and Applications
Jörg Cassens

2013

This contribution proposes a definition and taxonomy of the often used term cross-device interaction. Despite of technical progress, systems and interfaces that integrate into the environment are still the subject of intensive research. We still live in a world where devices reside in the foreground and present themselves and their interaction capabilities to the user. At the same time, computing devices become an integral part of our environment, be it in the form of public displays or mobile computers. Furthermore, the number of devices a user owns or has access to is increasing. Humans interacting consciously with multiple devices can be seen as an intermediate stage towards ambient environments or ubiquitous computing. The term cross-device interaction (XDI) is often used to refer to the underlying interaction paradigm in such environments. Unfortunately, the term still lacks consistent and concise definitions. This can be a problem as different authors use the term XDI with div...

View PDFchevron_right
Ubiquitous media for collocated interaction
Ann Morrison, Antti Salovaara
View PDFchevron_right
A Framework to Support Multiple Levels of Interaction
Dario Di Mauro

2015

The human world is more and more inter-connected and, as consequence, we need to communicate in a faster and smarted way. Many software applications do that, but they usually work in a single context at time. In this paper we present a framework that aims at making the interaction easier and more natural; involved actors are connected in a graph, sending and receiving signals by adjacent nodes. The framework has been developed to work in dierent contexts, especially in domotic and cultural heritage fruition; the goal is to connect dierent spaces, such as homes, museums, etc, focusing the attention on interaction perspec- tive, maintaining a natural interface for the user and hiding low-level communication issues. This work will be framed in the context of Natu- ral User Interfaces, so it is centered on the user, exchanging signals with external sensors or devices, such as a smartphone and PC, using gestures, dialogues and augmented reality.

View PDFchevron_right
A framework for bimanual inter-device interactions
Gursimran Walia

Journal of Visual Languages & Computing, 2014

A shared interactive display (e.g., a tabletop) provides a large space for collaborative interactions. However, a public display lacks a private space for accessing sensitive information. On the other hand, a mobile device offers a private display and a variety of modalities for personal applications, but it is limited by a small screen. We have developed a framework that supports fluid and seamless interactions among a tabletop and multiple mobile devices. This framework can continuously track each user's action (e.g., hand movements or gestures) on top of a tabletop and then automatically generate a unique personal interface on an associated mobile device. This type of inter-device interactions integrates a collaborative workspace (i.e., a tabletop) and a private area (i.e., a mobile device) with multimodal feedback. To support this interaction style, an event-driven architecture is applied to implement the framework on the Microsoft PixelSense tabletop. This framework hides the details of user tracking and inter-device communications. Thus, interface designers can focus on the development of domainspecific interactions by mapping user's actions on a tabletop to a personal interface on his/her mobile device. A user study compared our interaction style with a standard tabletop interface and justified the usability of the proposed interaction.

View PDFchevron_right
Multi-Platform Human Computer Interaction in Converged Media Spaces ISBN: 978-0-7695-3791-7
David Robison

The boundaries between different kinds of media spaces are complex and challenging. The convergence of computing, media, and telecommunications produces environments that contain elements of their origins, but also contain new components that allow interaction in new ways by new users with new kinds of information. This poses problems for effective human computer interaction and human media interaction because the paradigms are not well understood. Converged environments are driving these new uses just as the first PCs supported keyboards and then WIMP interfaces.

View PDFchevron_right

Related topics

  • Mobile Agent
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved