Academia.eduAcademia.edu

Outline

Title
Abstract
Conclusion
References
All Topics
Computer Science
Human-Computer Interaction

Towards User-defined Cross-Device Interaction

Profile image of Audrey SanctorumAudrey SanctorumProfile image of Beat SignerBeat Signer

2016

https://doi.org/10.1007/978-3-319-46963-8_17
visibility

…

description

8 pages

link

1 file

Abstract

Over the last decade we have seen various research on distributed user interfaces (DUIs). We provide an overview of existing DUI approaches and classify the different solutions based on the granularity of the distributed UI components, location constraints as well as their support for the distribution of state. We propose an approach for user-defined cross-device interaction where users can author their customised user interfaces based on a hypermedia metamodel and the concept of active components. Furthermore, we discuss the configuration and sharing of customised distributed user interfaces by end users where the focus is on an authoring rather than programming approach.

Related papers

3RD Workshop on Distributed User Interfaces
Maria Fernanda Echeverry Lozano

Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems - EICS '13, 2013

Distributed User Interfaces (DUIs) have recently become a new field of research and development in Human-Computer Interaction (HCI). The DUIs have brought about drastic changes affecting the way interactive systems are conceived. DUIs have gone beyond the fact that user interfaces are controlled by a single end user on the same computing platform in the same environment. This new interaction mechanism affects the way these novel systems are designed and developed. New features need to be taken into account from the very beginning of the development process and new models, methods, and tools need to be considered for the correct development of interactive systems based on Distributed User Interfaces. Therefore, the goal of this workshop is to promote the discussion about the emerging topic of DUIs, answering a set of key questions regarding their development: How current UI models can be used or extended to cover the new features of DUIs? What new features should be considered and how should they be included within the development process? What new methods and methodologies do we need to develop DUIs in a correct way following the quality standards for interactive systems?. These articles were submitted to the 3nd Workshop on Distributed User Interfaces: Models, Methods and Tools that was held on June 24th, 2013 in London, UK as part of the fifth ACM SIGCHI Symposium on Engineering Interactive Computing Systems EICS 2013 conference.

View PDFchevron_right
Flexible support for distributing user interfaces across multiple devices
Fabio Paternò

2011

In this paper, we describe a solution to obtain flexible user interface distribution across multiple devices, even supporting different modalities. For this purpose we extend a model-based user interface language in order to address the specification of distribution at various user interface granularities. We also introduce how this solution works at run-time in order to support dynamic distribution of user interface elements across various devices.

View PDFchevron_right
A framework for the development of distributed interactive applications
Luca Frosini

Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems - EICS '13, 2013

In this paper we present a framework and the associated software architecture to manage user interfaces that can be distributed and/or migrated in multi-device and multi-user environments. It supports distribution across dynamic sets of devices, and does not require the use of a fixed server. We also report on its current implementation, and an example application.

View PDFchevron_right
The 4C reference model for distributed user interfaces
Jean Vanderdonckt

2008

Distributed User Interfaces (DUIs) are those interfaces whose different parts can be distributed in time and space on different monitors, screens, and computing platforms, depending on several parameters expressing the context of use, such as the user, the computing platform, and the physical environment in which the user is carrying out her interactive task. To understand and classify existing approaches for DUIs and to identify underexplored situations of DUIs, a reference model for DUIs is introduced that examines DUIs according to four 'C' dimensions: computation (what is distributed?), communication (when is it distributed?), coordination (who is it distributed?), and configuration (from where and to where is the distribution operated?). At the core of this reference model exists the original notion of user interface habitat, that is the place where a particular type of user interface is normally found. According to this notion, it is possible to explore and investigate a wide spectrum of DUIs among which we exemplify several cases coming from our existing research and development of DUIs. Fourth International Conference on Autonomic and Autonomous Systems 0-7695-3093-1/08 $25.00

View PDFchevron_right
A reference model for distributed user interfaces
Gaelle Calvary

2005

This paper proposes a reference model for classifying about different types of Distributed User Interfaces (DUIs) so that one could reason about their types: mouldable, distributable, and migratable UIs. The reference model explicitly captures concepts subject to distribution at different levels of abstraction (tasks, concepts, abstract UI, concrete UI, and deployed UI) so as to provide designers with a specification mechanism that enables them to express distribution. Some representative types of distributed UI are expressed according to the reference model to exemplify its usage.

View PDFchevron_right
UI Delegation: The 3rd Dimension for Cross-Platform User Interfaces Dagmawi Lemma Gobena
Abel Gomes

2015

Abstract—Two of the prominent dimensions behind the development of cross-platform UIs are the UI distribution and UI migration. In UI distribution, since UI elements of a given application has to be distributed across more than one device, some UI elements can be even duplicated. In UI migration, the description and construction of UI elements are centralized using a client-server model of computing over a computer network. Thus, we end up having limitations with respect to scalability and maintainability of the computing environment. Also, UI distribution and migration mostly support explicit HCI for interactive systems. However, in ubiquitous computing, implicit HCI is the most desired interaction approach. In this paper, we present the theoretical concept of UI delegation as the third dimension that ideally supports implicit HCI and trans-modality by assuring autonomy of the platforms using a peer-to-peer model. Keywords – cross-platform UI; multi-platform UI; user interface desi...

View PDFchevron_right
A Component-Based Infrastructure for Pervasive User Interaction
Yolande Berbers, Yves Vandewoude

Since a growing number of different mobile computing devices are used in pervasive and ubiquitous environments, the need to adopt new approaches for designing and implementing pervasive interactive software with minor effort is emerging. In this paper we present a process that facilitates the design of next-generation interactive software for pervasive environments. We created a distributed runtime infrastructure that enables the distribution of software components on heterogeneous, networked and embedded hardware systems. Some of these components or compositions of components will require interaction by human users from a large range of different devices. To make the deployment of consistent and functional User Interfaces in these pervasive environments easier, Interaction Components are introduced into the runtime infrastructure which enable the presentation of component and service behavior to human users.

View PDFchevron_right
Authoring pervasive multimodal user interfaces
Fabio Paternò

International Journal of Web Engineering and Technology, 2008

In this paper, we present an environment for authoring pervasive multimodal user interfaces. It is composed of a set of XML-based languages, transformations among such languages, and an authoring tool. It provides designers with the possibility of designing interfaces for a wide set of platforms, which support various modalities. We describe how the environment has deeply changed from the initial mono-modal, web-oriented environment and provide example applications for a number of platforms.

View PDFchevron_right
Lessons learned from the design and implementation of distributed post-WIMP user interfaces
Michael Haller

2011

Creating novel user interfaces that are “natural” and distributed is challenging for designers and developers.“Natural” interaction techniques are barely standardized and in combination with distributed UIs additional technical difficulties arise. In this paper we present the lessons we have learned in developing several natural and distributed user interfaces and propose design patterns to support development of such applications.

View PDFchevron_right
Multi-devices “Multiple” user interfaces: development models and research opportunities
Peter Forbrig

Journal of Systems and Software, 2004

Today, Internet-based appliances can allow a user to interact with the server-side services and information using different kinds of computing platforms including traditional office desktops, palmtops, as well as a large variety of wireless devices including mobile telephones, Personal Digital Assistants, and Pocket Computers. This technological context imposes new challenges in user interface software engineering, as it must run on different computing platforms accommodating the capabilities of various devices and the different contexts of use. Challenges are triggered also because of the universal access requirements for a diversity of users. The existing approaches of designing a single user interface using one computing platform do not adequately address the challenges of diversity, cross-platform consistency, universal accessibility and integration. Therefore, there is an urgent need for a new integrative framework for modeling, designing and evaluating multi-device user interfaces for the emerging generation of interactive systems. This paper begins by describing a set of constraints and characteristics intrinsic to multi-device user interfaces, and then by examining the impacts of these constraints on the specification, design and validation processes. Then, it discusses the research opportunities in important topics relevant to multi-device user interface development, including task and model-based, pattern-driven and device-independent development. We will highlight how research in these topics can contribute to the emergence of an integrative framework for Multiple-User Interface design and validation.

View PDFchevron_right

References (32)

  1. Bader, T., Heck, A., Beyerer, J.: Lift-and-Drop: Crossing Boundaries in a Multi- Display Environment by Airlift. In: Proc. of AVI 2010. Roma, Italy (May 2010)
  2. Balme, L., Demeure, A., Barralon, N., Coutaz, J., Calvary, G.: CAMELEON-RT: A Software Architecture Reference Model for Distributed, Migratable, and Plastic User Interfaces. In: Proc. of EUSAI 2004. Eindhoven, The Netherlands (Nov 2004)
  3. Bardram, J., Gueddana, S., Houben, S., Nielsen, S.: ReticularSpaces: Activity- Based Computing Support for Physically Distributed and Collaborative Smart Spaces. In: Proc. of CHI 2012. Austin, USA (May 2012)
  4. Bardram, J., Houben, S., Nielsen, S., Gueddana, S.: The Design and Architecture of ReticularSpaces: an Activity-Based Computing Framework for Distributed and Collaborative Smartspaces. In: Proc. of EICS 2012. Copenhagen, Denmark (June 2012)
  5. Biehl, J.T., Bailey, B.P.: ARIS: An Interface for Application Relocation in an Interactive Space. In: Proc. of GI 2004. London, Canada (May 2004)
  6. Biehl, J.T., Baker, W.T., Bailey, B.P., Tan, D.S., Inkpen, K.M., Czerwinski, M.: IMPROMPTU: A New Interaction Framework for Supporting Collaboration in Multiple Display Environments and Its Field Evaluation for Co-located Software Development. In: Proc. of CHI 2008. Florence, Italy (Apr 2008)
  7. Chang, T., Li, Y.: Deep Shot: A Framework for Migrating Tasks Across Devices Using Mobile Phone Cameras. In: Proc. of CHI 2011. Vancouver, Canada (May 2011)
  8. Chi, P.P., Li, Y.: Weave: Scripting Cross-Device Wearable Interaction. In: Proc. of CHI 2015. Seoul, Republic of Korea (Apr 2015)
  9. Demeure, A., Sottet, J., Calvary, G., Coutaz, J., Ganneau, V., Vanderdonckt, J.: The 4C Reference Model for Distributed User Interfaces. In: Proc. of ICAS 2008. Gosier, Guadeloupe (Mar 2008)
  10. Elmqvist, N.: Distributed User Interfaces: State of the Art. In: Distributed User Interfaces: Designing Interfaces for the Distributed Ecosystem. Human-Computer Interaction Series (2011)
  11. Everitt, K., Shen, C., Ryall, K., Forlines, C.: MultiSpace: Enabling Electronic Document Micro-Mobility in Table-Centric, Multi-Device Environments. In: Proc. of Tabletop 2006. Adelaide, Australia (Jan 2006)
  12. Frosini, L., Manca, M., Paternò, F.: A Framework for the Development of Dis- tributed Interactive Applications. In: Proc. of EICS 2013. London, United King- dom (June 2013)
  13. Hamilton, P., Wigdor, D.J.: Conductor: Enabling and Understanding Cross-Device Interaction. In: Proc. of CHI 2014. Toronto, Canada (Apr 2014)
  14. Han, R., Perret, V., Naghshineh, M.: WebSplitter: a Unified XML Framework for Multi-Device Collaborative Web Browsing. In: Proc. of CSCW 2000. Philadelphia, USA (Dec 2000)
  15. Husmann, M., Nebeling, M., Pongelli, S., Norrie, M.C.: MultiMasher: Providing Architectural Support and Visual Tools for Multi-device Mashups. In: Proc. of WISE 2014. Thessaloniki, Greece (Oct 2014)
  16. Johanson, B., Fox, A., Winograd, T.: The Interactive Workspaces Project: Experi- ences with Ubiquitous Computing Rooms. IEEE Pervasive Computing 1(2) (2002)
  17. Leigh, S., Schoessler, P., Heibeck, F., Maes, P., Ishii, H.: THAW: Tangible Interac- tion with See-Through Augmentation for Smartphones on Computer Screens. In: Proc. of TEI 2015. Stanford, California, USA (Jan 2015)
  18. Marquardt, N., Hinckley, K., Greenberg, S.: Cross-Device Interaction via Micro- mobility and F-formations. In: Proc. of UIST 2012. Cambridge, USA (Oct 2012)
  19. Melchior, J.: Distributed User Interfaces in Space and Time. In: Proc. of EICS 2011. Pisa, Italy (June 2011)
  20. Melchior, J., Grolaux, D., Vanderdonckt, J., Roy, P.V.: A Toolkit for Peer-to-Peer Distributed User Interfaces: Concepts, Implementation, and Applications. In: Proc. of EICS 2009. Pittsburgh, USA (July 2009)
  21. Nebeling, M., Mintsi, T., Husmann, M., Norrie, M.C.: Interactive Development of Cross-Device User Interfaces. In: Proc. of CHI 2014. Toronto, Canada (April 2014)
  22. Nebeling, M., Zimmerli, C., Husmann, M., Simmen, D.E., Norrie, M.C.: Informa- tion Concepts for Cross-Device Applications. In: Proc. of DUI 2013. London, UK (June 2013)
  23. Paternò, F., Santoro, C.: A Logical Framework for Multi-Device User Interfaces. In: Proc. of EICS 2012. Copenhagen, Denmark (June 2012)
  24. Rädle, R., Jetter, H., Marquardt, N., Reiterer, H., Rogers, Y.: HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In: Proc. of ITS 2014. Dresden, Germany (Nov 2014)
  25. Rekimoto, J.: Pick-and-Drop: A Direct Manipulation Technique for Multiple Com- puter Environments. In: Proc. of UIST 1997. Banff, Canada (Oct 1997)
  26. Robertson, S.P., Wharton, C., Ashworth, C., Franzke, M.: Dual Device User Inter- face Design: PDAs and Interactive Television. In: Proc. of CHI 1996. Vancouver, Canada (Apr 1996)
  27. Schreiner, M., Rädle, R., Jetter, H., Reiterer, H.: Connichiwa: A Framework for Cross-Device Web Applications. In: Proc. of CHI 2015. Seoul, Republic of Korea (Apr 2015)
  28. Signer, B., Norrie, M.C.: As We May Link: A General Metamodel for Hypermedia Systems. In: Proc. of ER 2007. Auckland, New Zealand (Nov 2007)
  29. Signer, B., Norrie, M.C.: A Framework for Developing Pervasive Cross-Media Ap- plications Based on Physical Hypermedia and Active Components. In: Proc. of ICPCA 2008. Alexandria, Egypt (Oct 2008)
  30. Signer, B., Norrie, M.C.: Active Components as a Method for Coupling Data and Services -A Database-Driven Application Development Process. In: Proc. of ICOODB 2009. Zurich, Switzerland (July 2009)
  31. Streitz, N.A., Geißler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., Steinmetz, R.: i-LAND: An Interactive Landscape for Creativity and Innovation. In: Proc. of the CHI 1999. Pittsburgh, USA (May 1999)
  32. Yang, J., Wigdor, D.: Panelrama: Enabling Easy Specification of Cross-Device Web Applications. In: Proc. of CHI 2014. Toronto, Canada (Apr 2014)

Related papers

Towards End-User Development of Distributed User Interfaces
Audrey Sanctorum, Beat Signer

2017

Over the last decade we have seen an increasing number of solutions for distributed user interfaces (DUIs). This paper provides a detailed overview of existing DUI approaches and classify the different solutions based on the granularity of the distributed UI components, the supported interaction space as well as their support for the distribution of state. After the analysis of existing solutions, we discuss a DUI scenario and derive a number of requirements for end-user DUI development. We propose an approach where users can author their customised user interfaces based on a hypermedia metamodel and the concept of active components. We further discuss possibilities for the configuration and sharing of customised distributed user interfaces by end users where the focus is on an authoring rather than a programming approach.

View PDFchevron_right
A Unifying Reference Framework and Model for Adaptive Distributed Hybrid User Interfaces
Audrey Sanctorum, Beat Signer

2019

Over the last decade, research on adaptive and distributed user interfaces (DUIs) has increased. We also witness a growing number of Internet of Things (IoT) devices, allowing digital user interfaces (UIs) to communicate with physical objects and vice versa through so-called hybrid user interfaces. There exist various solutions to manage adaptive, distributed or hybrid UIs. However, none of them covers all three aspects and users have to deal with multiple applications and configurations when developing adaptive distributed hybrid user interfaces. We introduce the eSPACE reference framework and conceptual model unifying the domains of adaptive, distributed and hybrid interfaces. While our reference framework has been inspired by the CAMELEON reference framework, the conceptual model is based on the Resource-Selector-Link (RSL) hypermedia meta-model. We propose an approach for adaptive distributed hybrid user interfaces where users can author their user interfaces based on the different levels of abstraction introduced by our reference framework. We further present a use case illustrating the extensibility, flexibility and reusability offered by our unified approach and discuss potential future work.

View PDFchevron_right
Distributed user interfaces: how to distribute user interface elements across users, platforms, and environments
Jean Vanderdonckt

2010

Abstract Distributed User Interfaces (DUIs) have become one vivid area of research and development in Human-Computer Interaction (HCI) where many dramatic changes occur in the way we can interact with interactive systems. DUIs attempt to surpass user interfaces that are manipulated only by a single end user, on the same computing platform, and in the same environment, with little or no variations among these axes.

View PDFchevron_right
Distributed user interfaces
Ricardo Tesoriero

Proceedings of the …, 2011

This document exposes the most relevant issues regarding the development of Distributed User Interfaces (DUIs) to present the specific features that are not covered by traditional development processes. A transversal approach to tackle these new aspects is also proposed. Therefore, the goal of this workshop is to promote the discussion about the emerging topic of distributed user interfaces, answering a set of key questions: what, when, how, why distribute a user interface among different devices.

View PDFchevron_right
UI Delegation: The 3rd Dimension for Cross-Platform User Interfaces
Dagmawi Lemma Gobena

2015

Two of the prominent dimensions behind the development of cross-platform UIs are the UI distribution and UI migration. In UI distribution, since UI elements of a given application has to be distributed across more than one device, some UI elements can be even duplicated. In UI migration, the description and construction of UI elements are centralized using a client-server model of computing over a computer network. Thus, we end up having limitations with respect to scalability and maintainability of the computing environment. Also, UI distribution and migration mostly support explicit HCI for interactive systems. However, in ubiquitous computing, implicit HCI is the most desired interaction approach. In this paper, we present the theoretical concept of UI delegation as the third dimension that ideally supports implicit HCI and trans-modality by assuring autonomy of the platforms using a peer-to-peer model.

View PDFchevron_right

Related topics

  • Information Systems
  • Engineering
  • Computer Science
  • Software Engineering
  • Human Computer Interaction
  • Information Technology
  • Management Information Systems
  • Technology
  • New Media
  • Design
  • Informatics
  • Computer Engineering
  • Web Engineering
  • User Experience (UX)
  • Interaction Design
  • Human Information Interaction
  • Web Technologies
  • Interactive and Digital Media
  • Multimodal Interaction
  • Cross-Media Information Spaces
  • Tangible User Interfaces
  • End User Development
  • End-User Software Engineering
  • Distributed User Interfaces
  • End-User Development
  • Pervasive and Ubiquitous Computing
  • Cross-Device

    • Cited by

    Distributed Web browsing: supporting frequent uses and opportunistic requirements
    Marco Winckler

    Universal Access in the Information Society

    Nowadays, the development of Web applications supporting distributed user interfaces (DUI) is straightforward. However, it is still hard to find Web sites supporting this kind of user interaction. Although studies on this field have demonstrated that DUI would improve the user experience, users are not massively empowered to manage these kinds of interactions. In this setting, we propose to move the responsibility of distributing both the UI and user interaction, from the application (a Web application) to the client (the Web browser), giving also rise to inter-application interaction distribution. This paper presents a platform for client-side DUI, built on the foundations of Web augmentation and End User Development. The idea is to empower end users to apply an augmentation layer over existing Web applications, considering both frequent use and opportunistic DUI requirements. In this work, we present the architecture and a prototype tool supporting this approach and illustrate the incorporation of some DUI features through case studies.

    View PDFchevron_right
    580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved