Stitching

2010

To support reminiscing in the home, people collect an increasing amount of digital media on numerous devices. When sharing their media with other people, distribution of the media over different devices can be problematic. In this paper, we address this problem by designing an innovative interaction concept for cross-device interaction to support groups in sharing photos using multiple devices. We designed and implemented the Pipet concept. Results of a comparative study show that Pipet resulted in a pragmatic and hedonic user experience.

Proc. …, 2007

We introduce C-Slate, a new vision-based system, which utilizes stereo cameras above a commercially available tablet technology to support remote collaboration. The horizontally mounted tablet provides the user with high resolution stylus input, which is augmented by multi-touch interaction and recognition of untagged everyday physical objects using new stereo vision and machine learning techniques. This provides a novel and interesting interactive tabletop arrangement, capable of supporting a variety of fluid multi-touch interactions, including symmetric and asymmetric bimanual input, coupled with the potential for incorporating tangible objects into the user interface. When used in a remote context, these features are combined with the ability to see visual representations of remote users' hands and remote physical objects placed on top of the surface. This combination of bimanual and tangible interaction and sharing of remote gestures and physical objects provides a new way to collaborate remotely, complementing existing channels such as audio and video conferencing. : Enabling multi-touch sensitivity using stereo vision. Our detailed analysis of fingertips allows for symmetric and asymmetric bimanual interaction: scaling, rotation, translation with simultaneous use of the stylus and also single handed rotation and scaling.

2013 Seventh International Conference on Next Generation Mobile Apps, Services and Technologies, 2013

The success of context-aware systems depends on intuitive user interface designs which facilitate communication between multiple devices. This paper presents ThrowIt, a natural user interface for sharing objects between mobile devices using gaze and hand gestures. For enabling gesture control, ThrowIt includes an off-the-shelf monochrome camera with infrared lights and a hand-held 6 degree of freedom sensor. To share an object, the user first locks their gaze on the object, then selects the object by doing a short 'grab' gesture, and finally, sends the object to another mobile device by doing a 'throwing' gesture. The mobile devices locate each other via a context server. According to the results of our user study, the idea of sharing digital objects using ThrowIt was found both useful and fascinating. However, sharing objects to many people at the same time raised security concerns.

Interacting with Computers, 2019

As the range of handheld, mobile and desktop devices expands and worldwide demand for collaborative application tools increases, there is a growing need for higher speed impromptu cross-device application sharing to keep up with workplace requirements for on-site or remote collaborations. To address this, we have developed CamCutter, a cross-device interaction technique enabling a user to quickly select and share an application running on another screen using the camera of a handheld device. This technique can accurately identify the targeted application on a display using our adapted computer vision algorithm, system architecture and software implementation, allowing impromptu real-time and synchronized application sharing between devices. For desktop and meeting room set-ups, we performed a technical evaluation, measuring accuracy and speed of migration. For a single-user reading task and a collaborative composition task, we carried out a user study comparing our technique with co...

Collaboration Meets Interactive Spaces, 2016

Large vertical displays are increasingly widespread, and content sharing between them and personal mobile devices is central to many collaborative usage scenarios. In this chapter we present FlowTransfer, bidirectional transfer techniques which make use of the mobile phone's position and orientation. We focus on three main aspects: multi-item transfer and layout, the dichotomy of casual versus precise interaction, and support for physical navigation. Our five techniques explore these aspects in addition to being contributions in their own right. They leverage physical navigation, allowing seamless transitions between different distances to the display, while also supporting arranging content and copying entire layouts within the transfer process. This is enabled by a novel distance-dependent pointing cursor that supports coarse pointing from distance as well as precise positioning at close range. We fully implemented all techniques and conducted a qualitative study documenting their benefits. Finally, based on a literature review and our holistic approach in designing the techniques, we also contribute an analysis of the underlying design space.

2003

Despite the mobility enabled by the plethora of technological tools such as laptops, PDA and cell phones, horizontal flat surfaces are still extensively used and much preferred for on-the-move face-to-face collaboration. Unfortunately, when digital documents need to be shared during collaboration, people are still mostly constrained to display surfaces that have been designed for single users, such as laptops and PDAs. Technologically there is a lack of computational support for shared digital document access, browsing, visualization and manipulation on horizontal surfaces. We believe support for such serendipitous meetings will play a critical role in future ubiquitous computing spaces. Our UbiTable project examines the design space of tabletops used as scrap displays. Scrap displays support kiosk-style walk-up interaction for impromptu face-to-face collaboration. Our design offers the affordances of a physical table. It provides the flexibility by allowing users to layout shared documents with desired orientation and position; at the same time it augments traditional paper-based interactions by providing a flexible gradient or shades of sharing semantics. UbiTable addresses visual accessibility vs. electronic accessibility of documents, an issue which is critical to ubiquitous environments.

CONIELECOMP 2012, 22nd International Conference on Electrical Communications and Computers, 2012

In this paper we report on early findings on how a set of gestures and graphical elements can be used as a means to introduce and manipulate ideas represented by images, text, and freehand drawings around a horizontal multi-touch surface in the context of collaborative processes. A fan-like menu that can be obtained from any point on the interactive surface is one of the key proposed graphical elements. We also propose a knowledge management system for this scenario, which allows for the organization of ideas into hierarchical conceptual structures. We also present two innovative solutions to challenging issues related with the undo/redo stack and the clipboard mechanism for interactive surfaces.

2003

Drag-and-pop and drag-and-pick are interaction techniques designed for users of pen-and touchoperated display systems. They provide users with access to screen content that would otherwise be impossible or hard to reach, e.g., because it is located behind a bezel or far away from the user. Drag-and-pop is an extension of traditional drag-and-drop. As the user starts dragging an icon towards some target icon, drag-and-pop responds by temporarily moving potential target icons towards the user's current cursor location, thereby allowing the user to interact with these icons using comparably small hand movements. Drag-and-Pick extends the drag-and-pop interaction style such that it allows activating icons, e.g., to open folders or launch applications. In this paper, we report the results of a user study comparing drag-and-pop with traditional drag-and-drop on a 15' (4.50m) wide interactive display wall. Participants where able to file icons up to 3.7 times faster when using the drag-and-pop interface.

2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), 2018

We present Pocket Transfers: interaction techniques that allow users to transfer content from situated displays to a personal mobile device while keeping the device in a pocket or bag. Existing content transfer solutions require direct manipulation of the mobile device, making interaction slower and less flexible. Our introduced techniques employ touch, mid-air gestures, gaze, and a multimodal combination of gaze and mid-air gestures. We evaluated the techniques in a novel user study (N=20), where we considered dynamic scenarios where the user approaches the display, completes the task, and leaves. We show that all pocket transfer techniques are fast and seen as highly convenient. Mid-air gestures are the most efficient touchless method for transferring a single item, while the multimodal method is the fastest touchless method when multiple items are transferred. We provide guidelines to help researchers and practitioners choose the most suitable content transfer techniques for their systems.

2009

Usage patterns of private mobile devices are constantly evolving. For example, researchers have recently found that mobile users prefer using their devices with only one hand. Furthermore, current hardware in these devices reduces the need for a stylus and instead relies on finger input. However, current interactive techniques, such as those used for sharing documents between private and public devices have not taken advantage of these recent developments. For example a popular technique, Flick for sharing documents between devices relies on pen and stylus use and has not been adapted to support one-handed interaction. In this paper, we present Chucking, a gesture-based technique for sharing documents between private mobile devices and public displays. Chucking is based on the natural human gesture used for throwing or passing objects. We present the various design parameters that make Chucking an effective document sharing technique. In a document positioning task, we evaluated Chucking against Flicking. Our results show that under certain contexts users were more accurate and effective with Chucking. Participants also preferred Chucking as it maps closely the type of interaction one naturally performs to share objects. We also introduce extensions to Chucking, such as Chuck-Back, Chuck-and-Rotate, and Chuck-and-Place that constitute a suite of techniques that facilitate a large range of document sharing interactions between private mobile devices and public displays.