Skip to main content

Tony Dunnigan

Followers

0

Following

1

Public Views

Interests

Uploads

Papers by Tony Dunnigan

Post-Bit is a small e-paper device modeled after paper Post-Its r 1 . We explored and designed in... more Post-Bit is a small e-paper device modeled after paper Post-Its r 1 . We explored and designed interfaces to handle multimedia contents with paper-like manipulations using this epaper device. The functions of each Post-Bit combined the affordance of physical tiny sticky memos and digital handling of information. At this stage of the design, we have prototyped two features of the interface: connecting computer-based workspaces and physical workspaces (using a function called Drop-Beyond-Drag), and tangible and tactile operation of multi-media contents. In this paper, we present the integrated design and functionality of the Post-Bit system's main components as shown in the video scenario.

ThermoTouch

Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

ThermoTouch is a new type of thermo-haptic display device. It provides a visual display with a gr... more ThermoTouch is a new type of thermo-haptic display device. It provides a visual display with a grid of thermal pixels that can provide hot or cold haptic feedback. Unlike previous devices, our proposed design uses liquid cooling and resistive heating to output thermal feedback. We describe the hardware and software design of ThermoTouch. Technical measurements on our prototype indicate that ThermoTouch has thermal output properties comparable to Peltier elements, which have been used extensively as thermal transducers in previous works. Our measurements of ThermoTouch's per-area power consumption and its low hardware cost per thermal pixel indicate that our technology improves scalability to large-scale thermal displays over technologies used in previous systems. As an example application of ThermoTouch, we describe an editing, automatic keyframe generation and playback system for video with an additional thermo-haptic feedback channel. Lastly, we describe technical design considerations for creating large-scale thermal displays using ThermoTouch technology.

MyUnity: Building Awareness and Fostering Community in the Workplace

arXiv (Cornell University), Jun 25, 2010

Successful collaboration depends on effective communication. Ongoing group awareness facilitates ... more Successful collaboration depends on effective communication. Ongoing group awareness facilitates communication by enabling workers to be more informed about their collaborators, about their activities, and about the interpersonal dependencies among people working together. In this paper we present MyUnity, a new system that aids workers in building group awareness. The system uses multiple sources, both automatic and user-provided, to report colleagues' location, availability, current tasks, and preferred communication channels. Information is aggregated, fused and presented as a simple presence state for each worker. Workers can each independently control what information is collected by the system, allowing them to participate in the system without compromising their privacy. Results from a four-week field study show MyUnity increased group awareness and fostered an increased sense of community in the workplace. Results provide insights into the utility of awareness systems in the workplace.

Visualizing Gaze Presence for 360° Cameras

Advancements in 360° cameras have increased their relatedlivestreams. In the case of video confer... more Advancements in 360° cameras have increased their relatedlivestreams. In the case of video conferencing, 360° camerasprovide almost unrestricted visibility into a conference room for aremote viewer without the need for an articulating camera. However,local participants are left wondering if someone is connected andwhere remote participants might be looking. To address this, wefabricated a prototype device that shows the gaze and presence ofremote 360° viewers using a ring of LEDs that match the remoteviewports. We discuss the long term use of one of the prototypes ina lecture hall and present future directions for visualizing gazepresence in 360° video streams.

Automatic Photo to Ideophone Manga Matching

ArXiv, 2020

Photo applications offer tools for annotation via text and stickers. Ideophones, mimetic and onom... more Photo applications offer tools for annotation via text and stickers. Ideophones, mimetic and onomatopoeic words, which are common in graphic novels, have yet to be explored for photo annotation use. We present a method for automatic ideophone recommendation and positioning of the text on photos. These annotations are accomplished by obtaining a list of ideophones with English definitions and applying a suite of visual object detectors to the image. Next, a semantic embedding maps the visual objects to the possible relevant ideophones. Our system stands in contrast to traditional computer vision-based annotation systems, which stop at recommending object and scene-level annotation, by providing annotations that are communicative, fun, and engaging. We test these annotations in Japanese and find they carry a strong preference and increase enjoyment and sharing likelihood when compared to unannotated and object-based annotated photos.

Use Your Head! Exploring Interaction Modalities for Hat Technologies

Proceedings of the 2019 on Designing Interactive Systems Conference, 2019

Figure 1. Left: touch sensitive region and public crown display of the fedora prototype. Middle: ... more

Evolution of a Tabletop Telepresence System through Art and Technology

Proceedings of the 23rd ACM international conference on Multimedia, 2015

New technologies arise in a number of ways. They may come from advances in scientific research, t... more New technologies arise in a number of ways. They may come from advances in scientific research, through new combinations of existing technologies, or by simply imagining what might be possible in the future. This video describes the evolution of Tabletop Telepresence, a system for remote collaboration through desktop videoconferencing combined with a digital desk. Tabletop Telepresence began as a collection of camera, projector, videoconferencing and user interaction technologies. Working together; artists and research scientists combined these technologies into a means of sharing paper documents between remote desktops, interacting with those documents, requesting services (such as translation), and communicating through a videoconference.

Design Evolution of a Mixed Reality Factory System

Mobile monitoring and control system for a food industry development laboratory

Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion, 2012

In this demonstration we will show a mobile remote control and monitoring application for a recip... more In this demonstration we will show a mobile remote control and monitoring application for a recipe development laboratory at a local chocolate production company. In collaboration with TCHO, a chocolate maker in San Francisco, we built a mobile Web app designed to allow chocolate makers to control their laboratory's machines. Sensor data is imported into the app from each machine in the lab. The mobile Web app is used for control, monitoring, and collaboration. We have tested and deployed this system at the real-world factory and it is now in daily use. This project is designed as part of a research exploration into enhanced collaboration in industrial settings between physically remote people and places, e.g. factories in China with clients in the US.

Shapewriter on the iphone

CHI '09 Extended Abstracts on Human Factors in Computing Systems, 2009

We present our experience in bringing ShapeWriter, a novel HCI research product, from the laborat... more

MET: media-embedded target for connecting paper to digital media

International Journal of Multimedia Information Retrieval, 2014

Media Embedded Target, or MET, is an iconic mark printed in a blank margin of a page that indicat... more Media Embedded Target, or MET, is an iconic mark printed in a blank margin of a page that indicates a media link is associated with a nearby region of the page. It guides the user to capture the region and thus retrieve the associated link through visual search within indexed content. The target also serves to separate page regions with media links from other regions of the page. The capture application on the cell phone displays a sight having the same shape as the target near the edge of a camera-view display. The user moves the phone to align the sight with the target printed on the page. Once the system detects correct sight-target alignment, the region in the camera view is captured and sent to the recognition engine which identifies the image and causes the associated media to be displayed on the phone. Since target and sight alignment defines a capture region, this approach saves storage by only indexing visual features in the predefined capture region, rather than indexing the entire page. Targetsight alignment assures that the indexed region is fully captured. We compare the use of MET for guiding capture with two standard methods: one that uses a logo to indicate that media content is available and text to define the capture region and another that explicitly indicates the capture region using a visible boundary mark.

Embedded media barcode links

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, 2010

Embedded Media Barcode Links, or simply EMBLs, are optimally blended iconic barcode marks, printe... more Embedded Media Barcode Links, or simply EMBLs, are optimally blended iconic barcode marks, printed on paper documents, that signify the existence of multimedia associated with that part of the document content (Figure ). EMBLs are used for multimedia retrieval with a camera phone. Users take a picture of an EMBL-signified document patch using a cell phone, and the multimedia associated with the EMBL-signified document location is displayed on the phone. Unlike a traditional barcode which requires an exclusive space, the EMBL construction algorithm acts as an agent to negotiate with a barcode reader for maximum user and document benefits. Because of this negotiation, EMBLs are optimally blended with content and thus have less interference with the original document layout and can be moved closer to a media associated location. Retrieval of media associated with an EMBL is based on the barcode identification of a captured EMBL. Therefore, EMBL retains nearly all barcode identification advantages, such as accuracy, speed, and scalability. Moreover, EMBL takes advantage of users' knowledge of a traditional barcode. Unlike Embedded Media Maker (EMM) which requires underlying document features for marker identification, EMBL has no requirement for the underlying features. This paper will discuss the procedures for EMBL construction and optimization. It will also give experimental results that strongly support the EMBL construction and optimization ideas.

Trailblazing: Video Playback Control by Direct Object Manipulation

Multimedia and Expo, 2007 IEEE International Conference on, 2007

We describe a new interaction technique that allows users to control nonlinear video playback by ... more We describe a new interaction technique that allows users to control nonlinear video playback by directly manipulating objects seen in the video. This interaction technique is similar to video "scrubbing" where the user adjusts the playback time by moving the mouse along a slider. Our approach is superior to variable-scale scrubbing in that the user can concentrate on interesting objects and does not have to guess how long the objects will stay in view. Our method relies on a video tracking system that tracks objects in fixed cameras, maps them into 3D space, and handles hand-offs between cameras. In addition to dragging objects visible in video windows, users may also drag iconic object representations on a floor plan. In that case, the best video views are selected for the dragged objects.

The virtual chocolate factory: Building a real world mixed-reality system for industrial collaboration and control

2010 IEEE International Conference on Multimedia and Expo, 2010

Virtual, mobile, and mixed reality systems have diverse uses for data visualization and remote co... more Virtual, mobile, and mixed reality systems have diverse uses for data visualization and remote collaboration in industrial settings, especially factories. We report our experiences in designing complex mixed-reality collaboration, control, and display systems for a real-world factory, for delivering real-time factory information to multiple types of users. In collaboration with TCHO, a chocolate maker in San Francisco, our research group is building a virtual "mirror" world of a real-world chocolate factory and its processes. Sensor data is imported into the multi-user 3D environment from hundreds of sensors on the factory floor. The resulting "virtual factory" is designed for simulation, visualization, and collaboration, using a set of interlinked, real-time layers of information about the factory and its processes. We are also looking at appropriate industrial uses for mobile devices such as cell phones and tablet computers, and how they intersect with virtual worlds and mixed realities. For example, an experimental iPhone web app provides mobile laboratory monitoring and control. The mobile system is integrated with the database underlying the virtual factory world. These systems were deployed at the real-world factory and lab in 2009, and are now in beta development. Through this mashup of mobile, social, mixed and virtual technologies, we hope to create industrial systems for enhanced collaboration between physically remote people and places -for example, factories in China with managers in Japan or the US.

The virtual chocolate factory

Proceedings of the 18th ACM international conference on Multimedia, 2010

Abstract We show several aspects of a complex mixed reality system that we have built and deploye... more

The future is in the past: Designing for exploratory search

IIiX 2012 - Proceedings 4th Information Interaction in Context Symposium: Behaviors, Interactions, Interfaces, Systems, 2012

Exploratory search activities tend to span multiple sessions and involve finding, analyzing and e... more Exploratory search activities tend to span multiple sessions and involve finding, analyzing and evaluating information found through many queries. Typical search systems, on the other hand, are designed to support single query, precision-oriented search tasks. We describe a search interface and system design of a multisession exploratory search system, discuss design challenges encountered, and chronicle the evolution of our design. Our design describes novel displays for visualizing retrieval history information, and introduces ambient displays and persuasive elements to interactive information retrieval.

Proceedings of the 15th ACM international conference on Multimedia, 2007

) is an indoor, real-time, multi-camera surveillance system, deployed in a real office setting. D... more ) is an indoor, real-time, multi-camera surveillance system, deployed in a real office setting. DOTS combines video analysis and user interface components to enable security personnel to effectively monitor views of interest and to perform tasks such as tracking a person. The video analysis component performs feature-level foreground segmentation with reliable results even under complex conditions. It incorporates an efficient greedy-search approach for tracking multiple people through occlusion and combines results from individual cameras into multi-camera trajectories. The user interface draws the users' attention to important events that are indexed for easy reference. Different views within the user interface provide spatial information for easier navigation. DOTS, with over twenty video cameras installed in hallways and other public spaces in our office building, has been in constant use for a year. Our experiences led to many changes that improved performance in all system components.

Embedded media markers

Proceedings of the 15th international conference on Intelligent user interfaces, 2010

Embedded Media Markers, or simply EMMs, are nearly transparent iconic marks printed on paper docu... more Embedded Media Markers, or simply EMMs, are nearly transparent iconic marks printed on paper documents that signify the existence of media associated with that part of the document. EMMs also guide users' camera operations for media retrieval. Users take a picture of an EMMsignified document patch using a cell phone, and the media associated with the EMM-signified document location is displayed on the phone. Unlike bar codes, EMMs are nearly transparent and thus do not interfere with the document contents. Retrieval of media associated with an EMM is based on image local features of the captured EMMsignified document patch. This paper describes a technique for semi-automatically placing an EMM at a location in a document, in such a way that it encompasses sufficient identification features with minimal disturbance to the original document.

The virtual factory: Exploring 3D worlds as industrial collaboration and control environments

2010 IEEE Virtual Reality Conference (VR), 2010

This project investigates practical uses of virtual, mobile, and mixed reality systems in industr... more This project investigates practical uses of virtual, mobile, and mixed reality systems in industrial settings, in particular control and collaboration applications for factories. In collaboration with TCHO, a chocolate maker start-up in San Francisco, we have built virtual mirror-world representations of a real-world chocolate factory and are importing its data and modeling its processes. The system integrates mobile devices such as cell phones and tablet computers. The resulting "virtual factory" is a cross-reality environment designed for simulation, visualization, and collaboration, using a set of interlinked, real-time 3D and 2D layers of information about the factory and its processes.

Looking ahead

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval, 2013

ABSTRACT Exploratory search is a complex, iterative information seeking activity that involves ru... more ABSTRACT Exploratory search is a complex, iterative information seeking activity that involves running multiple queries and finding and examining many documents. We designed a query preview control that visualizes the distribution of newly-retrieved and re-retrieved documents prior to running the query. When evaluating the preview control with a control condition, we found effects on both people&#39;s information seeking behavior and improved retrieval performance. People spent more time formulating a query and were more likely to explore search results more deeply, retrieved a more diverse set of documents, and found more different relevant documents when using the preview.