The design and implementation of a portable meeting recorder is presented. Composed of an omni-di... more The design and implementation of a portable meeting recorder is presented. Composed of an omni-directional video camera with four-channel audio capture, the system saves a view of all the activity in a meeting and the directions from which people spoke. Subsequent analysis computes metadata that includes video activity analysis of the compressed data stream and audio processing that helps locate events that occurred during the meeting. Automatic calculation of the room in which the meeting occurred allows for efficient navigation of a collection of recorded meetings. A user interface is populated from the metadata description to allow for simple browsing and location of significant events.
Our contextual inquiry into the practices of oral historians unearthed a curious incongruity. Whi... more Our contextual inquiry into the practices of oral historians unearthed a curious incongruity. While oral historians consider interview recordings a central historical artifact, these recordings sit unused after a written transcript is produced. We hypothesized that this is largely because books are more usable than recordings. Therefore, we created Books with Voices: bar-code augmented paper transcripts enabling fast, random access to digital video interviews on a PDA. We present quantitative results of an evaluation of this tangible interface with 13 participants. They found this lightweight, structured access to original recordings to offer substantial benefits with minimal overhead. Oral historians found a level of emotion in the video not available in the printed transcript. The video also helped readers clarify the text and observe nonverbal cues.
Proceedings of the SIGCHI conference on Human …, Jan 1, 1999
Over the last two centuries, reading styles have shifted away from the reading of documents from ... more Over the last two centuries, reading styles have shifted away from the reading of documents from beginning to end and toward the skimming of documents in search of relevant information. This trend continues today where readers, often confronted with an insurmountable amount of text, seek more efficient methods of extracting relevant information from documents. In this paper, a new document reading environment is introduced called the Reader's Helper TM , which supports the reading of electronic and paper documents. The Reader's Helper analyzes documents and produces a relevance score for each of the reader's topics of interest, thereby helping the reader decide whether the document is actually worth skimming or reading. Moreover, during the analysis process, topic of interest phrases are automatically annotated to help the reader quickly locate relevant information. A new information visualization tool, called the Thumbar TM , is used in conjunction with relevancy scoring and automatic annotation to portray a continuous, dynamic thumb-nail representation of the document. This further supports rapid navigation of the text.
Our contextual inquiry into the practices of oral historians unearthed a curious incongruity. Whi... more Our contextual inquiry into the practices of oral historians unearthed a curious incongruity. While oral historians consider interview recordings a central historical artifact, these recordings sit unused after a written transcript is produced. We hypothesized that this is largely because books are more usable than recordings. Therefore, we created Books with Voices: bar-code augmented paper transcripts enabling fast, random access to digital video interviews on a PDA. We present quantitative results of an evaluation of this tangible interface with 13 participants. They found this lightweight, structured access to original recordings to offer substantial benefits with minimal overhead. Oral historians found a level of emotion in the video not available in the printed transcript. The video also helped readers clarify the text and observe nonverbal cues.
We introduce query-free information retrieval, a paradigm in which queries are constructed autono... more We introduce query-free information retrieval, a paradigm in which queries are constructed autonomously and information relevant to a user is offered without explicit request. Query-free methods offer an apparently new approach for integrating knowledge-based applications with legacy databases. We describe a fielded system, FIXIT, which integrates an expert diagnostic system with a pre-existing fulltext database of maintenance manuals. The reported results suggest that queryfree information retrieval can liberate the user from burdensome information retrieval activities while incurring only modest system development costs and minimal run-time costs.
Video Paper is a prototype system for multimedia browsing, analysis, and replay. Key frames extra... more Video Paper is a prototype system for multimedia browsing, analysis, and replay. Key frames extracted from a video recording are printed on paper together with bar codes that allow for random access and replay. A transcript for the audio track can also be shown so that users can read what was said, thus making the document a stand-alone representation for the contents of the multimedia recording. The Video Paper system has been used for several applications, including the analysis of recorded meetings, broadcast news, oral histories and personal recordings. This demonstration will show how the Video Paper system was applied to these domains and the various replay systems that were developed, including a self-contained portable implementation on a PDA and a fixed implementation on desktop PC.
… Electronics, 2002. ICCE. 2002 Digest of …, Jan 1, 2002
A paper-based method for browsing, retrieving, and viewing video programs is described. A printed... more A paper-based method for browsing, retrieving, and viewing video programs is described. A printed form of the transcript for a TV program is provided that's formatted for easy browsing. The printout is annotated with bar codes that provide links to the corresponding position in the video recording. A remote control device is used for scanning the bar codes and controlling the replay of the video either on the remote control itself or on a video monitor. This paper describes an implementation of this method using a Pocket PC with a bar code reader as the remote control device and an archive of TV programs on the Pocket PC or an external server.
The components of a key frame selection algorithm for a paper-based multimedia browsing interface... more The components of a key frame selection algorithm for a paper-based multimedia browsing interface called Video Paper are described. Analysis of video image frames is combined with the results of processing the closed caption to select key frames that are printed on a paper document together with the closed caption. Bar codes positioned near the key frames allow a user to play the video from the corresponding times. This paper describes several component techniques that are being investigated for key frame selection in the Video Paper system, including face detection and text recognition. The Video Paper system implementation is also discussed.
A new method for augmenting paper documents with electronic information is described that does no... more A new method for augmenting paper documents with electronic information is described that does not modify the format of the paper document in any way. Applicable to both commercially printed documents as well as documents that are output from PC's, the technique we call Paper-Based Augmented Reality substantially improves the utility of paper. We describe the recognition technology that makes this possible as well as several applications. An implementation on a camera phone is discussed that lets users retrieve data and access links from paper documents to electronic data. Recognition is performed at 4 frames per second on a Treo 700w and support is provided for several user applications, including "clickable paper" -printed web pages whose appearance is unchanged but that can be navigated with a camera phone.
A paper-based interface for browsing video is proposed. A paper document shows key frames selecte... more A paper-based interface for browsing video is proposed. A paper document shows key frames selected from a video, a transcript for the parallel audio track, and bar codes that, when scanned, invoke a multimedia player. The paper document provides a stand-alone representation for a video recording that lets a user both understand the content of the file and replay only selected parts of the multimedia that are necessary to gain a better understanding. This approach applies the twodimensional display characteristics of a newspaper to multimedia retrieval. By so doing, the user's browsing and search efficiency is greatly improved. This poster describes an implementation of the Video Paper system using a Pocket PC with a bar code reader as the remote control device and an archive of TV programs on the Pocket PC or an external server.
CHI'08 extended abstracts on Human factors in …, Jan 1, 2008
For more than half a century, musicians used artwork as a way of visually describing the contents... more For more than half a century, musicians used artwork as a way of visually describing the contents of an album. "Cover art" attracts attention, reminds the listener of the contents, and when printed on the album cover, provides a tangible representation of the music that's easily used for organization and sharing. Over the past few decades, the benefits of the physical album "package" were lost as it changed from a 12 inch vinyl album to an electronic file and thumbnail image downloaded from an online music store. In this demonstration we present a tangible user interface called iCandy that restores the benefits of physical albums for the electronic music in the iTunes multimedia application and provides a method for easy access to recorded media. The system also includes several desktop visualizations that enhance the overall experience especially when dealing with large collections of music and video.
Visual search connects physical (offline) objects with (online) digital media. Using objects from... more Visual search connects physical (offline) objects with (online) digital media. Using objects from the environment, like newspapers, magazines, books and posters, we can retrieve supplemental information from the online world. In this demonstration, we show a framework for delivering visual search services to users of mobile devices. We show how users can point a mobile device at any location in a document, magazine or book to view related, online material on the device. We describe client applications now being deployed for the iPhone and the server architecture used for recognition of scanned images.
Uploads
Papers by Jamey Graham