Papers by Andi Winterboer
Being interrupted by notifications and reminders is common while working. In this study we consid... more Being interrupted by notifications and reminders is common while working. In this study we consider whether system politeness reduces (negative) effects of being interrupted by system requests. We carried out a 2 (polite vs. neutral system request) x 2 (high vs. low mental load) between-participants experiment. We measured annoyance, frustration and mental effort. Our results suggest that social strategies can mitigate some of the negative effects, but that this depends on the difficulty of the task. We discuss the implications of these results for the design of interruptive system messages and for further research into social computing. Author Keywords Task interruption; text message; social strategies; mental workload; social computing; cognitive overload; ACM Classification Keywords H.5.m. Information interfaces and presentation (e.g.,
Evaluating
the effect of information presentation strategies on task success and user perceptions

In spoken dialog systems, information must be presented sequentially, making it difficult to quic... more In spoken dialog systems, information must be presented sequentially, making it difficult to quickly browse through a large number of options. Recent studies have shown that user satisfaction is negatively correlated with dialog duration, suggesting that systems should be designed to maximize the efficiency of the interactions. Analysis of the logs of 2,000 dialogs between users and nine different dialog systems reveals that a large percentage of the time is spent on the information presentation phase, thus there is potentially a large pay-off to be gained from optimizing information presentation in spoken dialog systems. This article proposes a method that improves the efficiency of coping with large numbers of diverse options by selecting options and then structuring them based on a model of the user’s preferences. This enables the dialog system to automatically determine trade-offs between alternative options that are relevant to the user and present these trade-offs explicitly. ...
We report the results of a Wizard-of-Oz (WoZ) study comparing two approaches to presenting inform... more We report the results of a Wizard-of-Oz (WoZ) study comparing two approaches to presenting information in a spoken dialogue system generating flight recommendations. We found that recommendations presented using the user-model based summarize and refine (UMSR) approach enable more efficient information retrieval than the data-driven summarize and refine (SR) approach. In addition, user ratings on four evaluation criteria showed aclear preference for recommendations based on the UMSR approach.
Abstract. Previous research on spatial projective terms such as to the left (of) and in front (of... more Abstract. Previous research on spatial projective terms such as to the left (of) and in front (of) typically focuses on static (locative) usages. We address the usage of such expressions in dynamic contexts (i.e., as directionals). As part of our general aim of developing a speech interface for allowing intuitive control of a mobile robot in navigation tasks, we implemented a carefully selected subset of interpretations of directional terms in a robotic system. The system was validated and gradually improved by experiments involving spontaneous directional instructions by users who were not informed about the robot's capabilities. 1.
In this paper we examine the effect of linguistic devices on recall and comprehension in informat... more In this paper we examine the effect of linguistic devices on recall and comprehension in information presentation using both recall and eye-tracking data. In addition, the results were validated via an experiment using Amazon's Mechanical Turk micro-task environment.
This paper presents results of a Wizard-of-Oz (WoZ) study examining the effect of two different i... more This paper presents results of a Wizard-of-Oz (WoZ) study examining the effect of two different information presentation methods on a secondary task, namely driving. The results demonstrate that the user-model based summarize and refine (UMSR) approach enables more efficient information retrieval in comparison to the data-driven summarize and refine (SR) approach, and does not negatively affect driving performance.
In this paper we present results of a Wizard-of-Oz (WoZ) experiment comparing two approaches to i... more In this paper we present results of a Wizard-of-Oz (WoZ) experiment comparing two approaches to information presentation in spoken dialogue systems. We show that the usermodel based summarizeand-refine (UMSR) approach leads to increased task efficiency in comparison with the summarize-andrefine (SR) approach. Moreover, user ratings on four evaluation criteria demonstrated a clear preference for recommendations based on the UMSR approach to information presentation. 123

A common task for spoken dialogue systems (SDS) is to help users select a suitable option (e.g., ... more A common task for spoken dialogue systems (SDS) is to help users select a suitable option (e.g., flight, hotel, restaurant) from the set of options available. When the number of options is small, they can simply be presented sequentially. However, as the number of options increases, the system must have strategies for helping users browse the space of available options. In this thesis, I compare two approaches to information presentation in SDS: (1) the summarize and refine (SR) approach (Polifroni et al., 2003; Polifroni, 2008) in which the summaries are generated by clustering the options based on attributes that lead to the smallest number of clusters, and (2) the user-model based summarize and refine (UMSR) approach (Demberg, 2005; Demberg and Moore, 2006) which employs a user model to cluster options based on attributes that are relevant to the user and uses coherence markers (e.g., connectives, discourse cues, adverbials) to highlight the trade-offs among the presented items. ...
INTERSPEECH 2007, 8th Annual Conference of the International Speech Communication Association, Antwerp, Belgium, August 27-31, 2007
Robotics and Autonomous Systems
Do discourse cues facilitate recall in information presentation messages?
Proceedings of the 12th European Workshop on Natural Language Generation (ENLG 2009)}, 2009
Augmentative and Alternative Communication (AAC) systems are communication aids for people who ca... more Augmentative and Alternative Communication (AAC) systems are communication aids for people who cannot speak because of motor or cognitive impairments. We are developing AAC systems where users select information they wish to communicate, and this is expressed using an NLG system. We believe this model will work well in contexts where AAC users wish to go beyond simply making requests or answering questions, and have more complex communicative goals such as story-telling and social interaction.

Emotion has been found to influence humans’ cognitive information processing and decision-making ... more Emotion has been found to influence humans’ cognitive information processing and decision-making (Schwarz, 2000). A state of sadness, for example, is accompanied by substantive information processing, with greater attention to detail, whereas people in a happier state tend to process information more heuristically. Mobile applications or services presenting information to users, especially those used primarily in emotionally laden contexts, could adapt information presentation to users’ current emotional state to improve compliance. This paper reports the results of an 2x2 between-subject survey experiment (N=91) with affective state (happy vs. sad) and information presentation style (heuristic vs. substantive) as dimensions. The results confirm that participants in a sad affective state are more likely to comply with mobile agents’ advice when information is tailored to a substantive processing style. They base decisions on substantive information and provide longer descriptions. I...
Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, 2007
A 2x2 enhanced Wizard-of-Oz experiment (N = 32) was conducted to compare two different approaches... more A 2x2 enhanced Wizard-of-Oz experiment (N = 32) was conducted to compare two different approaches to presenting information to drivers in easy and difficult driving conditions. Data of driving safety, evaluation of the spoken dialogue system, and perception of self were analyzed. Results show that the user-modeled summarizeand-refine (UMSR) approach led to more efficient information retrieval than did the summarize-and-refine (SR) approach. However, depending on driving condition, higher efficiency did not always translate into pleasant subjective experience. Implications for usability testing and interface design were presented, followed by discussions of future research directions.
Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, 2007
A 2x2 enhanced Wizard-of-Oz experiment (N = 32) was conducted to compare two different approaches... more A 2x2 enhanced Wizard-of-Oz experiment (N = 32) was conducted to compare two different approaches to presenting information to drivers in easy and difficult driving conditions. Data of driving safety, evaluation of the spoken dialogue system, and perception of self were analyzed. Results show that the user-modeled summarizeand-refine (UMSR) approach led to more efficient information retrieval than did the summarize-and-refine (SR) approach. However, depending on driving condition, higher efficiency did not always translate into pleasant subjective experience. Implications for usability testing and interface design were presented, followed by discussions of future research directions.
Canary in a coal mine
Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems - CHI EA '11, 2011
We present an application that facilitates environmental monitoring by and for the general public... more We present an application that facilitates environmental monitoring by and for the general public. 'Canary in a Coal Mine' (CIACM) gathers and analyses pollution-related tweets in real-time from the micro-blogging platform Twitter and visualizes temporal and spatial characteristics of the data. CIACM allows citizens to keep track of the environmental quality of their region and empowers users to contribute to
The user model-based summarize and refine approach improves information presentation in spoken dialog systems
A common task for spoken dialog systems (SDS) is to help users select a suitable option (eg, flig... more A common task for spoken dialog systems (SDS) is to help users select a suitable option (eg, flight, hotel, and restaurant) from the set of options available. As the number of options increases, the system must have strategies for generating summaries that enable the user to browse the option space efficiently and successfully. In the user-model based summarize and refine approach (UMSR, Demberg and Moore, 2006), options are clustered to maximize utility with respect to a user model, and linguistic devices such as discourse cues and ...
Motion Encoding in Language and …, Jan 1, 2008
We present an application that facilitates environmental monitoring by and for the general public... more We present an application that facilitates environmental monitoring by and for the general public. ‘Canary in a Coal Mine’ (CIACM) gathers and analyses pollution- related tweets in real-time from the micro-blogging platform Twitter and visualizes temporal and spatial characteristics of the data. CIACM allows citizens to keep track of the environmental quality of their region and empowers users to contribute to this public environmental monitoring system.
Uploads
Papers by Andi Winterboer