Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Conclusion
References

Social capabilities for autonomous virtual characters

Profile image of Catherine PelachaudCatherine Pelachaud

2006

Abstract

Abstract. In this paper we describe our work toward the creation of affective multimodal virtual characters endowed with communicative and other socially significant capabilities. While much work in modern game AI has focused on issues such as path-finding and squad-level AI, more highly-detailed behaviour for small groups of interacting game characters has been lacking in the literature.

Related papers

Expressive virtual characters for social demonstration games
Christopher Edward Peters

2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), 2017

, Fig. 1: The Unity-based behavior toolkit supports the animation of facial expressions, body animations and group formations of virtual characters focussed on the development of social games.

View PDFchevron_right
Simulation of the dynamics of virtual characters' emotions and social relations
N. Sabouret

2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, 2009

One of the main challenges is to give life to believable virtual characters. Research shows that emotions and social relations, closely related, play a key role in determining the behavior of individuals. In order to improve the believability of virtual characters' behavior, we propose in this article a method to compute virtual characters emotions based on attitudes and a model of their influence on the dynamics of social relations. Based on this work, a tool aiming at the simulation of the evolution of emotions and social relations of virtual characters have been implemented.

View PDFchevron_right
Building Smart Embodied Virtual Characters
Elisabeth André

Lecture Notes in Computer Science, 2003

Embodied conversational characters are autonomous, graphically embodied virtual creatures that live in a 2D or 3D virtual environment. They are able to interact intelligently with human users, other characters, and their digital environment. While for decades research has concentrated on geometric body modelling and the development of animation and rendering techniques for virtual characters, other qualities have now come in focus as well, including the provision of conversational skills as well as the simulation of believable behavior including affect and peculiarities induced by individual personality traits. As a consequence, the domain of virtual characters has become much more diverse and now encompasses a wide range of disciplines, from computer graphics and animation to AI and more recently also psychology, sociology as well as design and arts. The current paper discusses a number of design issues that arise when building an application with one or more embodied characters. By means of selected sample applications we also illustrate a yet ongoing development of animated presentation agents starting with TV-style information presenters to highly interactive multi-character scenarios in which information is conveyed to the user in the form of multi-party conversations.

View PDFchevron_right
Emotional Communication with Virtual Humans
Nadia Thalmann

International Journal of Computer-supported Collaborative Learning, 2003

In this paper, we present our approach to modelling perceptive 3D virtual characters with emotion and personality. The characters are powered by a di- alogue system that consists of a large set of ba- sic interactions between the user and the computer. These interactions are encoded in finite state ma- chines. The system is integrated with an expres- sion recognition

View PDFchevron_right
A Six Dimensional Paradigm for Generating Emotions in Virtual Characters
Penny de Byl

International Journal of Intelligent Games & Simulation, 2003

The paper outlines an emotionally intelligent agent design for use in computer games. The agent is designed to provide users with a rationally unpredictable adversary or companion in virtual environments. An overview of the agent's emotional assessment mechanism are given followed by an assessment of the agent when used to model a computerized pet dog.

View PDFchevron_right
Creating Playable Social Experiences through Whole-Body Interaction with Virtual Characters
Daniel Shapiro

Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment

This paper describes work towards the goal of enabling unscripted interaction with non-player characters in virtual environments. We hypothesize that we can define a layer of social affordances, based on physical and non-verbal signals exchanged between individuals and groups, which can be reused across games. We have implemented a first version of that substrate that employs whole body interaction with virtual characters and generates nuanced, real-time character performance in response. We describe the playable experience produced by the system, the implementation architecture (based on the behavior specification technology used in Façade, the social model employed in Prom Week, and gesture recognition technology), and illustrate the key behaviors and programming idioms that enable character performance. These idioms include orthogonal coding of attitudes and activities, use of relational rules to nominate social behavior, use of volition rules to rank options, and priority ba...

View PDFchevron_right
Socially communicative characters for interactive applications
Steve DiPaola

2006

ABSTRACT Interactive Face Animation-Comprehensive Environment (iFACE) is a general-purpose software framework that encapsulates the functionality of “face multimedia object” for a variety of interactive applications such as games and online services. iFACE exposes programming interfaces and provides authoring and scripting tools to design a face object, define its behaviours, and animate it through static or interactive situations.

View PDFchevron_right
A personality-based emotional model for embodied conversational agents: Effects on perceived social presence and game experience of users
Stefan Kopp

Entertainment Computing, 2019

This paper reports on an experiment that investigates the effect of interacting with a personality-driven embodied conversational agent (ECA) on the perceived social presence and game experience of people in a VR social simulator. Furthermore, the dynamics between the different metrics of game experience and social presence of people are explored to determine which game experience metrics are the strongest predictors of perceived social presence in this context. A personality-based emotional model is used for personifying the employed ECA, which governs the manifestation of its non-verbal behaviors. Three experimental conditions manipulating the existence and intensity of non-verbal behaviors exhibited by the ECA were used to investigate the effect of this proposed approach. The results of the experiment with 41 participants indicate that people who were exposed to an extrovert ECA experienced significantly higher levels of behavioral involvement as part of their social presence compared to the other conditions. These results suggest that incorporating personality by means of non-verbal behavior in the emotional model of an ECA influences users perceived feeling of social presence. Furthermore, our results reveal that there is a bidirectional relationship between game experience metrics and perceived social presence of people as each predict the other.

View PDFchevron_right
Virtual Humans and Social Interaction
Juan Barbosa

2009

We thought that, virtual reality cannot merely be reduced to a hardware system, another way to achieve the optimal experience, is to produce a sense of immersion associated to an emotional and social experience inside the virtual environment. We believe that Virtual Characters that express a social and emotional behavior in their interaction could produce a sense of immersion in the user that interact with them. We propose to use this kind of character to develop social and emotional interfaces, capable to produce a believable Social Interaction.

View PDFchevron_right
Affective and social behavior in animated agents
M. Ishizuka

Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569), 2001

This paper introduces a model of interaction between users and animated agents as well as inter-agent interaction that supports basic features of affective conversation and social interaction. As essential requirements for animated agents' capability to engage in and exhibit affective and social communication we motivate reasoning about emotions and emotion expression, personality, and social role awareness. The main contribution of our paper is the incorporation of 'social filter programs' to mental models of animated agents. Those programs may qualify an agent's expression of its emotional state by the social context, thereby enhancing the agent's believability as a conversational partner. Our implemented system is entirely web-based and demonstrates animated agents with affective and social behavior in a virtual coffee shop environment.

View PDFchevron_right

References (45)

  1. J. Allwood, J. Nivre, and E. Ahlsn. On the semantics and pragmatics of linguistic feedback. Semantics, 9(1), 1993.
  2. Electronic Arts. The sims.
  3. G. Barrier, J. Caelen, and B. Meillon. La visibilité des gestes: Paramètres directionnels, intentionnalité du signe et attribution de pertinence. In Workshop Franc ¸ais sur les Agents Conversationnels Animés, pages 113-123, Grenoble, France, 2005.
  4. J. Bates. The role of emotion in believable agents. Commun. ACM, 37(7):122-125, 1994.
  5. G. Calbris. L'expression gestuelle de la pensée d'un homme politique. CNRS Editions, 2003.
  6. L. Cañamero. Emotions in Humans and Artifacts, chapter Designing Emotions for Activity Selection in Autonomous Agents, pages 115-148. MIT Press, 2003.
  7. N. Chovil. Social determinants of facial displays. Journal of Nonverbal Behavior, 15(3):141- 154, Fall 1991.
  8. C. Crawford. On Game Design. New Riders Games, 2003.
  9. B. DeCarolis, C. Pelachaud, I. Poggi, and M. Steedman. Apml, a mark-up language for believable behavior generation. In Helmut Prendinger and Mitsuru Ishizuka, editors, Life- Like Characters, Cognitive Technologies. Springer, 2004.
  10. P. Ekman. About brows: Emotional and conversational signals. In M. von Cranach, K. Foppa, W. Lepenies, and D. Ploog, editors, Human ethology: Claims and limits of a new discipline: contributions to the Colloquium, pages 169-248. Cambridge University Press, Cambridge, England; New-York, 1979.
  11. C. Elliot. The Affective Reasoner: A process model of emotions in a multi-agent system. Computer science, Northwestern University, 1992.
  12. D. Friedman and M. Gillies. Teaching virtual characters to use body language. In Intelligent Virtual Agents, Lecture Notes in Artificial Intelligence. Springer-Verlag, 2005.
  13. J. Funge. Artificial Intelligence For Computer Games: An Introduction. AK Peters, Welles- ley, MA, July 2004.
  14. E. Goffman. Behaviour in public places: notes on the social order of gatherings. The Free Press, New York, 1963.
  15. J. Gratch. Emile: Marshalling passions in training and education. In The Fourth International Conference on Autonomous Agents, pages 325-332, Barcelona, Catalonia, Spain, 2000.
  16. M. Gullberg and K. Holmqvist. Keeping an eye on gestures: Visual perception of gestures in face-to-face communication. Pragmatics and Cognition, 7:35-63, 1999.
  17. Bjoern Hartmann, Maurizio Mancini, and Catherine Pelachaud. Towards affective agent action: Modelling expressive ECA gestures. In Proceedings of the IUI Workshop on Affective Interaction, San Diego, CA, January 2005.
  18. K. Isbister. Better Game Characters by Design: A Psychological Approach. Elsevier Science and Technology Books, 2006.
  19. L. Itti. Models of Bottom-Up and Top-Down Visual Attention. PhD thesis, California Institute of Technology, Jan 2000.
  20. A. Kendon. Movement coordination in social interaction: Some examples described. In S. Weitz, editor, Nonverbal Communication. Oxford University Press, 1974.
  21. J. E. Laird and M. van Lent. Human-level AI's killer application: Interactive computer games. In AAAI/IAAI, pages 1171-1178, 2000.
  22. T. Leonard. Building an ai sensory system -examining the design of thief -the dark project. In Proceedings of Game Developers Conference 2003, San Francisco, California, 2003. CMP Game Media Group.
  23. R. M. Maatman, J. Gratch, and S. Marsella. Natural behavior of a listening agent. In 5th International Conference on Interactive Virtual Agents. Kos, Greece, 2005.
  24. M. Mateas and A. Stern. Fac ¸ade: An experiment in building a fully-realized interactive drama. In Game Developers Conference, Game Design track, March 2003.
  25. D. McNeill. Hand and Mind: What Gestures Reveal about Thought. University of Chicago, 1992.
  26. Magalie Ochs, Radoslaw Niewiadomski, Catherine Pelachaud, and David Sadek. Intelligent expressions of emotions. In Jianhua Tao, Tieniu Tan, and Rosalind W. Picard, editors, The 1st International Conference on Affective Computing and Intelligent Interaction (ACII'05), pages p. 707-714, Beijing, China, 2005. Springer.
  27. A. Ortony, G.L. Clore, and A. Collins. The cognitive structure of emotions. Cambridge University Press, 1988.
  28. C. Pelachaud and M. Bilvi. Computational model of believable conversational agents. In Marc-Philippe Huget, editor, Communication in Multiagent Systems, volume 2650 of Lecture Notes in Computer Science, pages 300-317. Springer-Verlag, 2003.
  29. C. Pelachaud, V. Carofiglio, B. De Carolis, and F. de Rosis. Embodied contextual agent in information delivering application. In First International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS), Bologna, Italy, July 2002.
  30. D.I. Perrett and N.J. Emery. Understanding the intentions of others from visual signals: neurophysiological evidence. Current Psychology of Cognition, 13:683-694, 1994.
  31. C. Peters. Bottom-Up Visual Attention for Autonomous Virtual Human Animation. PhD thesis, Department of Computer Science, Trinity College Dublin, 2004.
  32. C. Peters. Direction of attention perception for conversation initiation in virtual environ- ments. In International Working Conference on Intelligent Virtual Agents, pages 215-228, Kos, Greece, September 2005.
  33. C. Peters. Evaluating perception of interaction initiation in virtual environments using hu- manoid agents. In Proceedings of the 17th European Conference on Artificial Intelligence, pages 46-50, Riva Del Garda, Italy, August 2006.
  34. R. Picard. Affective Computing. MIT Press, 1997.
  35. I. Poggi. Mind markers. In N. Trigo M. Rector, I. Poggi, editor, Gestures. Meaning and use. University Fernando Pessoa Press, Oporto, Portugal, 2003.
  36. I. Poggi. Backchannel: from humans to embodied agents. In Conversational Informatics for Supporting Social Intelligence and Interaction -Situational and Environmental Information Enforcing Involvement in Conversation workshop in AISB'05. University of Hertfordshire, Hatfield, England, 2005.
  37. F. E. Pollick. The features people use to recognize human movement style. In A. Camurri and G. Volpe, editors, Gesture-Based Communication in Human-Computer Interaction -GW 2003, number 2915 in LNAI, pages 10-19. Springer, 2004.
  38. A. S. Rao and M.P. Georgeff. Modeling rational agents within a bdi-architecture. In Proceed- ings of International Conference on Principles of Knowledge Representation and Reasoning (KR), pages 473-484, San Mateo, CA, USA, 1991.
  39. S. Reilly. Believable Social and Emotional Agents. Computer science, University of Carnegie Mellon, 1996.
  40. C. W. Reynolds. Interaction with groups of autonomous characters. In Proceedings of Game Developers Conference 2000, pages 449-460, San Francisco, California, 2000. CMP Game Media Group.
  41. Z. Ruttkay and C. Pelachaud. Exercises of style for virtual humans. In Symposium of the AISB'02 Convention, volume Volume Animating Expressive Characters for Social Interac- tions, London, 2002.
  42. A.E. Scheflen. The significance of posture in communication systems. Psychiatry, 27, 1964.
  43. K. Scherer. Introduction to Social Psychology: A European perspective, chapter Emotion. Oxford, 2000.
  44. A. Stern. Emotions in Humans and Artifacts, chapter Creating emotional relationships with virtual characters. MIT Press, 2003.
  45. H. G. Wallbott and K. R. Scherer. Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51(4):690-699, 1986.

Related papers

Imparting individuality to virtual humans
Arjan Egges, Nadia Magnenat-halmann

2002

In this paper, we present an integrated method of linking personality and emotion with the response generation and expression synthesis of Virtual Humans. The characters are powered by a dialogue system that consists of a large set of basic interactions between user and computer. These interactions are encoded in finite state machines. Transitions are linked with conditions and actions that can be connected with external modules. One of these modules is a personality module. In this way, responses of the virtual human depend not only on input given by a user, but also on its personality and emotional state. The dialogue system is connected to a 3D face that performs the speech and facial animation, together with facial expressions that reflect the personality specification.

View PDFchevron_right
Interactive expressive virtual characters: challenges for conducting experimental studies about multimodal social interaction
Matthieu Courgeon

2012

ABSTRACT Advanced studies about social interaction address several challenges of virtual character research. In this paper, we focus on the two following capacities of virtual characters that are the focus of research in human-computer interaction and affective computing research: 1) realtime social interaction, and 2) multimodal expression of social signals.

View PDFchevron_right
An emotional architecture for virtual characters
Angélica de Antonio

… Using Virtual Reality Technologies for Storytelling, 2005

This paper presents the mechanisms proposed by a generic cognitive architecture for virtual characters with emotional influenced behaviors, called cognitiva, to maintain behavior control at will without giving up the richness provided by emotions. This architecture, together with a progressive specification process for its application, have been used successfully to model 3D intelligent virtual actors for virtual storytelling.

View PDFchevron_right
Modelling socially intelligent virtual humans
Nadia Magnenat-thalmann

2009

Emotions are one of the important mechanisms to control the behavior of virtual characters both for the reason of giving them a personality as well as automatically producing animations by simulating their internal dynamics. In our talk, we will define what is needed to model personality, mood and emotion, we will describe memory processes and show how far it is

View PDFchevron_right
Affective Multimodal Control of Virtual Characters
Patrick Gebhard

International Journal of Virtual Reality, 2020

In this paper we report about the use of computer generated affect to control body and mind of cognitively modeled virtual characters. We use the computational model of affect ALMA that is able to simulate three different affect types in real-time. The computation of affect is based on a novel approach of an appraisal language. Both the use of elements of the appraisal language and the simulation of different affect types has been evaluated. Affect is used to control facial expressions, facial complexions, affective animations, posture, and idle behavior on the body layer and the selection of dialogue strategies on the mind layer. To enable a fine-grained control of these aspects a Player Markup Language (PML) has been developed. The PML is player-independent and allows a sophisticated control of character actions coordinated by high-level temporal constraints. An Action Encoder module maps the output of ALMA to PML actions using affect display rules. These actions drive the real-ti...

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved