Predicting Player Experience without the Player
Proceedings of the Annual Symposium on Computer-Human Interaction in Play
https://doi.org/10.1145/3116595.3116631Abstract
A key challenge of procedural content generation (PCG) is to evoke a certain player experience (PX), when we have no direct control over the content which gives rise to that experience. We argue that neither the rigorous methods to assess PX in HCI, nor specialised methods in PCG are sufficient, because they rely on a human in the loop. We propose to address this shortcoming by means of computational models of intrinsic motivation and AI game-playing agents. We hypothesise that our approach could be used to automatically predict PX across games and content types without relying on a human player or designer. We conduct an exploratory study in level generation based on empowerment, a specific model of intrinsic motivation. Based on a thematic analysis, we find that empowerment can be used to create levels with qualitatively different PX. We relate the identified experiences to established theories of PX in HCI and game design, and discuss next steps.
References (57)
- S. Abuhamdeh, M. Csikszentmihalyi, and B. Jalal. 2015. Enjoying the Possibility of Defeat: Outcome Uncertainty, Suspense, and Intrinsic Motivation. Motiv. Emot. 39, 1 (2015), 1-10.
- R. Agarwal and E. Karahanna. 2000. Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage. MIS quarterly (2000), 665-694.
- T. Anthony, D.l Polani, and C. L. Nehaniv. 2014. General Self-Motivation and Strategy Identification: Case Studies Based on Sokoban and Pac-Man. IEEE T-CIAIG 6, 1 (2014), 1-17.
- P. Bontrager, A. Khalifa, A. Mendes, and J. Togelius. 2016. Matching Games and Algorithms for General Video Game Playing. In Proc. Conf. AIIDE.
- E. A. Boyle, T. M. Connolly, T. Hainey, and J. M. Boyle. 2012. Engagement in Digital Entertainment Games: A Systematic Review. Computers in Human Behavior 28, 3 (2012), 771-780.
- V. Braun and V. Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Psychology 3, 2 (2006), 77-101.
- R. Caillois. 1961. Man, Play and Games. University of Illinois Press.
- P. Cairns, A. Cox, and A. I. Nordin. 2014. Immersion in Digital Games: Review of Gaming Experience Research. Handbook of Digital Games (2014), 337-361.
- M. Cook, M. Eladhari, A. Nealen, M. Treanor, E. Boxerman, A. Jaffe, P. Sottosanti, and S. Swink. 2016. PCG-Based Game Design Patterns. arXiv preprint arXiv:1610.03138 (2016).
- T. M. Cover and J. A. Thomas. 1991. Elements of Information Theory. Wiley-Interscience.
- A. Cox, P. Cairns, P. Shah, and M. Carroll. 2012. Not Doing But Thinking: The Role of Challenge in the Gaming Experience. In Proc. ACM Conf. CHI. 79-88.
- R. Craveirinha, N. Barreto, and L. Roque. 2016. Towards a Taxonomy for the Clarification of PCG Actors' Roles. In Proc. ACM Conf. CHI Play. 244-253.
- M. Csikszentmihalyi, S. Abuhamdeh, and J. Nakamura. 2014. Flow. In Flow and the Foundations of Positive Psychology. Springer, 227-238.
- A. Denisova and P. Cairns. 2015. The Placebo Effect in Digital Games: Phantom Perception of Adaptive AI. In Proc. ACM Conf. CHI Play. 23-33.
- A. Denisova, C. Guckelsberger, and D. Zendle. 2017. Challenge in Digital Games: Towards Developing a Measurement Tool. In Proc. ACM Conf. CHI.
- C. Guckelsberger and D. Polani. 2014. Effects of Anticipation in Individually Motivated Behaviour on Survival and Control in a Multi-Agent Scenario with Resource Constraints. Entropy 16, 6 (2014), 3357-3378.
- C. Guckelsberger and C. Salge. 2016. Does Empowerment Maximisation Allow for Enactive Artificial Agents?. In Proc. Conf. ALIFE. 704-711.
- C. Guckelsberger, C. Salge, and S. Colton. 2016. Intrinsically Motivated General Companion NPCs. In Proc. IEEE Conf. CIG. 150-157.
- M. Guzdial, N. Sturtevant, and B. Li. 2016. Deep Static and Dynamic Level Analysis: A Study on Infinite Mario. In Experimental AI in Games Workshop, Vol. 3.
- M. Hudson and P. Cairns. 2014. Interrogating Social Presence in Games with Experiential Vignettes. Entertainment Computing 5, 2 (2014), 101-114.
- id Software. 2011. The Elder Scrolls V: Skyrim. Game [Windows, PlayStation 3/4, Xbox 360/One]. (11 Nov 2011). Bethesda Game Studios.
- id Software. 2016. Doom. Game [PC/PS4/XBoxOne]. (13 May 2016). id Software, Richardson, USA.
- C. Jennett, A. L. Cox, P. Cairns, S. Dhoparee, A. Epps, T. Tijs, and A. Walton. 2008. Measuring and Defining the Experience of Immersion in Games. Human Computer Studies 66, 9 (2008), 641-661.
- A. Khalifa, D. Perez-Liebana, S. M. Lucas, and J. Togelius. 2016. General Video Game Level Generation. In Proc. Conf. Genetic and Evolutionary Computation.
- M. Klarkowski, D. Johnson, P. Wyeth, M. McEwan, C. Phillips, and S. Smith. 2016. Operationalising and Evaluating Sub-Optimal and Optimal Play Experiences through Challenge-Skill Manipulation. In Proc. ACM Conf. CHI. 5583-5594.
- C. Klimmt, T. Hartmann, and A. Frey. 2007. Effectance and Control as Determinants of Video Game Enjoyment. Cyberpsychology & Behavior 10, 6 (2007), 845-848.
- A. S. Klyubin, D. Polani, and C. L. Nehaniv. 2008. Keep Your Options Open: An Information-Based Driving Principle for Sensorimotor Systems. PloS one 3, 12 (2008), 1-14.
- A. Liapis, C. Holmgård, G. N. Yannakakis, and J. Togelius. 2015. Procedural Personas as Critics for Dungeon Generation. In Proc. European Conf. Applications of Evolutionary Computation. 331-343.
- T. W. Malone. 1981. Toward a Theory of Intrinsically Motivating Instruction. Cognitive science 5, 4 (1981), 333-369.
- L. E. Nacke. 2013. An Introduction to Physiological Player Metrics for Evaluating Games. In Game Analytics. Springer, 585-619.
- P.-Y. Oudeyer and F. Kaplan. 2008. How Can We Define Intrinsic Motivation?. In Proc. Conf. Epigenetic Robotics. 93-101.
- D. Pavlas, F. Jentsch, E. Salas, S. M. Fiore, and V. Sims. 2012. The Play Experience Scale: Development and Validation of a Measure of Play. Human Factors 54, 2 (2012), 214-225.
- A. Perry. 2016. 'Tegotae' is essential to Nintendo's philosophy on video games -here's what it means. http://www.techinsider.io/ tegotae-is-essential-to-nintendos-philosophy-2016-7. (2016). [Online; accessed 21-July-2016].
- M. Persson. 2010. Infinite Mario Bros. Game [Cross-Platform/Java]. (2010).
- K. Poels, Y. De Kort, and W. Ijsselsteijn. 2007. It Is Always a Lot of Fun!: Exploring Dimensions of Digital Game Experience Using Focus Group Methodology. In Proc. ACM Conf. Future Play. 83-89.
- D. Polani. 2009. Information: Currency of Life? HSFP Journal 3, 5 (2009), 307-316. Issue 3.
- G. Ritchie. 2007. Some Empirical Criteria for Attributing Creativity to a Computer Program. Minds and Machines 17, 1 (2007), 67-99.
- R. M. Ryan and E. L. Deci. 2000. Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. Contemp. Educ. Psych. 25, 1 (2000), 54-67.
- R. M. Ryan, C. S. Rigby, and A. Przybylski. 2006. The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motiv. Emot. 30, 4 (2006), 347-363.
- K. Salen and E. Zimmerman. 2004. Rules of Play: Game Design Fundamentals. MIT Press.
- C. Salge, C. Glackin, and D. Polani. 2014a. Changing the Environment Based on Empowerment as Intrinsic Motivation. Entropy 16, 5 (2014), 2789-2819.
- C. Salge, C. Glackin, and D. Polani. 2014b. Empowerment -an Introduction. Guided Self-Organization: Inception (2014), 67-114.
- T. Schaul. 2013. A Video Game Description Language for Model-Based or Interactive Learning. In Proc. IEEE Conf. CIG. 1-8.
- N. Shaker. 2016. Intrinsically Motivated Reinforcement Learning: A Promising Framework for Procedural Content Generation. In Proc. IEEE Conf. CIG. 1-8.
- G. Smith. 2014. Understanding Procedural Content Generation: a Design-Centric Analysis of the Role of PCG in Games. In Proc. ACM Conf. CHI. 917-926.
- G. Smith and J. Whitehead. 2010. Analyzing the Expressive Range of a Level Generator. In Proc. 2010 Workshop on PCG in Games. 1-7.
- N. Sorenson, P. Pasquier, and S. DiPaola. 2011. A Generic Approach to Challenge Modeling for the Procedural Creation of Video Game Levels. IEEE T-CIAIG 3, 3 (2011), 229-244.
- A. Summerville, S. Snodgrass, M. Guzdial, C. Holmgård, A. K. Hoover, A. Isaksen, A. Nealen, and J. Togelius. 2017. Procedural Content Generation via Machine Learning. arXiv preprint arXiv:1702.00539 (2017).
- J. Takatalo, J. Häkkinnen, J. Kaistinen, and G. Nyman. 2010. Presence, Involvement, and Flow in Digital Games. In Evaluating User Experience in Games. Concepts and Methods, R. Bernhaupt (Ed.). Springer, 23-46.
- J. Togelius, R. De Nardi, and S. M. Lucas. 2007. Towards Automatic Personalised Content Creation for Racing Games. In Proc. IEEE Symp. CIG. 252-259.
- J. Togelius and N. Shaker. 2015. The Search-Based Approach. In Procedural Content Generation in Games, N. Shaker, J. Togelius, and M. J. Nelson (Eds.). Springer, 17-30.
- D. Trendafilov and R. Murray-Smith. 2013. Information-Theoretic Characterization of Uncertainty in Manual Control. In Proc. 2013 IEEE Conf. Systems, Man, and Cybernetics. 4913-4918.
- J. Wiemeyer, L. Nacke, C. Moser, and F. Mueller. 2016. Player Experience. In Serious Games, R. Dörner, S. Göbel, W. Effelsberg, and J. Wiemeyer (Eds.). Springer, 243-271.
- G. N. Yannakakis and C. Alexopoulos. 2014. Mixed-Initiative Co-Creativity. In Proc. Conf. FDG.
- G. N. Yannakakis and J. Togelius. 2011. Experience-Driven Procedural Content Generation. In IEEE Trans. Affective Computing. 147-161.
- D. Yu. 2008. Spelunky. Game [PC]. (21 December 2008). Mossmouth.
- D. Yu. 2016. Spelunky. Boss Fight Books.