Chapter 1 Towards the Adaptive Generation of Bespoke Game Content
2014
Abstract
In this chapter, we explore methods for automatically generating game content — and games themselves — adapted to individual players, in order to improve their playing experience or achieve a desired effect. This goes beyond notions of mere replayability, and involves modelling player needs to maximise their enjoyment, involvement and interest in the game being played. We identify three main aspects of this process: Generation of new content and rule sets; Measurement of this content and the player; Adaptation of the game to change player experience. This process forms a feedback loop of constant refinement, as games are continually improved while being played. Framed within this methodology, we present an overview of our recent and ongoing research in this area. This is illustrated by a number of case studies that demonstrate these ideas in action over a variety of game types, including: 3D action games, arcade games, platformers, board games, puzzles and open world games. We draw ...
References (65)
- Ingo Althöfer. Computer-Aided Game Inventing. Technical re- port, Friedrich-Schiller Univ., Faculty Math. Comp. Sci., Jena http://www.minet.uni-jena.de/preprints/althoefer 03/CAGI.pdf, 2003.
- Mike Ambinder. Biofeedback in gameplay: How Valve measure physiology to en- hance gaming experience. Online slides: http://www.valvesoftware.com/ publications/2011/ValveBiofeedback-Ambinder.pdf, 2011.
- Stylianos Asteriadis, Noor Shaker, Kostas Karpouzis, and Georgios Yannakakis. To- wards player's affective and behavioral visual cues as drives to game adaptation. In Proceedings of Workshop on Multimodal Corpora 2012, pages 6-9, 2012.
- Richard Bartle. Hearts, clubs, diamonds, spades: Players who suit MUDs. Journal of MUD Research, 1(1), 1996.
- Chris Bateman, Rebecca Lowenhaupt, and Lennart E. Nacke. Player typology in theory and practice. In Think Design Play: International Conference of the Digital Games Research Association (DIGRA), Hilversum, the Netherlands, September 2011.
- Robin Baumgarten. Towards automatic player behaviour characterisation using multi- class LDA. In Proc. AISB Symp. on AI & Games, pages 63-66, 2010.
- Michael Booth. The AI systems of Left 4 Dead. Online slides: http:
- Ingwer Borg and Patrick Groenen. Modern Multidimensional Scaling: Theory and Ap- plications. Springer, 2nd edition, 2005.
- Cameron Browne. Automatic Generation and Evaluation of Recombination Games. Ph.d. dissertation, QUT, Brisbane, 2008.
- Cameron Browne. Evolutionary Game Design. Springer, Berlin, 2011.
- Cameron Browne. Elegance in Game Design. IEEE Trans. on Computational Intelli- gence & AI in Games, 4, 2012.
- Cameron Browne. Evolutionary game design: 2012 "Humies" winner. SIGEVO Newsletter, 6(2), 2012.
- Cameron Browne. Metrics for better puzzles. In Magy Seif El-Nasr, Anders Drachen, and Alessandro Canossa, editors, Game Analytics: Maximizing the Value of Player Data. Springer, New York, 2012.
- Cameron Browne and Simon Colton. Computational creativity in a closed game system. In Proc. Comput. Intell. Games (CIG), 2012.
- Cameron Browne, Edward Powley, Daniel Whitehouse, Simon Lucas, Peter I. Cowling, Philipp Rohlfshagen, Stephen Tavener, Diego Perez, Spyridon Samothrakis, and Simon Colton. A Survey of Monte Carlo Tree Search Methods. IEEE Trans. on Computational Intelligence & AI in Games, 4:1:1-43, 2012.
- Cameron Browne and Néstor Romeral Andrés. Shibumi Rule Book. Lulu, Raleigh, 2012.
- Simon Colton and Geraint A. Wiggins. Computational creativity: The final frontier. In Proceedings of the European Conference on Artificial Intelligence, 2012.
- Michael Cook and Simon Colton. Initial results from co-operative co-evolution for auto- mated platformer design. In Volume 7248 of Applications of Evolutionary Computation, 2012.
- Michael Cook, Simon Colton, and Alison Pease. Aesthetic considerations for automated platformer design. In Proceedings of the 8th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Forthcoming, 2012.
- Benjamin Cowley. Player Profiling and Modelling in Computer and Video Games. PhD thesis, University of Ulster, Belfast, UK, 2009.
- Chris Crawford. The Art of Computer Game Design. McGraw Hill, Berkeley, 1984.
- Ethan Dereszynski, Jesse Hostetler, Alan Fern, Tom Dietterich Thao-Trang Hoang, and Mark Udarbe. Learning probabilistic behavior models in real-time strategy games. In Proceedings of the Seventh AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 2012.
- Anders Drachen, Alessandro Canossa, and Georgios Yannakakis. Player modeling using self-organization in Tomb Raider: Underworld. In Proc. IEEE Symp. on Comp. Intelli- gence & Games (CIG), pages 1-8, 2009.
- Wolfgang Engel. Programming Vertex and Pixel Shaders. Charles River Media, 2009.
- Jeremy Gow, Robin Baumgarten, Paul Cairns, Simon Colton, and Paul Miller. Unsuper- vised modelling of player style with LDA. IEEE Trans. on Computational Intelligence & AI in Games, 4(3), 2012.
- Jeremy Gow, Simon Colton, Paul Cairns, and Paul Miller. Mining rules from player experience and activity data. In Proceedings of the Eighth Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. The AAAI Press, 2012. Forthcoming.
- Eun Y. Ha, Jonathan P. Rowe, Bradford W. Mott, and James C. Lester. Goal recognition with markov logic networks for player-adaptive games. In Proceedings of the Seventh AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 2012.
- Erin J. Hastings, Ratan K. Guha, and Kenneth O. Stanley. Evolving content in the galac- tic arms race video game. In Proc. IEEE Symp. on Comp. Intelligence & Games (CIG), 2009.
- Mark Hendrikx, Sebastian Meijer, Joeri van der Velden, and Alexandru Iosup. Procedu- ral content generation for games: A survey. ACM Trans. Multimed. Comput. Commun. Applic., 2011.
- Hiroshi Higashida. Machine-made puzzles and hand-made puzzles. In R. Nakatsu et al., editor, IFIP Adv. Inform. Commun. Technol., volume 333, pages 214-222, 2010.
- Victor Hom and John Marks. Automatic design of balanced board games. In Proc. 3rd Artif. Intell. Interact. Digital Entert. Conf., pages 25-30, 2007.
- Andy Howlett, Simon Colton, and Cameron Browne. Evolving pixel shaders for the prototype video game subversion. In Proceedings of the AISB symposium on AI and Games, 2010.
- Robin Hunicke. The case for dynamic difficulty adjustment in games. In Proceedings of the International Conference on Advances in Computer Entertainment Technology, ACE 2005, Valencia, Spain, June 15-15, 2005, pages 429-433. ACM, 2005.
- Hiroyuki Iida, Kazutoshi Takahara, Jun Nagashima, Yoichiro Kajihara, and Tsuyoshi Hashimoto. An application of game-refinement theory to mah jong. In Proc. ICEC'04, LNCS 3166, pages 333-338, 2004.
- Martin Jennings-Teats, Gillian Smith, and Noah Wardrip-Fruin. Polymorph: dynamic difficulty adjustment through level generation. In Proceedings of the 2010 Workshop on Procedural Content Generation in Games, PCGames 2010, New York, 2010. ACM.
- Nobuhiko Kanamoto. A well-made Sudoku is a pleasure to solve, 2001. Avail- able at http://www.nikoli.co.jp/en/puzzles/sudoku/hand_made_ sudoku.htm.
- Scott Kim. What is a puzzle?, 2008. Available at http://scottkim.com/ thinkinggames/whatisapuzzle/index.html.
- John Koza. Genetic Programming. MIT Press, Cambridge, 1992.
- Nicole Lazzaro. Why we play: Affect and the fun of games. In In The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applica- tions, pages 679-700. Lawrence Eribaum, New York, 2003.
- Thomas W. Malone. What makes things fun to learn? heuristics for designing instruc- tional computer games. In Proceedings of the 3rd ACM SIGSMALL symposium and the first SIGPC symposium on Small systems, pages 162-169. ACM, 1980.
- Regan L. Mandryk and M. Stella Atkins. A fuzzy physiological approach for continu- ously modeling emotion during interaction with play technologies. International Journal of Human-Computer Studies, 65(4):329-347, 2007.
- Andrew Martin, Andrew Lim, Simon Colton, and Cameron Browne. Evolving 3d build- ings for the prototype video game subversion. In Proceedings of the EvoGames Work- shop, 2010.
- Geoffrey. J. McLachlan. Discriminant Analysis and Statistical Pattern Recognition. Wi- ley Interscience, 2004.
- Michelle McPartland and Marcus Gallagher. Reinforcement learning in first person shooter games. IEEE Trans. on Computational Intelligence & AI in Games, 3(1), 2011.
- Gwaredd Mountain. Psychology profiling in Silent Hill: Shattered Memories. Invited talk at Paris Game/AI Conference, 2010. Available from http://gameaiconf. com/?p=141.
- Christopher Pedersen, Julian Togelius, and Georgios Yannakakis. Modeling player expe- rience for content creation. IEEE Trans. on Computational Intelligence & AI in Games, 2(1):54-67, 2010.
- Mitchell Potter and Kenneth De Jong. A cooperative coevolutionary approach to function optimization. In Yuval Davidor, Hans-Paul Schwefel, and Reinhard Männer, editors, Parallel Problem Solving from Nature -PPSN III, volume 866 of Lecture Notes in Computer Science, pages 249-257. Springer Berlin / Heidelberg, 1994.
- Andrew K. Przybylski, C. Scott Rigby, and Richard M. Ryan. A motivational model of video game engagement. Review of General Psychology, 14(2):154, 2010.
- Daniel Ramirez-Cano, Simon Colton, and Robin Baumgarten. Player classification us- ing a meta-clustering approach. In Proceedings of the 3rd International Conference on Computer Games, Multimedia and Allied Technology, CGAT 2010, Singapore, April 2010, 2010.
- Randi Rost, Bill Licea-Kane, Dan Ginsburg, John Kessenich, Barthold Lichtenbelt, Hugh Malon, and Mike Weiblen. OpenGL Shading Language, 3rd Edition. Addison Wesley, 2009.
- R. Wayne Schmittberger. New Rules for Classic Games. John Wiley & Sons, New York, 1992.
- Noor Shaker, Julian Togelius, Georgios N. Yannakakis, Ben Weber, Tomoyuki Shimizu, Tomonori Hashiyama, Nathan Sorenson, Philippe Pasquier, Peter Mawhorter, Glen Takahashi, Giliian Smith, and Robin Baumgarten. The 2010 mario ai championship: Level generation track. IEEE Trans. on Computational Intelligence & AI in Games, 3(4):332-347, 2011.
- Noor Shaker, Georgios Yannakakis, Julian Togelius, Miguel Nicolau, and Michael O'Neill. Evolving personalized content for Super Mario Bros using grammatical evo- lution. In Proceedings of the Seventh AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 2012.
- Pieter Spronck, Marc Ponsen, Ida Sprinkhuizen-Kuyper, and Eric Postma. Adaptive game ai with dynamic scripting. Machine Learning, 63(3):217-248, 2006.
- Penelope Sweetser and Peta Wyeth. Gameflow: a model for evaluating player enjoyment in games. Computers in Entertainment (CIE), 3(3):3-3, 2005.
- Ruck Thawonmas and Keita Iizuka. Visualization of online-game players based on their action behaviors. International Journal of Computer Games Technology, 2008.
- Mark J. Thompson. Defining the Abstract. The Games Journal, 2000.
- Julian Togelius, Georgios Yannakakis, Kenneth O. Stanley, and Cameron Browne. Search-based procedural content generation: A taxonomy and survey. IEEE Trans. on Computational Intelligence & AI in Games, 3(3):172-186, 2011.
- Gregory Trefay. Casual Game Design: Designing Play for the Gamer in All of Us. Morgan Kaufmann, Burlington, 2010.
- Giel van Lankveld, Pieter Spronck, Jaap van den Herik, and Arnoud Arntz. Games as personality profiling tools. In Proc. IEEE Symp. on Comp. Intelligence & Games (CIG), pages 197-202, 2011.
- Georgios Yannakakis, M. Maragoudakis, and John Hallam. Preference learning for cog- nitive modeling: a case study on entertainment preferences. IEEE Transactions on Sys- tems, Man and Cybernetics, Part A: Systems and Humans, 39(6):1165-1175, 2009.
- Georgios N. Yannakakis. How to model and augment player satisfaction: A review. In Proceedings of the 1st Workshop on Child, Computer and Interaction, Chania, Crete, ACM Press, 2008.
- Georgios N. Yannakakis and Julian Togelius. Experience-driven procedural content gen- eration. IEEE Trans. on Affective Computing, 2(3):147-161, 2011.
- Nick Yee, Nicolas Ducheneaut, Les Nelson, and Peter Likarish. Introverted elves & conscientious gnomes: The expression of personality in world of warcraft. In Proc. Int. Conf. on Human Factors in Computing Systems (CHI), pages 753-762, 2011.
- Alexander E. Zook and Mark O. Riedl. A temporal data-driven player model for dynamic difficulty adjustment. In Proceedings of the Seventh AAAI Conference on Artificial In- telligence and Interactive Digital Entertainment, 2012.