Crowd-Sourcing the Aesthetics of Platform Games
Abstract
What are the aesthetics of platform games and what makes a platform level engaging, challenging and/or frustrating? We attempt to answer such questions through mining a large-set of crowd-sourced gameplay data of a clone of the classic platform game Super Mario Bros. The data consists of 40 short game levels that differ along six key level design parameters. Collectively, these levels are played 1560 times over the Internet and the perceived experience is annotated by experiment participants via self-reported ranking (pairwise preferences). Given the wealth of this crowd-sourced data, as all details about players' in-game behaviour are logged, the problem becomes one of extracting meaningful numerical features at the appropriate level of abstraction for the construction of generic computational models of player experience and, thereby, game aesthetics. We explore dissimilar types of features, including direct measurements of event and item frequencies, and features constructed through frequent sequence mining and go through an in-depth analysis of the interrelationship between level content, player's behavioural patterns and reported experience. Furthermore, the fusion of the extracted features allows us to predict reported player experience with a high accuracy even from short game segments. In addition to advancing our insight on the factors that contribute to platform game aesthetics, the results are useful for the personalisation of game experience via automatic game adaptation.
References (37)
- T. Malone, "What makes computer games fun? (abstract only)," in Proceedings of the joint conference on Easier and more productive use of computer systems. (Part -II): Human interface and the user interface -Volume 1981, ser. CHI '81. New York, NY, USA: ACM, 1981, p. 143.
- R. Koster, A theory of fun for game design. Paraglyph press, 2004.
- B. Magerko, C. Heeter, J. Fitzgerald, and B. Medler, "Intelligent adaptation of digital game-based learning," in Proceedings of the 2008 Conference on Future Play: Research, Play, Share. ACM, 2008, pp. 200-203.
- G. Yannakakis and J. Hallam, "A generic approach for generating interesting interactive pac-man opponents," in In Proceedings of the IEEE Symposium on Computational Intelligence and Games, 2005, pp. 94-101.
- J. Togelius and J. Schmidhuber, "An experiment in automatic game design," pp. 111-118, 2009.
- S. Björk, S. Lundgren, and J. Holopainen, "Game design patterns," in Proceedings of Level Up-1st International Digital Games Research Conference. Citeseer, 2003.
- K. Hullett and J. Whitehead, "Design patterns in fps levels," in FDG '10: Proceedings of the Fifth International Conference on the Foundations of Digital Games. New York, NY, USA: ACM, 2010, pp. 78-85.
- D. Moura, M. el Nasr, and C. Shaw, "Visualizing and understanding players' behavior in video games: discovering patterns and supporting aggregation and comparison," in ACM SIGGRAPH 2011 Game Papers. ACM, 2011, p. 2.
- D. Milam and M. El Nasr, "Design patterns to guide player movement in 3d games," in Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games. ACM, 2010, pp. 37-42.
- M. Jennings-Teats, G. Smith, and N. Wardrip-Fruin, "Polymorph: A model for dynamic level generation," in Sixth Artificial Intelligence and Interactive Digital Entertainment Conference, 2010.
- G. Smith, M. Cha, and J. Whitehead, "A framework for analysis of 2d platformer levels," in Sandbox '08: Proceedings of the 2008 ACM SIGGRAPH symposium on Video games. New York, NY, USA: ACM, 2008, pp. 75-80.
- G. Smith, J. Whitehead, and M. Mateas, "Tanagra: A mixed-initiative level design tool," in Proceedings of the International Conference on the Foundations of Digital Games, 2010.
- L. D. Riek, M. O. Connor, and P. Robinson, "Guess what? a game for affective annotation of video using crowd sourcing," in Proceedings Affective Computing and Intelligent Interaction, 2011.
- A. Drachen, A. Canossa, and G. N. Yannakakis, "Player Modeling using Self-Organization in Tomb Raider: Underworld," in Proceedings of the IEEE Symposium on Computational Intelligence and Games. Milan, Italy: IEEE, September 2009, pp. 1-8.
- C. Thurau and C. Bauckhage, "Analyzing the Evolution of Social Groups in World of Warcraft," in Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games. Copenhagen: IEEE, August 2010, pp. 170-177.
- G. N. Yannakakis and J. Togelius, "Experience-Driven Procedural Content Generation," IEEE Transactions on Affective Computing, 2011.
- C. Pedersen, J. Togelius, and G. N. Yannakakis, "Modeling player experience in super mario bros," in CIG'09: Proceedings of the 5th international conference on Computational Intelligence and Games. Piscataway, NJ, USA: IEEE Press, 2009, pp. 132-139.
- --, "Modeling player experience for content creation," IEEE Trans- actions on Computational Intelligence and AI in Games, vol. 2, no. 1, pp. 54-67, 2010.
- N. Shaker, G. N. Yannakakis, and J. Togelius, "Towards Automatic Personalized Content Generation for Platform Games," in Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE). AAAI Press, October 2010.
- --, "Feature Analysis for Modeling Game Content Quality," in IEEE Transactions on Computational Intelligence and AI in Games (CIG), 2011.
- P. A. Mawhorter and M. Mateas, "Procedural level generation using occupancy-regulated extension," in Proceedings of the IEEE Confer- ence on Computational Intelligence and Games (CIG), 2010, pp. 351- 358.
- N. Sorenson and P. Pasquier, "Towards a generic framework for automated video game level creation," in Proceedings of the European Conference on Applications of Evolutionary Computation (EvoAppli- cations), vol. 6024. Springer LNCS, 2010, pp. 130-139.
- N. Sorenson, P. Pasquier, and S. DiPaola, "A generic approach to challenge modeling for the procedural creation of video game levels," 2011.
- D. Perez, M. Nicolau, M. O'Neill, and A. Brabazon, "Evolving behaviour trees for the mario ai competition using grammatical evolu- tion," in Applications of Evolutionary Computation, ser. Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2011, vol. 6624, pp. 123-132.
- S. Bojarski and C. Congdon, "Realm: A rule-based evolutionary com- putation agent that learns to play mario," in Computational Intelligence and Games (CIG), 2010 IEEE Symposium, 2010, pp. 83-90.
- N. Shaker, J. Togelius, G. N. Yannakakis, B. Weber, T. Shimizu, T. Hashiyama, N. Sorenson, P. Pasquier, P. Mawhorter, G. Takahashi, G. Smith, and R. Baumgarten, "The 2010 Mario AI championship: Level generation track," IEEE Transactions on Computational Intelli- gence and Games, 2011.
- C. Pedersen, J. Togelius, and G. N. Yannakakis, "Modeling player experience for content creation," IEEE Transactions on Computational Intelligence and AI in Games, vol. 2, no. 1, pp. 54-67, 2010.
- G. Yannakakis and J. Hallam, "Entertainment modeling in physical play through physiology beyond heart-rate," Affective Computing and Intelligent Interaction, pp. 254-265, 2007.
- G. N. Yannakakis, M. Maragoudakis, and J. Hallam, "Preference learning for cognitive modeling: a case study on entertainment preferences," Trans. Sys. Man Cyber. Part A, vol. 39, pp. 1165-1175, November 2009. [Online]. Available: http://dx.doi.org/10.1109/TSMCA.2009.2028152
- K. Höök, "Affective loop experiences -what are they?" in PERSUA- SIVE, ser. Lecture Notes in Computer Science, vol. 5033. Springer, 2008, pp. 1-12.
- M. Li, X. Chen, X. Li, B. Ma, and P. Vitányi, "The similarity metric," IEEE Transactions on Information Theory, vol. 50, no. 12, pp. 3250- 3264, 2004.
- M. J. Zaki, "Spade: An efficient algorithm for mining frequent sequences," Mach. Learn., vol. 42, pp. 31-60, January 2001. [Online]. Available: http://portal.acm.org/citation.cfm?id=599609.599626
- R. Srikant and R. Agrawal, "Mining sequential patterns: Gener- alizations and performance improvements," Advances in Database TechnologyEDBT'96, pp. 1-17, 1996.
- H. Martinez and G. Yannakakis, "Mining multimodal sequential patterns: A case study on affect detection," in Proceedings of the 13th International Conference in Multimodal Interaction, ICMI 2011, Alicante. ACM Press, November 2011.
- G. N. Yannakakis and J. Hallam, "Entertainment modeling through physiology in physical play," Int. J. Hum.-Comput.
- G. N. Yannakakis, M. Maragoudakis, and J. Hallam, "Preference learn- ing for cognitive modeling: a case study on entertainment preferences," Trans. Sys. Man Cyber. Part A, vol. 39, pp. 1165-1175, November 2009.
- V. Nicollet, Difficulty in dexterity-based platform games. [Online]. Available: http://www.gamedev.net/reference/design/features/platformdiff, Mar. 2004. Noor Shaker is a Ph.D. candidate at the IT University of Copenhagen. She received a 5-year BA in IT Engineering in 2007 from Damascus University, and an M.Sc. in Artificial Intelligence in 2009 from Katholieke Universiteit Leuven. Her research interests include player modeling, proce- dural content generation, affective computing and player behavior imitation.