Mobile Game User Research: The World as Your Lab?
Abstract
With the advent of mobile games and the according growing and competitive market, game user research can provide valuable insights and a competitive edge if methods and procedures are employed that match the distinct challenges that mobile devices, games and usage scenarios induce. We present a summary of parameters that frame the research setup and procedure, focusing on the trade-offs between lab and field studies and the related decision whether to pursue large-scale and quantitative or small-scale focused research accompanied by qualitative methods. We then illustrate the implications of these considerations on real world projects along the lines of two evaluations of different input methods for the action-puzzle mobile game Somyeol: a local study with 37 participants and a mixed design of qualitative and quantitative methods, and the strictly quantitative analysis of game-play data from 117,118 users. The findings underline the importance of small-scale evaluations prior to release.
Key takeaways
AI
AI
- Mobile game user research (mGUR) is critical for competitive advantage in the $5.8 billion market.
- Combining qualitative and quantitative methods enhances the reliability of mGUR outcomes.
- A local study with 37 participants provided insights into input methods for Somyeol before release.
- Analysis of 117,118 users post-release showed a clear preference for gamepad emulation (GPE) input method.
- Evaluation frameworks must adapt to the unique challenges posed by mobile environments and user contexts.
References (10)
- Abowd, G.D. and Mynatt, E.D. Charting past, present, and future research in ubiquitous computing. ACM Transactions on Computer-Human Interaction (TOCHI) 7, 1 (2000), 29-58.
- Baillie, L. and Schatz, R. Exploring multimodality in the laboratory and the field. Proceedings of the 7th international conference on Multimodal interfaces, ACM (2005), 100-107.
- Duh, H.B.-L., Tan, G.C.B., and Chen, V.H. Usability evaluation for mobile device: a comparison of laboratory and field tests. Proceedings of the 8th conference on Human- computer interaction with mobile devices and services, ACM (2006), 181-186.
- Hagen, P., Robertson, T., Kan, M., and Sadler, K. Emerging research methods for understanding mobile technology use. Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future, Computer-Human Interaction Special Interest Group (CHISIG) of Australia (2005), 1-10.
- Henze, N., Rukzio, E., and Boll, S. Observational and experimental investigation of typing behaviour using virtual keyboards for mobile devices. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, (2012), 2659-2668.
- Kallio, T. and Kaikkonen, A. Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability studies 1, 4-16 (2005), 23-28.
- Kjeldskov, J. and Graham, C. A Review of Mobile HCI Research Methods. In L. Chittaro, ed., Human-Computer Interaction with Mobile Devices and Services. Springer Berlin Heidelberg, 2003, 317-335.
- Kjeldskov, J. and Stage, J. New techniques for usability evaluation of mobile systems. International Journal of Human- Computer Studies 60, 5-6 (2004), 599-620.
- Schusteritsch, R., Wei, C.Y., and LaRosa, M. Towards the perfect infrastructure for usability testing on mobile devices. CHI '07 Extended Abstracts on Human Factors in Computing Systems, ACM (2007), 1839-1844.
- Zhang, D. and Adipat, B. Challenges, methodologies, and issues in the usability testing of mobile applications. International Journal of Human-Computer Interaction 18, 3 (2005), 293-30.