Evaluating fun and usability in computer games with children

References (127)

1. Acuff, D. S., Reiher, R. H., 1997. What Kids Buy and Why: The Psychology of Marketing to Kids, Free Press.
2. Als, B. S., Jensen, J. J., Skov, M. B., 2005. Exploring Verbalization and Collaboration of Constructive Interaction with Children. Proceedings of the IFIP 9th International Conference on Human-Computer Interaction -INTERACT 2005, Springer, Rome, Italy, 443-456.
3. Anderson, J. R., 1983. The architecture of cognition, Harvard University Press, Cambridge, MA.
4. Andre, T. S., Hartson, H. R., Belz, S. M., McCreary, F. A., 2001. The User action framework: a reliable foundation for usability engineering support tools. International Journal of Human-Computer Studies, 54, 107-136.
5. ANP (2005, July 18). Algemeen Nederlands Persbureau, Half of all children plays games every day (Helft kinderen zit iedere dag te gamen).
6. Atari, 1999. Roller Coaster Tycoon 1 [Computer software] Atari.
7. Baauw, E., Bekker, M. M., Barendregt, W., 2005. A structured expert evaluation method for the evaluation of children's computer games. Proceedings of the IFIP 9th International Conference on Human-Computer Interaction -INTERACT Conference, 12 September 2005, Springer, Rome, Italy, 457-469.
8. Barendregt, W., Bekker, M. M., 2004. Towards a Framework for Design Guidelines for Young Children's Computer Games. Proceedings of the IFIP ICEC Conference, 1 September 2004, Springer, Eindhoven, The Netherlands, 365-376.
9. Barendregt, W., Bekker, M. M., 2005a. Developing a coding scheme for detecting usability and fun problems in computer games for young children. Proceedings of Measuring Behavior 2005, 31 August, Wageningen, The Netherlands.
10. Barendregt, W., Bekker, M. M., 2005b. Developing a coding scheme for detecting usability and fun problems in computer games for young children. Accepted for publication in Behavior Research Methods, Psychonomic Society Publications.
11. Barendregt, W., Bekker, M. M., 2005c. Development and Evaluation of the Picture Cards Method. Workshop Interaction Design for Children, Proceedings of the IFIP 9th - INTERACT Conference 2005 Rome, Italy, 15-19.
12. Barendregt, W., Bekker, M. M., 2005d. Extended guidelines for usability (and fun) testing with children. Proceedings of SIGCHI.NL Conference 2005, HCI Close to You, Den Haag, Barendregt, W., Bekker, M. M., Bouwhuis, D. G., Baauw, E., 2005a (Unpublished manuscript). Identifying usability and fun problems in a computer game during first use and after some practice. Submitted to International Journal of Human-Computer Studies.
13. Barendregt, W., Bekker, M. M., Bouwhuis, D. G., Baauw, E., 2005b. Predicting effectiveness of children participants in user testing based on personality characteristics. Behaviour & Information Technology (in press).
14. Barendregt, W., Bekker, M. M., Speerstra, M., 2003. Empirical evaluation of usability and fun in computer games for children. Proceedings of the IFIP 8th International Conference on Human-Computer Interaction INTERACT-03', 3 September 2003, IOS Press, Zürich, Switzerland, 705-708.
15. Barnum, C. M., 2002. Usability testing and research, Longman, London, UK.
16. Bekker, M. M., Barendregt, W., Crombeen, S., Biesheuvel, M., 2004. Evaluating usability and fun during initial and extended use of children's computer games. People and Computers XVIII-Design for Life, Springer, Leeds, 331-345.
17. Berchet, 2005. http://www.berchet.com/index.php (retrieved on December 5 2005).
18. Berlyne, D. E., 1968. Curiosity and exploration. Science, 153, 25-33.
19. Bloom, B. S., Mesia, B. B., Krathwohl, D. R., 1964. Taxonomy of Educational Objectives, David McKay, New York.
20. Bondy, A., Frost, L., 1994. The picture exchange communication system. Focus on Autistic Behaviour, 9, 1-19.
21. Boren, M. T., Ramey, J., 2000. Thinking Aloud: Reconciling Theory and Practice. IEEE Transactions on Professional Communication, 43, 261-278.
22. British Psychological Society, 2005. Ethical Principles for conducting Research with Human Participants. [On line] Available: http://www.bps.org.uk/the-society/ethics-rules-charter- code-of-conduct/code-of-conduct/ethical-principles-for-conducting-research-with- human-participants.cfm (retrieved on December 1 2005).
23. Buckleitner, W., 1999. The state of children's software evaluation -yesterday, today and in the 21st century. Information Technology in Childhood Education Annual, 211-220.
24. Carroll, J. M. & Mack, R. L., 1984. Learning to use a word processor: By doing, by thinking, and by knowing. In: Human factors in computer systems, J. C. Thomas & M. L. Schneider (Eds.). Norwood, NJ: Ablex Publishing, 13-51.
25. Clanton, C., 1998. An Interpreted Demonstration of Computer Game Design. Proceedings of the conference on CHI 98 summary: human factors in computing systems, 1-2.
26. Cockton, G., Lavery, D., 1999. A Framework for Usability Problem Extraction. Proceedings of the IFIP 7th International Conference on Human-Computer Interaction -INTERACT '99, IOS Press, London, 344-352.
27. Cockton, G., Woolrych, A., Hall, L., Hindmarch, M., 2003. Changing Analysts' Tunes: The Surprising Impact of a New Instrument for Usability Inspection Method Assessment. In: People and Computers, Designing for Society, P. Palanque, P. Johnson, and E. O'Neill (Eds.), Springer-Verlag , pp. 145-162.
28. Cockton, G., Woolrych, A., 2001. Understanding Inspection Methods: Lessons from an Assessment of Heuristic Evaluation. In: A. Blandford, J. Vanderdonckt, and P. D. Gray (Eds.), Springer-Verlag, pp. 171-192.
29. Cohen, J., 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
30. Connell, I. W., Hammond, N. V., 1999. Comparing Usability Evaluation Principles with Heuristics: Problem Instances Versus Problem Types. Proceedings of the IFIP 7th International Conference on Human-Computer Interaction -INTERACT '99, IOS Press, London, 621-636.
31. Csikszentmihalyi, M., 1975. Beyond boredom and anxiety, Jossey-Bass, San Fransisco.
32. Csikszentmihalyi, M., 1978. Intrinsic rewards and emergent motivation. In: The Hidden Costs of Reward, M.R. Lepper and D. Greene (Eds.), Lawrence Erlbaum, Morristown, N.J. Davilex, 2000. RedCat SuperKarts [Computer software] Davilex.
33. Deci, E. L., 1975. Intrinsic motivation, Plenum, New York.
34. Donker, A., 2005. Human factors in educational software for young children PhD Thesis, Department of Psychology and Pedagogy, Vrije Universiteit Amsterdam.
35. Donker, A., Markopoulos, P., 2001. Assessing the effectiveness of usability evaluation methods for children. In: Proceedings of the PC-HCI2001 Conference: Advances in Human Computer Interaction I, N. Avouris and N. Fakotakis (Eds.), Typorama Publications, Greece, pp. 409-410.
36. Donker, A., Reitsma, P., 2004. Usability Testing With Young Children. Proceedings of the Interaction Design and Children Conference 2004, 1 June 2004, ACM, Maryland, 43-48.
37. Druin, A., 1999. The design of children's technology, Morgan Kaufmann, San Francisco.
38. Elphick, E., Slotboom, A., & Kohnstamm, G. A., 2002. BeoordelingsLijst Individuele verschillen tussen Kinderen (Blikvanger): persoonlijkheidsvragenlijst voor kinderen in de leeftijd van 3-13 jaar. (Assessment List Individual Differences between Children (Blikvanger): personality characteristics questionnaire for children between 3-13 years old) [Computer software] Leiden: PITS.
39. Ergocube, 2005. http://store.ergocube.com/ (retrieved on December 5 2005).
40. Ericsson, K. A., Simon, H. A., 1984. Protocol analysis: Verbal reports as data, The MIT Press, Cambridge, MA.
41. Federoff, M. A., 2002. Heuristics and usability guidelines for the creation and evaluation of fun in video games Msc Thesis, Department of Telecommunications of Indiana University.
42. Frese, M., Zapf, D., 1991. Fehler bei der Arbeit mit dem Computer, Ergebnisse von Beobachtungen und Befragungen im Burobereich (Errors in Working with Computers, Results of Observations and Interviews in the Office Field), Huber, Bern Gottingen Toronto.
43. Génération 5, 2005. http://www.generation5.fr/ (retrieved on December 5 2005).
44. Gentner, D. A., Stevens, A. L., 1983. Mental models, Lawrence Erlbaum, Hillsdale, N.J.
45. Greca, A. M., 1983. Interviewing and Behavioral Observations. In: Handbook of Clinical Child Psychology, C.E. Walker and M. C. Roberts (Eds.), Wiley-Interscience, Chichester, pp. 109-131.
46. Grudin, J., 1990. The Computer Reaches Out: The Historical Continuity of Interface Design. Proceedings of the ACM CHI 90 Human Factors in Computing Systems Conference 1990, Seattle, Washington, USA, 261-268.
47. Hacker, W., 1986. Arbeitspsychologie, Huber, Bern.
48. Hanna, L., Neapolitan, D., Risden, K., 2004. Evaluating Computer Game Concepts with Children. Proceedings of the Interaction Design and Children Conference 2004, ACM, University of Maryland, 49-56.
49. Hanna, L., Risden, K., Alexander, K., 1997. Guidelines for usability testing with children. Interactions, 4, 9-14.
50. Hartson, H. R., 2005. Uncovering problems in layers. [Personal communication]
51. Hartson, H. R., Andre, T. S., Williges, R. C., 2001. Evaluating usability evaluation methods. International Journal of Human-Computer Interaction, 13, 373-410.
52. Hertzum, M., Jacobsen, N. E., 2001. The Evaluator Effect: A Chilling Fact About Usability Evaluation Methods. International Journal of Human-Computer Interaction, 13, 421-443.
53. Hoysniemi, J., Hamalainen, P., Turkki, L., 2002. Using Peer Tutoring in Evaluating the Usability of a Physically Interactive Computer Game with children. Proceedings of the Interaction Design and Children Conference 2002, Shaker Publishing BV, Maastricht, 144- 152.
54. ISO, 1998. Ergonomic requirements for office work with visual display terminals (VDTs) Part 11. Guidance on Usability (Rep. No. ISO No. 9241-11). International Organization for Standardization, Geneva, Switzerland.
55. Jacobsen, N. E., 1999. Usability Evaluation Methods, The Reliability and Usage of Cognitive Walkthrough and Usability Test, Doctoral Thesis. Department of Psychology University of Copenhagen, Denmark.
56. Jacobsen, N. E., Hertzum, M., John, B. E., 1998. The Evaluator Effect in Usability Tests. Proceedings of ACM CHI'98 Conference Summary (Los Angeles, CA, April 18-23), ACM Press, New York, 255-256.
57. Jacobsen, N. E., Hertzum, M., John, B. E., 2003. The evaluator effect in usability studies: Problem detection and severity judgments. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, HFES, Santa Monica, CA, 1336-1340.
58. Jordan, P. W., 1999. Pleasure with Products: Human Factors for Body, Mind and Soul. In: Human Factors in Product Design: Current Practise and Future Trends, W. Green and P. Jordan (Eds.), Taylor & Francis UK.
59. Jordan, B., Henderson, A., 1995. Interaction Analysis: Foundations and Practice. Journal of Learning Sciences, 4(1), 39-105.
60. Kanfer, R., Eyberg, S. M., Krahn, G. L., 1983. Interviewing strategies in child assessment. In: Handbook of Clinical Child Psychology, C.E. Walker and M. C. Roberts (Eds.), Wiley- Interscience, New York Chichester Brisbane Toronto, pp. 95-108.
61. Karakter Interactive, 2002. Heksenspul -Met Hennie de Heks en de kat Helmer (Witchstuff - With Hennie the Witch and the cat Helmer) [Computer software] Karakter Interactive.
62. Kersten-Tsikalkina, M., Bekker, M. M., 2001. Evaluating usability and fun of children's products. Proceedings of International Conference on Affective Human Factors Design, Asean Academic Press, London, 450-457.
63. Kjeldskov, J., Skov, M. B., and Stage, J., 2005. Does Time Heal? A Longitudinal Study of Usability. In: Proceedings of the Australian Computer-Human Interaction Conference 2005 (OzCHI'05), ACM Press.
64. Lavery, D., Cockton, G., Atkinson, M. P., 1997. Comparison of Evaluation Methods Using Structured Usability Problem Reports. Behaviour & Information Technology, 16, 246-266.
65. Lavery, D. and Cockton, G., 1997. Representing Predicted and Actual Usability Problems. In: Proceedings of the International Workshop on Representations in Interactive Software Development, QMW London, 97-108.
66. Law, E., Hvannberg, E. T., 2004. Analysis of Combinatorial User Effect in International Usability Tests. Proceedings of ACM CHI Conference 2004, April, 2004, 9-16.
67. Lewis, C., 1982. Using the "Thinking-aloud Method" in Cognitive Interface Design (Rep. No. RC 9265 (#40713)). IBM Thomas J. Watson Research Center, Yorktown Heights, NY.
68. Lewis, C., Polson, P., Wharton, C., Rieman, J., 1990. Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces. Proceedings of CHI 90, ACM, New York, NY, 235-242.
69. Lewis, J. R., 1994. Sample Size for Usability Studies: Additional Considerations. Human Factors, 36, 368-378.
70. Lourenco, O., Machado, A. 1996. In defence of Piaget's theory: A reply to 10 common criticisms. Psychological Review, 103, 143-164.
71. Malmberg, 2003. Wereld in getallen, Groep: 3 Het Pretpark (World in numbers, group 3: The Theme Park) [Computer software] Malmberg Uitgeverij.
72. Malone, T. W., 1980. What makes things fun to learn? A study of intrinsically motivating computer games, Technical Report CIS-7, Xerox PARC, Palo Alto.
73. Malone, T. W., Lepper, M. R., 1987. Making learning fun: a taxonomy of intrinsic motivations for learning. In: Aptitude, Learning and Interaction III Cognitive and Affective Process Analysis, R.E. Snow and M. J. Farr (Eds.), Lawrence Erlbaum, Hillsdale, N.J.
74. Markopoulos, P., Barendregt, W., Brus, M., Plakman, I., 2005. The Parent Evaluator Method. Workshop 'Children Computer Interaction: Methodological Research' Interact 2005, Rome, 36-38.
75. Markopoulos, P., Bekker, M. M., 2002. How to compare usability testing methods with children participants. Workshop Interaction Design for Children, Proceedings of the IFIP 9th International Conference on Human-Computer Interaction -INTERACT '05 Rome, Shaker Publishing, Maastricht, 153-158.
76. Maslow, A., 1970. Motivation and Personality, Harper and Row, N.Y.
77. Measelle, J. R., Ablow, J. C., Cowan, P. A., Cowan, C. P., 1998. Assessing Young Children's Views of Their Academic, Social, and Emotional Lives: An Evaluation of the Self- Perception Scales of the Berkeley Puppet Interview. Child Development, 69, 1556-1576.
78. MediaMix, 2002a. Max en de toverstenen (Milo and the magical stones) [Computer software] MediaMix Benelux.
79. MediaMix, 2002b. Regenboog, de mooiste vis van de zee (Rainbow, the most beautiful fish in the ocean) [Computer software] MediaMix Benelux.
80. MediaMix, 2004a. Kleine IJsbeer weet jij de weg? (Little Polar Bear, do you know the way?) [Computer software] MediaMix Benelux.
81. MediaMix, 2004b. Max en het rode fruit (Milo and the red fruit) [Computer software] MediaMix Benelux.
82. Medlock, M. C., Wixon, D., Terrano, M., Romero, R., Fulton, B., 2002. Using the RITE method to improve products; a definition and a case study. Proceedings of the Usability Professional's Association 2002 Annual Conference: Humanizing Design, July 8-12, 2002, Orlando FL, USA.
83. MindScape, 2003. Robbie Konijn, Groep 3: Pret in de Wolken (Robbie Rabbit, Group 3: Fun in the Clouds) [Computer software] Mindscape.
84. Miyake, N., 1986. Constructive Interaction and the Iterative Process of Understanding. Cognitive Science, 10, 151-177.
85. Nielsen, J., 1993. Usability Engineering, Academic Press Inc., Boston.
86. Nielsen, J., 1994. Estimating the number of subjects needed for a thinking aloud test. International Journal of Human-Computer Studies, 41, 385-397.
87. Nielsen, J., Molich, R., 1990. Heuristic evaluation of user interfaces. Proceedings of ACM CHI'90 Conference 1-5 April, Seattle, WA, 249-256.
88. Nisbett, R., Wilson, T., 1977. Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231-259.
89. Noldus, 2002. The Observer Pro [Computer software], Noldus.
90. Norman, D. A., 1981. Categorization of action slips. Psychological Review, 88, 1-15.
91. Norman, D. A., 1983. Some Observations on Mental Models. In: Mental Models, D.A. Gentner and A. A. Stevens (Eds.), Lawrence Erlbaum, Hillsdale, N.J.
92. Norman, D. A., 1998. The design of everyday things, MIT Press, London.
93. Norman, D. A., Draper, S. W., 1986. User centered system design: new perspectives on human-computer interaction, Lawrence Erlbaum, Hillsdale, N.J.
94. Pagulayan, R. J., Keeker, K., Wixon, D., Romero, R., Fuller, T., 2003. User-centered design in games. In: Handbook for Human-Computer Interaction in Interactive Systems, J. Jacko and A. Sears (Eds.), Lawrence Erlbaum, Mahwah, N.J. pp. 883-906.
95. Patel, M., Paulsen, C.A., 2002. Strategies for recruiting children for usability tests. Paper presented at the meeting of the Usability Professionals Association: FL (June 2002). Available: http://www.air.org/usability/publications/christinepaulsen/recruitingchildren. pdf (Retrieved at December 7 2005)
96. Pfister, M., 1999. Max en de toverstenen, Meander/4 windstreken.
97. Piaget, J., 1951. Play, dreams, and imitation in childhood, Norton, New York.
98. Piaget, J., 1970. Science of Education and the Psychology of the Child, Orion Press, New York.
99. Prümper, J., Zapf, D., Brodbeck, F. C., Frese, M., 1992. Some surprising differences between novice and expert errors in computerized office work. Behaviour & Information Technology, 11, 319-328.
100. Rasmussen, J., 1982. Human errors: A taxonomy for describing human malfunction in industrial installations. Journal of Occupational Accidents, 4, 311-335.
101. Rauterberg, M. 1993. A product oriented approach to quantify usability attributes and the interactive quality of user interfaces. In: Work With Display Units--WWDU'92. H. Luczak, A. Cakir & G. Cakir (eds.), Amsterdam: North-Holland pp. 324-328.
102. Rauterberg, M. 1995. About a framework for information and information processing of learning systems. In: Preprints of Proceedings of 'International Conference on Information System Concepts'--ISCO3. Marburg: Phillipps University pp. 4.1-4.15.
103. Read, J. C., MacFarlane, S. J., Casey C, 2002. Endurability, Engagement and Expectations: Measuring Children's Fun. Proceedings of the Interaction Design and Children Workshop 2002, Shaker Publishing, Maastricht, The Netherlands, 189-198.
104. Read, J., 2005. Smileyometer. [Personal communication]
105. Reason, J. T., 1990. Human error, Cambridge University Press, New York.
106. Reiterer, H., Oppermann, R., 1993. Evaluation of user interfaces: EVADIS II -a comprehensive evaluation approach. Behaviour and Information Technology, 12, 137-148.
107. Robson, C., 1993. Real World Research: A resource for social scientists and practitioner researchers, Blackwell Publishers, Malden, Mass.
108. Rouse III, R., 2005. Game design theory and practice, Wordware Publishing, Inc., Plano, Texas.
109. Rubin, J., 1994. Handbook of usability testing: how to plan, design, and conduct effective tests, Wiley, Chichester.
110. Sanderson, P. M., Fisher, C., 1994. Exploratory Sequential Data Analysis: Foundations. Human-Computer Interaction, 9, 251-317.
111. Schneiderman, B., 1998. Designing the User Interface: Strategies for Effective Human- Computer Interaction, 3 rd edition, Addison-Wesley Publishers, Reading, MA.
112. Shelley, B., 2001. Guidelines for Developing Successful Games. http://www.gamasutra.com/features/20010815/shelley_01.htm (retrieved on February 15 2004)
113. Stienstra, M., Hoonhout, J., 2002. TOONS Toys. Interaction toys as a means to create a fun experience. Proceedings of the Interaction Design and Children Conference 2002, Eindhoven, Shaker Publishing BV, Maastricht, The Netherlands, 199-210.
114. Sutcliffe, A. G., Ryan, M., Doubleday, A., Springett, M. V., 2000. Model mismatch analysis: towards a deeper explanation of users' usability problems. Behaviour & Information Technology, 19, 43-55.
115. Transposia, 2000. Oscar en de geheimen van het bos (Oscar the balloonist and the secrets of the forest) [Computer software] Lannoo.
116. Transposia, 2000. Freddi Fish, Dolle Doolhof (Freddi Fish, Silly Maze) [Computer software] Transposia.
117. Valkenburg, P. M., 1999. De ontwikkeling van Kind tot Consument (The development of Child to Consumer). Tijdschrift voor Communicatiewetenschap,30-46.
118. van Kesteren, I. E. H., Bekker, M. M., Vermeeren, A. P. O. S., Lloyd, P. A., 2003. Assessing Usability Evaluation Methods on their Effectiveness to Elicit Verbal Comments from children. Proceedings of the Interaction Design and Children Conference 2003, ACM, Inc., New York, 41-49.
119. Vermeeren, A. P. O. S., den Bouwmeester, K., Aasman, J., de Ridder, H., 2002. DEVAN: a detailed video analysis of user test data. Behaviour & Information Technology, 21, 403- 423.
120. Vermeeren, A. P. O. S., van Kesteren, I. E. H., Bekker, M. M., 2003. Managing the Evaluator Effect in User Testing. Proceedings of the IFIP 9th International Conference on Human- Computer Interaction -INTERACT '03, IOS Press, Zürich, Switzerland, 647-654.
121. Virzi, R. A., 1992. Refining the test phase of usability evaluation: How many subjects is enough? Human Factors, 34, 457-468.
122. Wickens, C. D., Lee, J., Liu, Y., Becker, S. G., 2004. An introduction to human factors engineering, Pearson Education International, Upper Saddle River, N.J.
123. Winograd, T., Flores, F., 1986. Understanding Computers and Cognition: A New Foundation for Design. Norwood: Ablex.
124. Woolrych, A., Cockton, G., 2001. Why and When Five Test Users aren't Enough. Proceedings of IHM-HCI 2001 Conference, Cépadèus Éditions, Toulouse, 105-108.
125. Wright, P., Monk, A., 1991. A cost-effective evaluation method for use by designers. International Journal of Man-Machine Studies, 35, 891-912.
126. Zapf, D., Brodbeck, F. C., Frese, M., Peters, H., Prümper, J., 1992. Errors in Working with Office Computers: A First Validation of a Taxonomy for Observed Errors in a Field Setting. International Journal of Human-Computer Interaction, 4, 311-339. Curriculum Vitae 10 okt. 1971 Geboren te Purmerend 1984-1985 Voorbereidend Wetenschappelijk Onderwijs (VWO), Elzendaal College, Boxmeer 1985-1988 Voorbereidend Wetenschappelijk Onderwijs (VWO), Thorbecke College Arnhem, in combinatie met Vooropleiding Dansacademie aan de Hogeschool voor de Kunsten, Arnhem 1998-1990 Voorbereidend Wetenschappelijk Onderwijs (VWO), Haags Montessori Lyceum, Den Haag 1990-1995 Studie Informatica, Radboud Universiteit Nijmegen 1995-1996 Functioneel Ontwerper, Rijks Computer Centrum, Apeldoorn 1996-1999 Software/Information Engineer, Kadaster, Apeldoorn 1999-2001 Interaction Designer, Getronics Interedge, Amersfoort 2002-nu Promovendus, Technische Universiteit Eindhoven, Faculteit Industrial Design Naam: 1. Welk spel vind je het leukst? Max IJsbeer
127. Als je nog een keer een ander spelletje zou mogen testen, zou je het dan het liefste met of zonder de kaartjes doen?