Personas for Artificial Intelligence (AI) An Open Source Toolbox
2022, IEEE Access
https://doi.org/10.1109/ACCESS.2022.3154776Abstract
Personas have successfully supported the development of classical user interfaces for more than two decades by mapping users' mental models to specific contexts. The rapid proliferation of Artificial Intelligence (AI) applications makes it necessary to create new approaches for future human-AI interfaces. Human-AI interfaces differ from classical human-computer interfaces in many ways, such as gaining some degree of human-like cognitive, self-executing, and self-adaptive capabilities and autonomy, and generating unexpected outputs that require non-deterministic interactions. Moreover, the most successful AI approaches are so-called "black box" systems, where the technology and the machine learning process are opaque to the user and the AI output is far not intuitive. This work shows how the personas method can be adapted to support the development of human-centered AI applications, and we demonstrate this on the example of a medical context. This work is-to our knowledge-the first to provide personas for AI using an openly available Personas for AI toolbox. The toolbox contains guidelines and material supporting persona development for AI as well as templates and pictures for persona visualisation. It is ready to use and freely available to the international research and development community. Additionally, an example from medical AI is provided as a best practice use case. This work is intended to help foster the development of novel human-AI interfaces that will be urgently needed in the near future.
References (88)
- D. P. C. Peters, A. Rivers, J. L. Hatfield, D. G. Lemay, S. Liu, and B. Basso, "Harnessing ai to transform agriculture and inform agricultural research," IT Professional, vol. 22, no. 3, pp. 16-21, 2020.
- M. S. Norouzzadeh, A. Nguyen, M. Kosmala, A. Swanson, M. S. Palmer, C. Packer, and J. Clune, "Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning," Proceedings of the National Academy of Sciences, vol. 115, no. 25, pp. E5716-E5725, 2018. [Online]. Available: https://www.pnas.org/content/115/25/E5716
- D. A. Norman, "Design principles for human-computer interfaces," in Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '83), 1983, pp. 1-10.
- S. K. Card, T. P. Moran, and A. Newell, The psychology of Human- Computer Interaction. Hillsdale (NJ): Erlbaum, 1983.
- B. Shneiderman, Designing the user interface: Strategies for effective human-computer interaction. Reading (MA): Addison-Wesley, 1987.
- R. C. Tumbleson, "Calculating machines," Electrical Engineering, vol. 67, no. 1, pp. 6-12, 1948.
- E. R. Harper, T. Rodden, Y. Rogers, and A. Sellen, Being Human: Human- Computer Interaction in the year 2020. Cambridge (UK): Microsoft Research, 2008.
- J. S. Seberger, M. Llavore, N. N. Wyant, I. Shklovski, and S. Patil, "Empowering resignation: There's an app for that," in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1-18.
- S. S. Sundar, "Rise of machine agency: A framework for studying the psy- chology of human-ai interaction (haii)," Journal of Computer-Mediated Communication, vol. 25, no. 1, pp. 74-88, 2020.
- W. Xu, M. J. Dainoff, L. Ge, and Z. Gao, "From human-computer interaction to human-ai interaction: New challenges and opportunities for enabling human-centered ai," arXiv:2105.05424 [cs.HC], 5 2021. [Online]. Available: http://arxiv.org/abs/2105.05424
- A. Dix, J. Finlay, G. D. Abowd, and R. Beale, Human-computer interac- tion. Harlow: Prentice Hall, 1993.
- A. Przegalinska, L. Ciechanowski, A. Stroz, P. Gloor, and G. Mazurek, "In bot we trust: A new methodology of chatbot performance measures," Business Horizons, vol. 62, no. 6, pp. 785-797, 2019.
- M. Manca, F. Paternò, C. Santoro, E. Zedda, C. Braschi, R. Franco, and A. Sale, "The impact of serious games with humanoid robots on mild cognitive impairment older adults," International Journal of Human- Computer Studies, vol. 145, p. 102509, 2021.
- Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, 2015.
- A. Esteva, B. Kuprel, R. A. Novoa, J. Ko, S. M. Swetter, H. M. Blau, and S. Thrun, "Dermatologist-level classification of skin cancer with deep neural networks," Nature, vol. 542, no. 7639, pp. 115-118, 2017.
- A. Ortigosa, R. M. Carro, and J. I. Quiroga, "Predicting user personality by mining social interactions in facebook," Journal of computer and System Sciences, vol. 80, no. 1, pp. 57-71, 2014.
- R. Louie, A. Coenen, C. Z. Huang, M. Terry, and C. J. Cai, "Novice- ai music co-creation via ai-steering tools for deep generative models," in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, pp. 1-13.
- A. Calero Valdez, A. Schaar, M. Ziefle, A. Holzinger, S. Jeschke, and C. Brecher, "Using mixed node publication network graphs for analyzing success in interdisciplinary teams," in Active Media Technology, Lecture Notes in Computer Science LNCS 7669, R. Huang, A. A. Ghorbani, G. Pasi, T. Yamaguchi, N. Y. Yen, and B. Jin, Eds. Heidelberg, Berlin: Springer, 2012, pp. 606-617.
- S. Robert, S. Büttner, C. Röcker, and A. Holzinger, "Reasoning under un- certainty: Towards collaborative interactive machine learning," in Machine Learning for Health Informatics: State-of-the-Art and Future Challenges, A. Holzinger, Ed. Cham: Springer International Publishing, 2016, pp. 357-376.
- A. Holzinger, "Interactive machine learning for health informatics: When do we need the human-in-the-loop?" Brain Informatics, vol. 3, no. 2, pp. 119-131, 2016.
- A. Crisan and M. Correll, "User ex machina: Simulation as a design probe in human-in-the-loop text analytics," in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1-16.
- A. Holzinger, P. Kieseberg, E. Weippl, and A. M. Tjoa, "Current advances, trends and challenges of machine learning and knowledge extraction: From machine learning to explainable ai," in Springer Lecture Notes in Computer Science LNCS 11015. Cham: Springer, 2018, pp. 1-8.
- K. Vredenburg, J.-Y. Mao, P. W. Smith, and T. Carey, "A survey of user- centered design practice," in Proceedings of the SIGCHI conference on Human factors in computing systems, 2002, pp. 471-478.
- A. Cooper and P. Saffo, The Inmates Are Running the Asylum. USA: Macmillan Publishing Co., Inc., 1999.
- T. Miaskiewicz and K. A. Kozar, "Personas and user-centered design: How can personas benefit product design processes?" Design Studies, vol. 32, no. 5, pp. 417-430, 2011. [Online]. Available: http://dx.doi.org/10.1016/j.destud.2011.03.003
- L. Nielsen, "Design personas -new ways, new contexts," Persona Studies, vol. 4, pp. 1-4, 11 2018.
- A. Collins and D. Gentner, "How people construct mental models," in Cultural models in language and thought, D. Holland and N. Quinn, Eds. Cambridge: Cambridge University Press, 1987, pp. 243-265.
- A. Holzinger and H. Mueller, "Toward human-ai interfaces to support explainability and causability in medical ai," IEEE COMPUTER, vol. 54, no. 10, pp. 78-86, 2021.
- C. LeRouge, J. Ma, S. Sneha, and K. Tolle, "User profiles and personas in the design and development of consumer health technologies," Inter- national journal of medical informatics, vol. 82, no. 11, pp. e251-e268, 2013.
- A. Blandford, "Hci for health and wellbeing: challenges and opportuni- ties," International Journal of Human-Computer Studies, vol. 131, no. 11, pp. 41-51, 2019.
- D. Schneeberger, K. Stoeger, and A. Holzinger, "The european legal framework for medical ai," in International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Springer LNCS 12279. Cham: Springer, 2020, pp. 209-226.
- K. Stoeger, D. Schneeberger, and A. Holzinger, "Medical artificial intel- ligence: The european legal perspective," Communications of the ACM, vol. 64, no. 11, pp. 34-36, 2021.
- A. Holzinger, G. Langs, H. Denk, K. Zatloukal, and H. Mueller, "Caus- ability and explainability of artificial intelligence in medicine," Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 9, no. 4, pp. 1-13, 2019.
- A. Holzinger, "Usability engineering methods for software developers," Communications of the ACM, vol. 48, no. 1, pp. 71-74, 2005.
- A. Holzinger, A. Carrington, and H. Müller, "Measuring the quality of explanations: The system causability scale (scs). comparing human and vol. 34, no. 2, pp. 193-198, 2020.
- A. Holzinger, B. Malle, A. Saranti, and B. Pfeifer, "Towards multi-modal causability with graph neural networks enabling information fusion for explainable ai," Information Fusion, vol. 71, no. pp. 28-37, 2021.
- E. L.-C. Law, V. Roto, M. Hassenzahl, A. Vermeeren, and J. Kort, "Un- derstanding, scoping and defining user experience: a survey approach," in Proceedings of the SIGCHI conference on human factors in computing systems, 2009, pp. 719-728.
- H. Mueller, M. T. Mayerhofer, E.-B. V. Veen, and A. Holzinger, "The ten commandments of ethical medical ai," IEEE COMPUTER, vol. 54, no. 7, pp. 119-123, 2021.
- A. Holzinger, "From machine learning to explainable ai," in 2018 World Symposium on Digital Intelligence for Systems and Machines (IEEE DISA). IEEE, 2018, pp. 55-66.
- L. Longo, R. Goebel, F. Lecue, P. Kieseberg, and A. Holzinger, "Explain- able artificial intelligence: Concepts, applications, research challenges and visions," in Machine Learning and Knowledge Extraction, vol. 12279 LNCS. Cham: SpringerInternational Publishing, 2020, pp. 1-16.
- J. Zhou, A. H. Gandomi, F. Chen, and A. Holzinger, "Evaluating the quality of machine learning explanations: A survey on methods and metrics," Electronics 2021, vol. 10, no. 593, 2021.
- D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning tions by back-propagating errors," Nature, vol. 323, no. 6088, pp. 533-536, 1986.
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge (MA): MIT Press, 2016.
- M. Kusner, Y. Sun, N. Kolkin, and K. Weinberger, "From word embed- dings to document distances," in Proceedings of the 32nd International conference on machine learning -Volume 37, ser. ICML'15. JMLR.org, 2015, pp. 957-966.
- R. Guidotti, A. Monreale, S. Ruggieri, F. Turini, F. Giannotti, and D. Pe- dreschi, "A survey of methods for explaining black box models," ACM computing surveys (CSUR), vol. 51, no. 5, p. 93, 2019.
- H. Hagras, "Toward human-understandable, explainable ai," Computer, vol. 51, no. 9, pp. 28-36, 2018.
- O. Helmer and N. Rescher, "On the epistemology of the inexact sciences," Management science, vol. 6, no. 1, pp. 25-52, 1959.
- E. H. Shortliffe, R. Davis, S. G. Axline, B. G. Buchanan, C. C. Green, and S. N. Cohen, "Computer-based consultations in clinical therapeutics: explanation and rule acquisition capabilities of the mycin system," Com- puters and biomedical research, vol. 8, no. 4, pp. 303-320, 1975.
- K. Holzinger, K. Mak, P. Kieseberg, and A. Holzinger, "Can we trust machine learning results? artificial intelligence in safety-critical decision support," ERCIM News, vol. 112, no. 1, pp. 42-43, 2018.
- S. G. Vilbergsdottir, E. T. Hvannberg, and E. L.-C. Law, "Assessing the reliability, validity and acceptance of a classification scheme of usability problems (cup)," Journal of Systems and Software, vol. 87, pp. 18-37, 2014.
- M. Pröbster, M. E. Haque, and N. Marsden, "Perceptions of personas: The role of instructions," 2018 IEEE International Conference on Engineering, Technology and Innovation, ICE/ITMC 2018 -Proceedings, 8 2018.
- N. Marsden, M. Pröbster, M. E. Haque, and J. Hermann, "Cognitive styles and personas: Designing for users who are different from me," in Proceedings of the 29th Australian Conference on Computer-Human Interaction, ser. OZCHI '17. New York, NY, USA: Association for Computing Machinery, 11 2017, pp. 452-456.
- L. Nielsen, Personas -User Focused Design. London: Springer, 2019.
- N. Marsden and M. Haag, "Stereotypes and politics: Reflections on personas," in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16. New York, NY, USA: Association for Computing Machinery, 2016, pp. 4017-4031. [Online]. Available: https://doi.org/10.1145/2858036.2858151
- N. Marsden and M. Proebster, "Personas and identity: Looking at multiple identities to inform the construction of personas," in Conference on Human Factors in Computing Systems CHI 2019 -Proceedings. Association for Computing Machinery, 5 2019, pp. 1-14.
- M. Burnett, S. Stumpf, J. Macbeth, S. Makri, L. Beckwith, I. Kwan, A. Pe- ters, and W. Jernigan, "Gendermag: A method for evaluating software's gender inclusiveness," Interacting with Computers, vol. 28, pp. 760-787, 11 2016.
- A. Shekhar and N. Marsden, "Cognitive walkthrough of a learning man- agement system with gendered personas," in Proceedings of the 4th Conference on Gender & IT, ser. GenderIT '18. New York, NY, USA: Association for Computing Machinery, 5 2018, pp. 191-198.
- C. H. Goh, N. Kulathuramaiyer, and T. Zaman, "Riding waves of change: A review of personas research landscape based on the three waves of HCI," in Information and Communication Technologies for Development -14th IFIP WG 9.4 International Conference on Social Implications of Computers in Developing Countries, ICT4D 2017, Yogyakarta, Indonesia, May 22-24, 2017, Proceedings, ser. IFIP Advances in Information and Communication Technology, J. Choudrie, M. S. Islam, F. Wahid, J. M. Bass, and J. E. Priyatma, Eds., vol. 504, 2017, pp. 605-616. [Online]. Available: https://doi.org/10.1007/978-3-319-59111-7_49
- J. Pruitt and J. Grudin, "Personas: practice and theory," DUX 03: Proceed- ings of the 2003 conference on Designing for user experiences, pp. 1-15, 6 2003.
- J. S. Pruitt and T. Adlin, The Persona Lifecycle -Keeping People in Mind Throughout Product Design. USA: Elsevier Inc., 2006.
- L. Nielsen, Engaging Personas and Narrative Scenarios -a study on how a user-centered approach influenced the perception of the design process in the e-business group at AstraZeneca. PhD dissertation, 2004. [Online]. Available: https://www.personas.dk/wp-content/uploads/2019/11/samlet- udgave-til-load-1.pdf
- M. Blythe and A. Dearden, "Representing older people: Towards meaningful images of the user in design scenarios," Universal Access in the Information Society, vol. 8, pp. 21-32, 6 2009. [Online]. Available: http://teaching.shu.ac.uk/aces/amd/
- S. T. Acuña, J. W. Castro, and N. Juristo, "A HCI technique for improving requirements elicitation," Information and Software Technology, vol. 54, no. 12, pp. 1357-1375, 2012.
- A. Wilson, S. D. Paoli, P. Forbes, and M. Sachy, "Creating personas for political and social consciousness in hci design," Persona Studies, vol. 4, pp. 25-46, 11 2018.
- I. R. Floyd, M. C. Jones, and M. B. Twidale, "Resolving incommensurable debates: a preliminary identification of persona kinds, attributes, and characteristics," Artifact, vol. 2, pp. 12-26, 4 2008.
- Y. N. Chang, Y. K. Lim, and E. Stolterman, "Personas: From theory to practices," in Proceedings of the 5th Nordic Conference on Human- Computer Interaction: Building Bridges, ser. NordiCHI '08, vol. 358, no. August 2015. New York, NY, USA: Association for Computing Machinery, 2008, pp. 439-442.
- L. Nielsen and K. S. Hansen, "Personas is applicable-a study on the use of personas in denmark," in Conference on Human Factors in Computing Systems -Proceedings. Association for Computing Machinery, 2014, pp. 1665-1674.
- L. Nielsen, K. S. Hansen, J. Stage, and J. Billestrup, "A template for design personas: Analysis of 47 persona descriptions from danish industries and organizations," International Journal of Sociotechnology and Knowledge Development, vol. 7, pp. 45-61, 1 2015.
- P. Losana, J. W. Castro, X. Ferre, E. Villalba-Mora, and S. T. Acuña, "A systematic mapping study on integration proposals of the personas technique in agile methodologies," Sensors, vol. 21, no. 18, 2021. [Online]. Available: https://www.mdpi.com/1424-8220/21/18/6298
- J. Salminen, B. J. Jansen, J. An, H. Kwak, and S. gyo Jung, "Are personas done? evaluating their usefulness in the age of digital analytics," Persona Studies, vol. 4, pp. 47-65, 11 2018.
- J. Salminen, S. G. Jung, S. Chowdhury, D. R. Robillos, and B. Jansen, "The ability of personas: An empirical evaluation of altering incorrect preconceptions about users," International Journal of Human Computer Studies, vol. 153, 9 2021.
- D. Cabrero, H. Winschiers-Theophilus, and H. Mendonca, "User-created personas -a micro-cultural lens into informal settlement's youth life," in Human Work Interaction Design. Work Analysis and Interaction Design Methods for Pervasive and Smart Workplaces. 4th IFIP 13.6 Working Conference, (HWID) 2015, London, UK, June 25-26,2015, Revised Se- lected Papers, ser. IFIP Advances in Information and Communication Technology, J. A. Nocera, B. R. Barricelli, A. Lopes, P. Campos, and T. Clemmensen, Eds. Springer International Publishing, 2015, pp. 57-70.
- N. Marsden, J. Hermann, and M. Pröbster, "Developing personas, con- sidering gender: A case study," in Proceedings of the 29th Australian Conference on Computer-Human Interaction, ser. OZCHI '17. New York, NY, USA: Association for Computing Machinery, 11 2017, pp. 392-396.
- J. Salminen, K. Guan, S.-G. Jung, and B. J. Jansen, "A survey of 15 years of data-driven persona development," International Journal of Human-Computer Interaction, pp. 1-24, 4 2021. [Online]. Available: https://www.tandfonline.com/doi/full/10.1080/10447318.2021.1908670
- C. Meske, E. Bunde, J. Schneider, and M. Gersch, "Explainable artificial intelligence: Objectives, stakeholders, and future research opportunities," Information Systems Management, vol. 39, no. 1, pp. 53-63, 2022.
- V. Arya, R. K. E. Bellamy, P.-Y. Chen, A. Dhurandhar, M. Hind, S. C. Hoffman, S. Houde, Q. V. Liao, R. Luss, A. Mojsilović, S. Mourad, P. Pedemonte, R. J. Richards, P. Sattigeri, K. Shanmugam, M. Singh, K. R. Varshney, D. Wei, and Y. Zhang, "One explanation does not fit all: A toolkit and taxonomy of AI explainability techniques," CoRR2019, vol. abs/1909.03012, 9 2019. [Online]. Available: http://arxiv.org/abs/1909.03012
- A. Cooper and R. Reimann, About Face 2.0 -The Essentials of Interaction Design. John Wiley & Sons, 2003. [Online]. Available: https://flylib.com/books/en/2.153.1/
- K. Williamson, "Chapter 16 -questionnaires, individual interviews and focus group interviews," in Research Methods, 2nd ed., K. Williamson and G. Johanson, Eds. Chandos Publishing, 2018, pp. 379-403. [Online]. Available: https://www.sciencedirect.com/science/article/pii/B9780081022207000169
- C. Phellas, A. Bloch, and C. Seale, "Structured methods: interviews, ques- tionnaires and observation," in Researching Society and Culture, 3rd ed., C. Seale , Ed. United Kingdom: SAGE Publications Ltd, 2011, ch. 11, pp. 181-205.
- M. Kargl, P. Regitnig, H. Mueller, and A. Holzinger, "Towards a better understanding of the workflows: Modeling pathology processes in view of future AI integration," in Artificial Intelligence and Machine Learning for Digital Pathology, ser. Lecture Notes in Computer Science, A. Holzinger, R. Goebel, M. Mengel, and H. Müller, Eds. Cham: Springer International Publishing, 2020, vol. 12090, pp. 102-117.
- J. W. Castro and S. T. Acuña, "Extension of personas technique for the requirements stage," Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7545 LNCS, pp. 94-103, 2012.
- J. Salminen, S.-G. Jung, J. M. Santos, A. M. S. Kamel, and B. J. Jansen, "Picturing it!: The effect of image styles on user perceptions of personas," in Proceedings CHI '21. Association for Computing Machinery (ACM), 5 2021, pp. 1-16.
- J. Salminen, S. gyo Jung, J. An, H. Kwak, L. Nielsen, and B. J. Jansen, "Confusion and information triggered by photos in persona profiles," International Journal of Human Computer Studies, vol. 129, pp. 1-14, 9 2019.
- M. Pröbster, J. Hermann, and N. Marsden, "Personas and persons -an empirical study on stereotyping of personas," in Proceedings of Mensch Und Computer 2019, ser. MuC'19. New York, NY, USA: Association for Computing Machinery, 9 2019, pp. 137-146.
- T. Karras, S. Laine, and T. Aila, "A style-based generator architecture for generative adversarial networks," in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 4396-4405.
- T. Karras, S. Laine, M. Aittala, J. Hellsten, J. Lehtinen, and T. Aila, "An- alyzing and improving the image quality of stylegan," in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2020, pp. 8107-8116.
- B. Shneiderman, "Human-centered artificial intelligence: Reliable, safe and trustworthy," International Journal of Human-Computer Interaction, vol. 36, no. 6, pp. 495-504, 2020.
- A. Holzinger, "Explainable ai and multi-modal causability in medicine," Wiley i-com Journal of Interactive Media, vol. 19, no. 3, pp. 171-179, 2020. ANDREAS HOLZINGER is Visiting Professor for explainable AI at the University of Alberta, Canada since 2019 and Head of the Human- Centered AI Lab at the Medical University Graz, Austria. He received his Ph.D. in cognitive science from Graz University and his second Ph.D. in computer science from Graz University of Tech- nology. He was elected ordinary member in the Academia Europaea, the European Academy of Sciences in the section Informatics, for his pio- neering work in interactive machine learning with the human-in-the-loop. He is a full member of the European Lab for Learning and Intelligent Systems. MICHAELA KARGL received the M.S. degree in electrical engineering with a focus on biomedical engineering from Graz University of Technology, Austria, in 1993 and the B.S. degree in informa- tion and computer engineering with a focus on human-computer interaction from Graz Univer- sity of Technology, Austria, in 2017. She works as a Research Associate at the Diagnostic and Research Institute of Pathology at the Medical University Graz. Her main research interests lie in user research, user experience (UX) and usability.