Academia.eduAcademia.edu

Outline

“Democratizing AI” and the Concern of Algorithmic Injustice

2024, Philosophy & Technology

https://doi.org/10.1007/S13347-024-00792-2

Abstract

The call to make artificial intelligence (AI) more democratic, or to “democratize AI,” is sometimes framed as a promising response for mitigating algorithmic injustice or making AI more aligned with social justice. However, the notion of “democratizing AI” is elusive, as the phrase has been associated with multiple meanings and practices, and the extent to which it may help mitigate algorithmic injustice is still underexplored. In this paper, based on a socio-technical understanding of algorithmic injustice, I examine three notable notions of democratizing AI and their associated measures—democratizing AI use, democratizing AI development, and democratizing AI governance—regarding their respective prospects and limits in response to algorithmic injustice. My examinations reveal that while some versions of democratizing AI bear the prospect of mitigating the concern of algorithmic injustice, others are somewhat limited and might even function to perpetuate unjust power hierarchies. This analysis thus urges a more fine-grained discussion on how to democratize AI and suggests that closer scrutiny of the power dynamics embedded in the socio-technical structure can help guide such explorations.

References (74)

  1. Adamson, Adewole S., and Avery Smith. 2018. "Machine Learning and Health Care Disparities in Dermatology." JAMA Dermatology 154 (11): 1247-48.
  2. AI Index Steering Committee. 2023. "Artificial Intelligence Index Report 2023." Institute for Human- Centered AI, Stanford University. https://aiindex.stanford.edu/report/.
  3. AI Now Institute. 2023. "The Climate Costs of Big Tech." AI Now Institute. April 11, 2023. https://ainowinstitute.org/spotlight/climate.
  4. Allen, Bibb, Sheela Agarwal, Jayashree Kalpathy-Cramer, and Keith Dreyer. 2019. "Democratizing AI." Journal of the American College of Radiology: JACR 16 (7): 961-63.
  5. Anderson, Elizabeth. 2006. "The Epistemology of Democracy." Episteme; Rivista Critica Di Storia Delle Scienze Mediche E Biologiche 3 (1-2): 8-22.
  6. Ardila, Rosana, Megan Branson, Kelly Davis, Michael Henretty, Michael Kohler, Josh Meyer, Reuben Morais, Lindsay Saunders, Francis M. Tyers, and Gregor Weber. 2019. "Common Voice: A Massively-Multilingual Speech Corpus." arXiv [cs.CL]. arXiv. http://arxiv.org/abs/1912.06670.
  7. Arnstein, Sherry R. 1969. "A Ladder of Citizen Participation." Journal of the American Institute of Planners 35 (4): 216-24.
  8. Benjamin, Ruha. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. John Wiley & Sons.
  9. Bianchi, Federico, Pratyusha Kalluri, Esin Durmus, Faisal Ladhak, Myra Cheng, Debora Nozza, Tatsunori Hashimoto, Dan Jurafsky, James Zou, and Aylin Caliskan. 2023. "Easily Accessible Text- to-Image Generation Amplifies Demographic Stereotypes at Large Scale." In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, 1493-1504. FAccT '23. New York, NY, USA: Association for Computing Machinery.
  10. Binns, Reuben. 2020. "On the Apparent Conflict between Individual and Group Fairness." In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 514-24.
  11. FAT* '20. New York, NY, USA: Association for Computing Machinery.
  12. Birhane, Abeba. 2021. "Algorithmic Injustice: A Relational Ethics Approach." Patterns (New York, N.Y.) 2 (2): 100205.
  13. Birhane, Abeba, William Isaac, Vinodkumar Prabhakaran, Mark Diaz, Madeleine Clare Elish, Iason Gabriel, and Shakir Mohamed. 2022. "Power to the People? Opportunities and Challenges for Participatory AI." In Equity and Access in Algorithms, Mechanisms, and Optimization, 1-8. EAAMO '22 6. New York, NY, USA: Association for Computing Machinery.
  14. Bommasani, Rishi, Kathleen A. Creel, Ananya Kumar, Dan Jurafsky, and Percy Liang. 2022. "Picking on the Same Person: Does Algorithmic Monoculture Lead to Outcome Homogenization?" arXiv [cs.LG]. arXiv. http://arxiv.org/abs/2211.13972.
  15. Buolamwini, Joy, and Timnit Gebru. 2018. "Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification." In Proceedings of the 1st Conference on Fairness, Accountability and Transparency, edited by Sorelle A. Friedler and Christo Wilson, 81:77-91. Proceedings of Machine Learning Research. PMLR.
  16. Chung, Ryoa. 2021. "Structural Health Vulnerability: Health Inequalities, Structural and Epistemic Injustice." Journal of Social Philosophy 52 (2): 201-16.
  17. Clegg, Nick, and Global Affairs. 2023. "Bringing People Together to Inform Decision-Making on Generative AI." Meta. June 22, 2023. https://about.fb.com/news/2023/06/generative-ai-community- forum/.
  18. Collins, Patricia Hill. 2002. Black Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment. Routledge.
  19. Costanza-Chock, Sasha. 2018. "Design Justice, A.i., and Escape from the Matrix of Domination." Journal of Design and Science, July. https://doi.org/10.21428/96c8d426.
  20. ---. 2020. "Design Justice: Community-Led Practices to Build the Worlds We Need." https://library.oapen.org/handle/20.500.12657/43542.
  21. Crawford, Kate. 2021. The Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence. Yale University Press.
  22. Dahl, Robert A. 2008. Democracy and Its Critics. Yale University Press.
  23. Davis, Jenny L., Apryl Williams, and Michael W. Yang. 2021. "Algorithmic Reparation." Big Data & Society 8 (2): 20539517211044808.
  24. Delgado, Fernando, Stephen Yang, Michael Madaio, and Qian Yang. 2021. "Stakeholder Participation in AI: Beyond 'Add Diverse Stakeholders and Stir.'" arXiv [cs.AI]. arXiv. http://arxiv.org/abs/2111.01122.
  25. Deng, Jianyang, and Yijia Lin. 2022. "The Benefits and Challenges of ChatGPT: An Overview." Frontiers in Computing and Intelligent Systems 2 (2): 81-83.
  26. Escobar, Oliver, and Stephen Elstub. 2017. "Forms of Mini-Publics." newDemocracy Foundation. Eveleth, Rose. 2014. "How Self-Tracking Apps Exclude Women." Atlantic 15. http://www.leeannhunter.com/digital/wp-content/uploads/2015/08/Eveleth.SelfTrackingApps.pdf.
  27. Fishkin, James. 2009. When the People Speak: Deliberative Democracy and Public Consultation. OUP Oxford.
  28. Floridi, Luciano. 2019. "Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical." Philosophy & Technology 32 (2): 185-93.
  29. Gabriel, Iason. 2022. "Toward a Theory of Justice for Artificial Intelligence." Daedalus 151 (2): 218-31.
  30. Gebru, Timnit. 2020. "Race and Gender." In The Oxford Handbook of Ethics of AI, edited by Markus D. Dubber, Frank Pasquale, and Sunit Das, 253-70. Oxford University Press.
  31. Gilens, Martin. 2012. Affluence and Influence. Princeton University Press.
  32. Gochfeld, Michael, and Joanna Burger. 2011. "Disproportionate Exposures in Environmental Justice and Other Populations: The Importance of Outliers." American Journal of Public Health 101 Suppl 1 (Suppl 1): S53-63.
  33. Goodin, Robert E. 2007. "Enfranchising All Affected Interests, and Its Alternatives." Philosophy & Public Affairs 35 (1): 40-68.
  34. Green, Ben. 2022. "Escaping the Impossibility of Fairness: From Formal to Substantive Algorithmic Fairness." Philosophy & Technology 35 (4): 90.
  35. Grönlund, Kimmo, Maija Setälä, and Kaisa Herne. 2010. "Deliberation and Civic Virtue: Lessons from a Citizen Deliberation Experiment." European Political Science Review 2 (1): 95-117.
  36. Groves, Lara, Aidan Peppin, Andrew Strait, and Jenny Brennan. 2023. "Going Public: The Role of Public Participation Approaches in Commercial AI Labs." In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, 1162-73. FAccT '23. New York, NY, USA: Association for Computing Machinery.
  37. Gulshan, Varun, Lily Peng, Marc Coram, Martin C. Stumpe, Derek Wu, Arunachalam Narayanaswamy, Subhashini Venugopalan, et al. 2016. "Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs." JAMA: The Journal of the American Medical Association 316 (22): 2402-10.
  38. Hacker, Jacob S., and Paul Pierson. 2010. Winner-Take-All Politics: How Washington Made the Rich Richer--and Turned Its Back on the Middle Class. Simon and Schuster.
  39. Hagendorff, Thilo. 2020. "The Ethics of AI Ethics: An Evaluation of Guidelines." Minds and Machines 30 (1): 99-120.
  40. Hamidi, Foad, Morgan Klaus Scheuerman, and Stacy M. Branham. 2018. "Gender Recognition or Gender Reductionism? The Social Implications of Embedded Gender Recognition Systems." In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1-13. CHI '18. New York, NY, USA: Association for Computing Machinery.
  41. Harding, Sandra. 1992. "RETHINKING STANDPOINT EPISTEMOLOGY: WHAT IS 'STRONG OBJECTIVITY?'" The Centennial Review 36 (3): 437-70.
  42. Hasbe, Sudhir, and Ryan Lippert. 2020. "Democratization of Machine Learning and Artificial Intelligence with Google Cloud," November 16, 2020. https://cloud.google.com/blog/products/data- analytics/democratization-of-ml-and-ai-with-google-cloud.
  43. Haslanger, Sally. 2016. "What Is a (social) Structural Explanation?" Philosophical Studies 173: 113-30.
  44. Himmelreich, Johannes. 2021. "Should We Automate Democracy?" In . Oxford University Press.
  45. ---. 2022. "Against 'democratizing AI.'" AI & Society, January. https://doi.org/10.1007/s00146-021- 01357-z.
  46. Hoffmann, Anna Lauren. 2019. "Where Fairness Fails: Data, Algorithms, and the Limits of Antidiscrimination Discourse." Information, Communication and Society 22 (7): 900-915.
  47. Jo, Eun Seo, and Timnit Gebru. 2020. "Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learning." In Proceedings of the 2020 Conference on Fairness, Accountability, and How Gender, Race, and Ethnicity Structure the World's Most Powerful Industry." Annual Review of Sociology 49 (1): 319-38.
  48. Nelson, Alan. 2002. "Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care." Journal of the National Medical Association 94 (8): 666-68.
  49. Niemeyer, Simon. 2011. "The Emancipatory Effect of Deliberation: Empirical Lessons from Mini- Publics." Politics & Society 39 (1): 103-40.
  50. Noble, Safiya Umoja. 2018. Algorithms of Oppression: How Search Engines Reinforce Racism. NYU Press.
  51. Noorman, Merel, and Tsjalling Swierstra. 2023. "Democratizing AI from a Sociotechnical Perspective." Minds and Machines 33 (4): 563-86.
  52. Nordgren, Anders. 2022. "Artificial Intelligence and Climate Change: Ethical Issues." Journal of Information, Communication and Ethics in Society 21 (1): 1-15.
  53. Obermeyer, Ziad, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. "Dissecting Racial Bias in an Algorithm Used to Manage the Health of Populations." Science 366 (6464): 447-53.
  54. Ragnedda, Massimo, and Glenn W. Muschert. 2013. The Digital Divide: The Internet and Social Inequality in International Perspective. Routledge.
  55. Rahwan, Iyad. 2018. "Society-in-the-Loop: Programming the Algorithmic Social Contract." Ethics and Information Technology 20 (1): 5-14.
  56. Rini, Regina, and Leah Cohen. 2022. "Deepfakes, Deep Harms." Journal of Ethics and Social Philosophy 22 (2). https://doi.org/10.26556/jesp.v22i2.1628.
  57. Rubeis, Giovanni, Keerthi Dubbala, and Ingrid Metzler. 2022. "'Democratizing' Artificial Intelligence in Medicine and Healthcare: Mapping the Uses of an Elusive Term." Frontiers in Genetics 13. https://doi.org/10.3389/fgene.2022.902542.
  58. Saetra, Henrik Skaug, Harald Borgebund, and Mark Coeckelbergh. 2022. "Avoid Diluting Democracy by Algorithms." Nature Machine Intelligence 4 (10): 804-6.
  59. Seger, Elizabeth, Aviv Ovadya, Ben Garfinkel, Divya Siddarth, and Allan Dafoe. 2023. "Democratising AI: Multiple Meanings, Goals, and Methods." In . New York, NY, USA: ACM. https://doi.org/10.1145/3600211.3604693.
  60. Shankar, Shreya, Yoni Halpern, Eric Breck, James Atwood, Jimbo Wilson, and D. Sculley. 2017. "No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing World." arXiv [stat.ML]. arXiv. http://arxiv.org/abs/1711.08536.
  61. Siu, Alice. 2017. "Deliberation & the Challenge of Inequality." Daedalus 146 (3): 119-28.
  62. Sloane, Mona, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2020. "Participation Is Not a Design Fix for Machine Learning." arXiv [cs.CY]. arXiv. http://arxiv.org/abs/2007.02423.
  63. Smith, Peter, and Laura Smith. 2021. "Artificial Intelligence and Disability: Too Much Promise, yet Too Little Substance?" AI and Ethics 1 (1): 81-86.
  64. Solaiman, Irene. 2023. "The Gradient of Generative AI Release: Methods and Considerations." In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, 111-22.
  65. FAccT '23. New York, NY, USA: Association for Computing Machinery.
  66. Strubell, Emma, Ananya Ganesh, and Andrew McCallum. 2020. "Energy and Policy Considerations for Modern Deep Learning Research." Proceedings of the AAAI Conference on Artificial Intelligence 34 (09): 13693-96.
  67. Veer, Sabine N. van der, Lisa Riste, Sudeh Cheraghi-Sohi, Denham L. Phipps, Mary P. Tully, Kyle Bozentko, Sarah Atwood, et al. 2021. "Trading off Accuracy and Explainability in AI Decision- Making: Findings from 2 Citizens' Juries." Journal of the American Medical Informatics Association: JAMIA 28 (10): 2128-38.
  68. Wagner, Ben. 2018. Ethics as an Escape from Regulation. From "ethics-Washing" to Ethics-Shopping? Philipps-Universität Marburg.
  69. Wolf, Christine T. 2020. "Democratizing AI? Experience and Accessibility in the Age of Artificial Intelligence." XRDS 26 (4): 12-15.
  70. Wong, Pak-Hang. 2020. "Democratizing Algorithmic Fairness." Philosophy & Technology 33 (2): 225- 44.
  71. Wylie, Alison. 2003. "Why Standpoint Matters." In Science and Other Cultures: Issues in Philosophies of Science and Technology, edited by Robert Figueroa and Sandra G. Harding, 26-48. Routledge, New York.
  72. Young, Iris Marion. 2011. Responsibility for Justice. Oxford University Press.
  73. Zimmermann, Annette, Elena Di Rossa, and Hochan Kim. 2020. "Technology Can't Fix Algorithmic Injustice." Boston Review, January 9, 2020. https://www.bostonreview.net/articles/annette- zimmermann-algorithmic-political/.
  74. Zuboff, Shoshana. 2019. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. PublicAffairs.