Academia.eduAcademia.edu

Outline

2. Moral authority

2022, Moral design and technology

https://doi.org/10.3920/978-90-8686-922-0_2

Abstract

In this chapter, we will introduce the concept of moral authority in the context of technology. Technology can be value-laden, and humans increasingly make use of technology in ethical decision-making. This raises the question of moral authority: who should make the decisions on the moral ladenness of technology? In this chapter, we will first reject the existence of moral truth and incomparability of moral solutions, which leads us to the assumption that moral problems exist and can be solved. Then, we will introduce theories on moral decision-making processes, and how individual, situational and issuerelated factors play an important role in these processes. In these theories lies the basis for the assumption that it matters who has the moral authority to decide on the moral charge of technology. Since engineers represent a rather homogeneous group, there is a high risk of producing biased technology that reflects the morality of this group. Therefore, the person who programmes the value-laden technology does not necessarily have the moral authority to decide on this programming. Moral authority can be found by further analysing the moral impact of technology and the concentration of that impact. It is proposed to make a distinction between low-stake and high-stake settings on the one hand, and specific concentration of effect on individual users and broad societal effects on the other. These elements can lie at the core of allocating moral authority. Key concepts ▶ A moral problem can be defined as a situation that requires a value judgement in which more, mutually excluding, value judgements can be right ▶ When we assume moral problems exist, this means we reject the notion that moral truth exists and that moral solutions are comparable ▶ If moral problems are-partially or fully-dealt with by technology, the matter of moral authority becomes even more relevant: who gets to decide on the moral programming of technology? Bart Wernaart (ed.) Moral design and technology

References (35)

  1. Aliman, N.M. and Kester, L., 2019. Transformative Al governance and Al-empowered ethical enhancement through preemptive simulations. Delphi -Interdisciplinary Review of Emerging Technologies, 2: 23-29. https://doi.org/10.21552/delphi/2019/1/6
  2. Amnesty International, 2020. We sense trouble: automated discrimination and mass surveillance in predictive policing in the Netherlands. Available at: https://www. amnesty.nl/content/uploads/2020/09/Report-Predictive-Policing-RM-7.0-FINAL- TEXT_CK-2.pdf?x53356
  3. Auernhammer, J. (2020). Human-centered AI: the role of human-centered design research in the development of AI. DRS2020, August 2020, Brisbane, Australia. https://doi.org/10.21606/drs.2020.282
  4. Moral authority
  5. Craft, J.L., 2013. A review of the empirical ethical decision-making literature: 2004-2011. Journal of Business Ethics 117: 221-259. https://doi.org/10.1007/s10551-012-1518-9
  6. Dubbink, W., 2018. A typology of ethical problems. Ethical perspectives, 25: 683-714.
  7. Dubljević, V., 2020. Toward implementing the ADC model of moral judgment in autonomous vehicles. Science and Engineering Ethics, 26: 2461-2472. https://doi. org/10.1007/s11948-020-00242-0
  8. Foot, P., 1976. The problem of abortion and the doctrine of the double effect. The Oxford Review, 5: 5-15.
  9. Garcia, M., 2016. Racist in the machine: the disturbing implications of algorithmic bias. World Policy Journal, 33: 111-117
  10. Gerders, J.C. and Thornton, S.M., 2016. Implementable ethics for autonomous vehicles. In: Maurer M., Gerdes J., Lenz B. and Winner H. (eds.) Autonomous driving. Springer, Berlin/Heidelberg, Germany. https://doi.org/10.1007/978-3-662-48847-8_5
  11. Gilligan, C., 1982. In a different voice. Harvard University Press, Cambridge, MA, USA.
  12. Grother, P., Ngan, M. and Hanaoka, K., 2019. Face recognition vendor test (FRVT) Part 3: demographic effects. National Institute of Standards and Technology, 8280. https://doi.org/10.6028/NIST.IR.8280
  13. Johnson, M. (1993). Moral imagination, Implications of cognitive science for ethics. The University of Chicago Press, Chicago, IL, USA.
  14. Jones, T.M., 1991. Ethical decision making by individuals in organizations: an issue- contingent model. Academy of Management Review, 16: 366-395. https://doi. org/10.2307/258867.
  15. Kvalnes Ø., 2019. Moral dilemmas. In: Moral reasoning at work. Palgrave Pivot, Cham, Switzerland, pp. 11-19. https://doi.org/10.1007/978-3-030-15191-1_2
  16. Leavy, S., 2018. Gender bias in artificial intelligence: the need for diversity and gender theory in machine learning. Proceedings of the 1 st International Workshop on Gender Equality in Software Engineering (GE '18). ACM, New York, 14-16.
  17. Lin P., 2016. Why ethics matters for autonomous cars. In: Maurer M., Gerdes J., Lenz B. and Winner H. (eds.) Autonomous driving. Springer, Berlin/Heidelberg, Germany. https://doi.org/10.1007/978-3-662-48847-8_4
  18. Lockard, T., 2000. Moral uncertainty and its consequences. Oxford University Press, Oxford, UK.
  19. Maclagan, P., 2003. Varieties of moral issue and dilemma: a framework for the analysis of case material in business ethics education. Journal of Business Ethics 48: 21-32. https://doi.org/10.1023/B:BUSI.0000004364.63317.73
  20. Messerli, M. and Reuter, K., 2017. Hard cases of comparison. Philosophical Studies, 174: 2227-2250. https://doi.org/10.1007/s11098-016-0796-y
  21. Millar, J., 2014. Technology as moral proxy: Autonomy and paternalism by design. 2014 IEEE International Symposium on Ethics in Science, Technology and Engineering, Chicago, IL, USA pp. 1-7. https://doi.org/10.1109/ETHICS.2014.6893388.
  22. Millar, J., 2017. Ethics settings for autonomous vehicles. In: Lin, P., Jenkins, R. and Abney, K. (eds.) Robot ethics 2.0. Oxford University Press, Oxford, UK, pp. 20-34. Moral design and technology
  23. Bart F. W. Wernaart Nyholm, S. and Smids, J., 2016. The ethics of accident-algorithms for self-driving cars: an applied trolley problem? Ethical Theory and Moral Practice, 19: 1275-1289. https://doi.org/10.1007/s10677-016-9745-2
  24. Pen, C-J. and Wernaart, B., 2022. Decentralized government and global challenges: how the Dutch datacenter debate demonstrates the need for powerful and hybrid governance. Bestuurskunde, ###: ###-###.
  25. Raz, J., 1986. Value incommensurability: some preliminaries. Proceedings of the Aristotelian Society, 86: 117-134. https://doi.org/10.1093/aristotelian/86.1.117
  26. Rest, J.R., 1986. Moral development: advances in research and theory. Praegerm, New York, NY, USA.
  27. Schwartz, M.S., 2016. Ethical decision-making theory: an integrated approach. Journal of Business Ethics 139: 755-776. https://doi.org/10.1007/s10551-015-2886-8
  28. Sepielli, A., 2008. Moral uncertainty and the principle of equity among moral theories. Philosophy and Phenomenological Research, 86: 580-589. https://doi.org/10.1111/ j.1933-1592.2011.00554.x
  29. Thomson, J., 1985. The trolley problem. The Yale Law Journal, 94: 1395-1415. https:// doi.org/10.2307/796133
  30. Toffler, B.L., 1986. Tough choices: managers talk ethics. Journal of Business Ethics, 8: 252-288.
  31. Trevino, L.K., Weaver, G.R. and Reynolds, S.J., 2006. Behavioural ethics in organizations. Journal of Management 32: 951-990. https://doi.org/10.1177/0149206306294258
  32. Van de Poel, I., 2015. Values in engineering and technology. In: Gonzalez, W.J. (ed.) New perspectives on technology, values, and ethics. Boston Studies in the Philosophy and History of Science, Volume 315, Springer, Cham, Switzerland, pp. 29-46.
  33. Verbeek, P., 2006. Materializing morality, design ethics and technological mediation. Science, Technology & Human Values, 31: 361-379. https://doi.org/10.1177/ 0162243905285847
  34. Wernaart, B., 2021. Developing a roadmap for the moral programming of smart technology. Technology in Society, 46: 101466. https://doi.org/10.1016/j.techsoc.2020.101466 Legal texts, policy documents and case law
  35. Grapperhaus, F., 2020 11 December. Reactie op rapport Amnesty International over massasurveillance. Available at: https://www.rijksoverheid.nl/documenten/ kamerstukken/2020/12/11/tk-reactie-op-rapport-amnesty-international-over- massasurveillance.