Controlling Smart Technology
A Brief Review of Some Ethical Challenges
DOI:
https://doi.org/10.29173/irie478Keywords:
ethics, smart systems, autonomyAbstract
This work explores some of the key challenges for incorporating appropriate ethical behavior and respect for social norms in highly-autonomous intelligent machines. Starting with the implications of Azimov's Three Laws of Robotics, we discuss the tradeoffs in human values, as encapsulated in the popular philosophical 'Trolley Problem'. We then examine some of the concerns for how smart systems model their worlds and their interactions with humans. The paper continues with a review of artificial moral agency and phronesis, and the techniques being proposed for implementing such agents. It concludes with some notes on recent research directions. This material is primarily an adaptation of work prepared by two of the authors, as part of a report of a series of workshops on machine consciousness, which were held during the summer of 2017.
References
Asimov, I. Runaround. In: I Robot. Gnome Press. (1950)
Baars, B. J. Global workspace theory of consciousness. Progress in Brain Research, (2005)
Benedict, R. The Chrysanthemum and the Sword. Houghton Mifflin. (1946)
Boswell, J. The Life Of Samuel Johnson, LL.D. Everyman's Library (Knopf), NY. (1811)
Bringsjord, S. et al. Toward a general logicist methodology for engineering ethically correct robots. IEEE
Intelligent Systems, 21(4):38–44. (2006)
Cave, S. There’s no such thing as free will. The Atlantic. June (2016)
Chella, A. et al. Towards Conscious AI Systems. AAAI Spring Symposium Series, Stanford CA, (2019)
Coeckelbergh, M., Seibt, J., et al. Envisioning Robots in Society – Power, Politics, and Public Space. Proceedings of Robophilosophy, Vienna Austria (2018).
Danielson, P. Designing a machine to learn about the ethics of robotics: The N-Reasons platform. Ethics and information technology, 12(3):251–261. (2010)
Dietrich, E. et al. The AI Wars, 1950–2000, and Their Consequences, Journal of Artificial Intelligence and Consciousness, 9(1): 127-151. (2022). doi.org/10.1142/S2705078521300012
ESOF2020. EuroScience Open Forum, Trieste Italy. September 2020.
Gamez, D. Human and Machine Consciousness. Open Book Publishers. (2018)
Govindarajulu, N. et al. On automating the doctrine of double effect. arXiv. (2017)
Greenblatt, S. The Swerve: How the World Became Modern. WW Norton & Co. (2011)
Haidt, J. The Righteous Mind: Why Good People Are Divided by Politics and Religion. Vintage. (2013) Hume, D. An Enquiry Concerning Human Understanding. (1748)
Jarvis Thomson, Judith. The Trolley Problem. Yale Law Journal. 94 (6). (1985)
Kobie, N. The complicated truth about China's social credit system. Wired UK. June (2019)
Kulicki, P. et al. Towards a formal ethics for autonomous cars. ibid. (DEON). (2018)
Lindner, F. & Bentzen, M. A formalizaion of Kant’s second formulation of the Categorical Imperative. In 14th
Intl Conf on Deontic Logic and Normative Systems (DEON). (2018)
Murray, J. & Chella, A. Creative Explorations in AI, Robotics, and Autonomous Systems. ESOF. (2020) Rawls, J. A Theory of Justice. Belknap Press/Harvard University Press. (1971)
Rushby, J. and Sanchez, D. Technology and Consciousness, SRI International. (2018)
Schopenhauer, A. On the Freedom of the Will. Oxford: Basil Blackwell. (1839)
Smith, A. Franken-algorithms. The Guardian, Aug 29 2018.
Sullins, J. Artificial phronesis and the social robot. In Seibt, J., Norskov, M., & Andersen, S. S. (eds), What
Social Robots Can and Should Do, pages 37–39. IOS Press. (2016)
Sullins, J & Dougherty, S. Ethical Nudging of Users While They Interact with Robots. In Norkov, M. et al (eds), Culturally Sustainable Social Robotics: Proceedings of Robophilosophy, Aarhus Denmark (2020)
Tononi, G. et al. Integrated information theory: From consciousness to its physical substrate. Nature Reviews Neuroscience, 17(7):450–461. (2016)
Turilli, M. Ethical protocols design. Ethics and Information Technology, 9(1):49–62. (2007)
Von der Lieth Gardner, A. An AI Approach to Legal Reasoning. MIT Press. (1987)
Wallach, W., Allen, C., and Franklin, S. Consciousness and ethics: Artificially conscious moral agents.
International Journal of Machine Consciousness, 3(01):177–192. (2011)
Williams, D. and Murray, J. Technology and consciousness workshops: An introductory overview. Journal of Artificial Intelligence and Consciousness, 7(01): 133-140. (2020) doi.org/10.1142/S2705078520710010
Yampolskiy, R. V. Artificial intelligence safety engineering: Why machine ethics is a wrong approach. In Philosophy and Theory of Artificial Intelligence, volume 5 of Studies in Applied Philosophy, Epistemology and Rational Ethics, pages 389–396. Springer. (2013)
Yu, H. et al. Building ethics into artificial intelligence. In Proc 27th Intl Joint Conf on Artificial Intelligence (IJCAI-18), Stockholm, Sweden. (2018)
