Controlling Smart Technology

A Brief Review of Some Ethical Challenges

Authors

  • John Murray
  • John Rushby
  • Daniel Sanchez

DOI:

https://doi.org/10.29173/irie478

Keywords:

ethics, smart systems, autonomy

Abstract

This work explores some of the key challenges for incorporating appropriate ethical behavior and respect for social norms in highly-autonomous intelligent machines. Starting with the implications of Azimov's Three Laws of Robotics, we discuss the tradeoffs in human values, as encapsulated in the popular philosophical 'Trolley Problem'. We then examine some of the concerns for how smart systems model their worlds and their interactions with humans. The paper continues with a review of artificial moral agency and phronesis, and the techniques being proposed for implementing such agents. It concludes with some notes on recent research directions. This material is primarily an adaptation of work prepared by two of the authors, as part of a report of a series of workshops on machine consciousness, which were held during the summer of 2017.

References

Asimov, I. Runaround. In: I Robot. Gnome Press. (1950)

Baars, B. J. Global workspace theory of consciousness. Progress in Brain Research, (2005)

Benedict, R. The Chrysanthemum and the Sword. Houghton Mifflin. (1946)

Boswell, J. The Life Of Samuel Johnson, LL.D. Everyman's Library (Knopf), NY. (1811)

Bringsjord, S. et al. Toward a general logicist methodology for engineering ethically correct robots. IEEE

Intelligent Systems, 21(4):38–44. (2006)

Cave, S. There’s no such thing as free will. The Atlantic. June (2016)

Chella, A. et al. Towards Conscious AI Systems. AAAI Spring Symposium Series, Stanford CA, (2019)

Coeckelbergh, M., Seibt, J., et al. Envisioning Robots in Society – Power, Politics, and Public Space. Proceedings of Robophilosophy, Vienna Austria (2018).

Danielson, P. Designing a machine to learn about the ethics of robotics: The N-Reasons platform. Ethics and information technology, 12(3):251–261. (2010)

Dietrich, E. et al. The AI Wars, 1950–2000, and Their Consequences, Journal of Artificial Intelligence and Consciousness, 9(1): 127-151. (2022). doi.org/10.1142/S2705078521300012

ESOF2020. EuroScience Open Forum, Trieste Italy. September 2020.

Gamez, D. Human and Machine Consciousness. Open Book Publishers. (2018)

Govindarajulu, N. et al. On automating the doctrine of double effect. arXiv. (2017)

Greenblatt, S. The Swerve: How the World Became Modern. WW Norton & Co. (2011)

Haidt, J. The Righteous Mind: Why Good People Are Divided by Politics and Religion. Vintage. (2013) Hume, D. An Enquiry Concerning Human Understanding. (1748)

Jarvis Thomson, Judith. The Trolley Problem. Yale Law Journal. 94 (6). (1985)

Kobie, N. The complicated truth about China's social credit system. Wired UK. June (2019)

Kulicki, P. et al. Towards a formal ethics for autonomous cars. ibid. (DEON). (2018)

Lindner, F. & Bentzen, M. A formalizaion of Kant’s second formulation of the Categorical Imperative. In 14th

Intl Conf on Deontic Logic and Normative Systems (DEON). (2018)

Murray, J. & Chella, A. Creative Explorations in AI, Robotics, and Autonomous Systems. ESOF. (2020) Rawls, J. A Theory of Justice. Belknap Press/Harvard University Press. (1971)

Rushby, J. and Sanchez, D. Technology and Consciousness, SRI International. (2018)

Schopenhauer, A. On the Freedom of the Will. Oxford: Basil Blackwell. (1839)

Smith, A. Franken-algorithms. The Guardian, Aug 29 2018.

Sullins, J. Artificial phronesis and the social robot. In Seibt, J., Norskov, M., & Andersen, S. S. (eds), What

Social Robots Can and Should Do, pages 37–39. IOS Press. (2016)

Sullins, J & Dougherty, S. Ethical Nudging of Users While They Interact with Robots. In Norkov, M. et al (eds), Culturally Sustainable Social Robotics: Proceedings of Robophilosophy, Aarhus Denmark (2020)

Tononi, G. et al. Integrated information theory: From consciousness to its physical substrate. Nature Reviews Neuroscience, 17(7):450–461. (2016)

Turilli, M. Ethical protocols design. Ethics and Information Technology, 9(1):49–62. (2007)

Von der Lieth Gardner, A. An AI Approach to Legal Reasoning. MIT Press. (1987)

Wallach, W., Allen, C., and Franklin, S. Consciousness and ethics: Artificially conscious moral agents.

International Journal of Machine Consciousness, 3(01):177–192. (2011)

Williams, D. and Murray, J. Technology and consciousness workshops: An introductory overview. Journal of Artificial Intelligence and Consciousness, 7(01): 133-140. (2020) doi.org/10.1142/S2705078520710010

Yampolskiy, R. V. Artificial intelligence safety engineering: Why machine ethics is a wrong approach. In Philosophy and Theory of Artificial Intelligence, volume 5 of Studies in Applied Philosophy, Epistemology and Rational Ethics, pages 389–396. Springer. (2013)

Yu, H. et al. Building ethics into artificial intelligence. In Proc 27th Intl Joint Conf on Artificial Intelligence (IJCAI-18), Stockholm, Sweden. (2018)

Downloads

Published

2022-08-22

How to Cite

Murray, John, John Rushby, and Daniel Sanchez. 2022. “Controlling Smart Technology: A Brief Review of Some Ethical Challenges”. The International Review of Information Ethics 31 (1). Edmonton, Canada. https://doi.org/10.29173/irie478.

Issue

Vol. 31 No. 1 (2022): Ethics in the Age of Smart Systems: Special Issue

Section

Articles

License

Under the CC-BY 4.0 license, you have the right to:

Share — copy and redistribute the material in any medium or format
Adapt — remix, transform, and build upon the material for any purpose, even commercially.

Under the following terms:
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.