Professor Alena Buyx on the embedded ethics approach in AI development
"Ethics must be part of the development process"
Professor Buyx, the discussions surrounding a greater emphasis on ethics in AI research have greatly intensified in recent years, to the point where one might speak of "ethics hype" …
… and many committees in Germany and around the world such as the German Ethics Council or the EU Commission High-Level Expert Group on Artificial Intelligence have responded. They are all in agreement: We need more ethics in the development of AI-based health technologies. But how do things look in practice for engineers and designers? Concrete solutions are still few and far between. In a joint pilot project with two Integrative Research Centers at TUM, the Munich School of Robotics and Machine Intelligence (MSRM) with its director, Prof. Sami Haddadin, and the Munich Center for Technology in Society (MCTS), with Prof. Ruth Müller, we want to try out the embedded ethics approach. We published the proposal in Nature Machine Intelligence at the end of July.
What exactly is meant by the "embedded ethics approach"?
The idea is to make ethics an integral part of the research process by integrating ethicists into the AI development team from day one. For example, they attend team meetings on a regular basis and create a sort of "ethical awareness" for certain issues. They also raise and analyze specific ethical and social issues.
Is there an example of this concept in practice?
The Geriatronics Research Center, a flagship project of the MSRM in Garmisch-Partenkirchen, is developing robot assistants to enable people to live independently in old age. The center's initiatives will include the construction of model apartments designed to try out residential concepts where seniors share their living space with robots. At a joint meeting with the participating engineers, it was noted that the idea of using an open concept layout everywhere in the units – with few doors or individual rooms – would give the robots considerable range of motion. With the seniors, however, this living concept could prove upsetting because they are used to having private spaces. At the outset, the engineers had not given explicit consideration to this aspect.
The approach sounds promising. But how can we avoid "embedded ethics" from turning into an "ethics washing" exercise, offering companies a comforting sense of "being on the safe side" when developing new AI technologies?
That's not something we can be certain of avoiding. The key is mutual openness and a willingness to listen, with the goal of finding a common language – and subsequently being prepared to effectively implement the ethical aspects. At TUM we are ideally positioned to achieve this. Prof. Sami Haddadin, the director of the MSRM, is also a member of the EU High-Level Group of Artificial Intelligence. In his research, he is guided by the concept of human centered engineering. Consequently, he has supported the idea of embedded ethics from the very beginning. But one thing is certain: Embedded ethics alone will not suddenly make AI "turn ethical". Ultimately, that will require laws, codes of conduct and possibly state incentives.
Stuart McLennan, Amelia Fiske, Leo Anthony Celi, Ruth Müller, Jan Harder, Konstantin Ritt, Sami
Haddadin, Alena Buyx: "An embedded ethics approach for AI development”.
Nature Machine Intelligence, published on July 31, 2020. DOI: 10.1038/s42256-020-0214-1
- Prof. Alena Buyx
- The Munich School of Robotics and Machine Intelligence (MSRM) is an Integrative Research Center at TUM. Its purpose is to research the fundamentals of robotics, perception and artificial intelligence in order to develop technological solutions in the areas of health, work and mobility. Prof. Sami Haddadin is Director of the MSRM and holds the Chair of Robotics and System Intelligence.
- The Munich Center for Technology in Society (MCTS) is an Integrative Research Center at TUM. As one of the most prominent centers for Science and Technology Studies (STS) in Germany, it is dedicated to understanding and reflexively shaping the multiple interactions between science, technology and society. Ruth Müller is a Professor of Science and Technology Policy at the Munich Center for Technology in Society. Her professorship is a joint appointment of the TUM School of Management and the TUM School of Life Sciences.
- The project is funded by the Bavarian Research Institute for Digital Transformation (bidt).
- Images for editorial use
Contacts to this article:
Prof. Alena Buyx
Technical University of Munich (TUM)
Ethics in Medicine and Health Technologies
Tel: +49 89 4140 6961