A research is shown touching a prototzpe of artificial skin.
Prof. Gordon Cheng, TUM Institute for Cognitive Systems, with a prototype of CellulARSkin. (Photo: A. Heddergott / TUM)

TUM technology endows brain-controlled exoskeleton with sense of touchOpening ceremony of FIFA World Cup: Paralyzed person kicks the first ball

During the opening ceremony of the FIFA 2014 World Cup in Brazil, a paralyzed person wearing a brain-controlled robotic exoskeleton made the first kick. Technology developed at the Technische Universität München (TUM) endows the exoskeleton with sense of touch.

The Walk Again Project is an international collaboration of more than one hundred scientists, led by Prof. Miguel Nicolelis of Duke University and the International Institute for Neurosciences of Natal, Brazil. Prof. Gordon Cheng, head of the Institute for Cognitive Systems at the Technische Universität München (TUM), is a leading partner.

Eight Brazilian patients, men and women between 20 and 40 years of age who are paralyzed from the waist down, have been training for months to use the exoskeleton. The system works by recording electrical activity in the patient's brain, recognizing his or her intention – such as to take a step or kick a ball – and translating that to action. It also gives the patient tactile feedback using sensitive artificial skin created by Cheng's institute.

The feeling of touching the ground

Inspiration for this so-called CellulARSkin technology – as well as for the Walk Again Project itself – came from a 2008 collaboration. As Cheng sums up that complex and widely reported experiment, "Miguel set up a monkey walking on a treadmill in North Carolina, and then I made my humanoid robot walk with the signal in Kyoto." It was a short step for the researchers to envision a paralyzed person walking with the help of a robotic exoskeleton that could be guided by mental activity alone.

"Our brains are very adaptive in the way that we can extend our embodiment to use tools," Cheng says, "as in driving a car or eating with chopsticks. After the Kyoto experiment, we felt certain that the brain could also liberate a paralyzed person to walk using an external body." It was clear that technical advances would be required to allow a relatively compact, lightweight exoskeleton to be assembled, and that visual feedback would not be enough. A sense of touch would be essential for the patient's emotional comfort as well as control over the exoskeleton. Thus the challenge was to give a paralyzed person, together with the ability to walk, the feeling of touching the ground.

A versatile solution

Upon joining TUM in 2010, Cheng made it a research priority for his institute to improve on the state of the art in tactile sensing for robotic systems. The result, CellulARSkin, provides a framework for a robust and self-organizing surface sensor network. It can be implemented using standard off-the-shelf hardware and thus will benefit from future improvements in miniaturization, performance, and cost.

The basic unit is a flat, six-sided package of electronic components including a low-power-consumption microprocessor as well as sensors that detect pre-touch proximity, pressure, vibration, temperature, and even movement in three-dimensional space. Any number of these individual "cells" can be networked together in a honeycomb pattern, protected in the current prototype by a rubbery skin of molded elastomer.

"It's not just the sensor that's important," Cheng says. "The intelligence of the sensor is even more important." Cooperation among the networked cells, and between the network and a central system, allows CellulARSkin to configure itself for each specific application and to recover automatically from certain kinds of damage. These capabilities offer advantages in enabling smarter, safer interaction of machines with people, and in rapid setup of industrial robots – as is being pursued in the EU-sponsored project "Factory in a Day."

In the Walk Again Project, CellulARSkin is being used in two ways. Integrated with the exoskeleton, for example on the bottoms of the feet, the artificial skin sends signals to tiny motors that vibrate against the patient's arms. Through training with this kind of indirect sensory feedback, a patient can learn to incorporate the robotic legs and feet into his or her own body schema. CellulARSkin is also being wrapped around parts of the patient's own body to help the medical team monitor for any signs of distress or discomfort.

A milestone, but "just the beginning"

"I think some people see the World Cup opening as the end," Cheng says, "but it's really just the beginning. This may be a major milestone, but we have a lot more work to do." He views the event as a public demonstration of what science can do for people. "Also, I see it as a great tribute to all the patients' hard work and their bravery!"

High-resolution photos to download:


Prof. Gordon Cheng
Institute for Cognitive Systems
Technische Universität München
Tel: +49 89 289 26800

Further information:

Technical University of Munich

Corporate Communications Center

Article at tum.de

Gewinner des Zukunftspreises 2017: Prof. Sami Haddadin, Dr. Simon Haddadin und Dipl.-Inf. Sven Parusel mit einem sensiblen und intuitiv bedienbaren Roboterassistenten.  (Foto: Ansgar Pudenz)

Highly endowed German Future Prize 2017 for new TUM professor

Federal President Frank-Walter Steinmeier has awarded the newly appointed professor of the Technical University of Munich (TUM) Sami Haddadin with the German Future Prize 2017. His project „Centre for Man - Robot Assistants...

TUM-Prof. Gordon Cheng neben einer seiner Robotik-Kreationen: Ein Roboterarm mit der von Cheng entwickelten künstlichen Haut.

Prof. Gordon Cheng named IEEE Fellow 2017

The Institute of Electrical and Electronics Engineers (IEEE) has chosen Prof. Gordon Cheng as an IEEE Fellow for 2017. Cheng, head of the Technical University of Munich’s (TUM) Institute for Cognitive Systems, is being...

Am bionischen Rollstuhl sind zwei "Füße" angebracht, die das Treppensteigen möglich machen.

Expanded mobility with the bionic wheelchair

People confined to a wheelchair are still confronted with insurmountable obstacles in everyday life – even in today’s more wheelchair-accessible society. There are often no elevators in a building – or if so, they’re out of...

Prof. Gordon Cheng.

"Robots help us to understand humans"

At the opening ceremony of the 2014 Soccer World Cup in Brazil a paraplegic Brazilian man kicked off the first ball of the tournament himself. The young man was wearing an exoskeleton whose movements he controlled using his...

Dongheui Lee, Professorin für Dynamische Mensch-Roboter-Interaktion in der Automatisierungstechnik an der TUM, erhält eine Helmholtz-Professur. (Foto: A. Heddergott / TUM)

Outstanding support for TUM scientist

Dongheui Lee (38), Professor for Dynamic Human-Robot Interaction at the Technical University of Munich (TUM), has been granted a highly sought-after Helmholtz professorship. Nation-wide, only six of these professorships...

Philipp Mittendorfer und die Roboter-Haut "Cellul.A.R.Skin" (Bild: Astrid Eckert / TUM)

BBC "Horizons" highlights artificial skin for robots

The current episode of "Horizons" on BBC World News focuses on technology inspired by nature – including sensitive artificial skin developed by Philipp Mittendorfer at TUM's Institute for Cognitive Systems. On the show, he...