Current robot systems are becoming increasingly intelligent. The embedded systems used for this have significantly better technical capabilities, so that more abstract programming of complex motion control combined with a variety of sensory capabilities can be achieved. The interaction between humans and robots, as well as between robots themselves, is thus increasingly coming to the fore as a field of experimentation for future applications.

As part of a measure to improve the quality of teaching, we have various robot systems at our disposal with which we have achieved initial results in a previous project (see videos!).
We now want to create and research further exciting fields of interaction between robots and humans and between robots themselves in the upcoming system project. In particular, we can investigate the possibilities of computer vision and motion control for controlling the robots in this environment.

Video Group 1 Nao Video Group 2 Nao Video Group Sphero Video Group Cozmo

The robots
We have a variety of robots with very different characteristics at our disposal. With two humanoid NAO robot systems, which are already equipped with a variety of sensors (including two HD cameras), we can test the interaction with humanoid systems.

Motion and interaction
Our first focus will be on investigating and optimising the movement characteristics of the robots. To this end, we will analyse the capabilities provided and supplement or replace them with our own software. As a second focus, we want to improve the interaction possibilities with humans and other robots as well as with the environment such as the respective room, and in addition to the cameras already installed in the robot system, further external cameras could also be used. To begin with, we will present you with a series of ideas in the kick-off, from which you will develop your own objectives and realisations.

Kick-off and preparation phase
In a kick-off, we start by presenting and discussing various ideas for scenarios with robots. We also provide information about the further process and the available hardware as well as selected procedures from SCRUM as project specifications. You will use the following days for technical preparation and to analyse the implementation options. From this, you will develop your project objective and plan in the form of a presentation.
Project objectives, the results of which could later be demonstrated to visitors to our faculty at a suitable opportunity, would be particularly suitable for this.

Block phase as a full-time project
With the presentation of the project objectives, we start the block phase in which you work full-time (8 hours/week) on the project. We take on the role of the client. As is usual in practice, any need for change that arises during the project must be agreed with us as the client. The results of the project will be presented in a final presentation.

Prior knowledge
Good programming skills and basic knowledge of graphical data processing are required as a minimum. Knowledge of software development for embedded systems or the basics of robotics is also an advantage.

The dates
Block event at the end of the lecture-free period in September!

Kick-off event: 27.08.19
Block phase: 09-20.09.19
Final presentation: 26/09/19

The lecturers
Prof. Dr Elke Hergenröther - Visual Computing and Foundations of Computer Science
Prof. Dr Thomas Horsch - Computer Engineering and Fundamentals of Computer Science, Robotics
Prof Dr Jens-Peter Akelbein - Computer science and software engineering, embedded systems, IoT

supported by

Rudi Scheitler - Laboratory Engineer Robotics
Mario Hoss - research assistant
Bettina Kurz - research assistant and laboratory engineer Emb. Systems