Skip to content

GesInA40

Menschliche Hände aus der Vogelperspektive auf denen die Knochen in verschiedenen Farbenaufgezeichnet sind.  Die Hände greifen nach etwas auf einem weißen Tisch.
  1. Artifical Intelligence and Data Science
  2. Intelligent Sensors and Signals

Gesture-based, machine-learning industrial assistance system to support manual assembly processes.

Cooperation partners

Funding

Background

The project focuses on developing of a flexible, intelligent assistance system to support manual assembly processes. Even in the digital factories of the future, manual assembly processes by people remains essential due to the high high flexibility and the precision it offers. It is crucial to provide intelligent support for workers in these often monotonous but concentration-demanding tasks.

The system can also be used for training purposes. A key social challenge is integrating low-skilled workers and non-native speakers into industrial production. With this system, the need for training and supervision can gradually decrease as the worker's competence improves.

Objective

The research project aims to create people-friendly working conditions in manual assembly processes. On the technical side, this means that the assistance system must reliably provide the appropriate support. The goal is to determine the optimal way to present this assistance using a user-centred design process.


Under the leadership of Prof. Dr. Konrad Doll, our research group will develop the assistance system. The researchers will analyse the manual assembly with the help of machine learning methods to automatically generate support aids and present them to the worker at the workstation, if needed. This allows the system to operate largely autonomously, minimizing the effort required for integration into production.

Methods

The assistance system consists of a 3D camera and a projector, both mounted overhead at the workplace, as well as an eye tracker and an industrial PC. Since studies have shown that it is uncomfortable for users to wear augmented reality glasses for a long period of time, a projector is used. In the future, other technologies will probably be used here instead, e.g. augmented reality via contact lenses.

Contact