Collaborative robots using mixed reality (MR) and artificial intelligence (AI)

Purpose and goal: Purpose

This study aims to implement novel sustainable solutions based on collaborative robots using mixed reality and artificial intelligence in the robotic platforms available within the participants. Goal + An assembly tasks demonstration was implemented for a collaborative robot + An artificial intelligence algorithm for body gesture recognition was integrated to command a collaborative robot.

+ A mixed reality algorithms was preliminary integrated for displaying information of the current state of the collaborative robot Expected results and effects:

The implementation of an assembly task demonstration, the integration of the artificial intelligence algorithm and the mixed reality algorithm have been integrated to the respective collaborative robots available. The results were presented at the MIRAI 2.0 R&I Week in Japan.

The developed concept/demonstration has been presented to the local industry as an example of the future industrial systems gave an understanding of the effect on the industry and the need to address the current issues in assembly tasks for facilitating the development in the production systems. Approach and implementation:

The technical development and integration of the algorithms for body language recognition, mixed reality and the implementation of a demonstration of assembly tasks progressed according to plan. A simple demonstration for assembly tasks was implemented in a collaborative robot. Basic functions of an artificial intelligence algorithm to control a collaborative robot were tested.

Basic functions of a mixed reality algorithm to display information about the state of a collaborative robot were preliminary tested.