Speech recognition in operator environments

Purpose and goal:

In this project, technology for speech recognition and speech feedback has been studied and initially integrated into a prototype for a future operator environment for mining machines. It has been clarified which specific areas of use/functions are best suited for speech recognition and speech feedback. A concept study integrating a speech recognition/speech feedback system with a mining machine remotely controlled from a control room has since been performed. The value has been evaluated by having operators test the system.

Expected results and effects:

The result of the concept study shows that in future operator environments there is room for several different interaction modes between machine and human. Speech has proven to be a very interesting communication medium for those cases for instance when the operator´s hands are busy with other activities. It has also been shown that certain communication commands are particularly well suited for speech communication, which will be further investigated in future development activities.

Approach and implementation: The project has been carried out in the following three phases:

1. Knowledge gathering regarding value and area of use: Interviews with industrial design competence and analysis of speech recognition/speech feedback from industries/applications outside the mining industry

2. Demonstration prototype: Development and implementation of physical demonstrator that demonstrates areas of use and technical maturity of speech recognition/speech feedback for remote control of mining machines. 3.Demonstration of prototype and analysis of outcomes.