Skip to content

AI and GenAI

Vocal Interaction with Autonomous Mobile Robots Using Smart Glasses and NLU

How a highly specialized manufacturing company enabled natural, voice based interaction with Autonomous Mobile Robots using Smart Glasses and NLU.

Industry
Manufacturing

Natural Voice Interaction with AMRs in Complex Industrial Environments

Programming and instructing Autonomous Mobile Robots in industrial plants is often complex, especially in heterogeneous and noisy environments. This solution was designed to reduce human machine friction and make AMR interaction simple, natural, and consistent.

The client

A highly-specialized manufacturing company and industry leader, operating multiple Autonomous Mobile Robots from different vendors within the same production facility.

The challenge

Managing AMRs posed several challenges:

  • Robots from different brands required different programming languages
  • High friction when issuing instructions, even to a single robot
  • Noisy industrial environments limited the effectiveness of traditional voice commands
  • Limited ability to manage and simulate robot fleets

The solution

BitBang developed a solution based on Smart Glasses and Natural Language Understanding.

Operators can:

  • Select a robot simply by looking at it through Smart Glasses
  • Issue voice commands even in noisy environments
  • Use natural language, automatically translated into the robot’s specific programming language

The solution integrates speech to text, NLU, and data analytics components, and supports fleet management and simulation scenarios.

The results

  • Smoother and more natural human robot interaction
  • Removal of dependency on proprietary robot programming languages
  • Improved effectiveness of voice commands in noisy environments
  • Ability to manage and simulate robots as homogeneous fleets
  • New opportunities for data analysis and operational optimization

Let's talk

Facing a similar challenge? Tell us about it: that's where we start.

More Case Studies