Mitsubishi said the technology can help reduce workload and avoid entry errors because information can be entered by voice, even in noisy environments. The system is expected to be used for a variety of maintenance work, such as inspections of water-treatment plants and building electrical systems.

According to the Mitsubishi, the new system overcomes two key problems, first, conventional AR systems that use two-dimensional imaging require high volumes of pictures for large-scale inspections. Second, precise AR imaging requires difficult calculations of position and angle when there is a large difference between a technician’s camera view and the super-imposed database images.

Mitsubishi Electric’s new technology uses a three-dimensional model that is easily built by scanning objects with a RGBD camera equipped tablet PC. Continuous operation builds the three-dimensional model and shows check procedure related to the objects.

In addition, precise AR imaging is possible by calculating the position and angle using a three-dimensional model instead of two-dimensional images. Moreover, the displayed contents of the check procedure are changed according to the distance between the technician and the super-imposed item.