LEGO structures are generally constructed by following an instruction manual in paper or digital form, which shows the LEGO model at different stages of assembly. Some instructions can be very complicated and difficult to illustrate on paper. Augmented reality (AR) is a technology that superimposes 3D models onto the physical world. This chapter explores the use of AR for assembly through a mobile application for Android devices that serves as an assembly guide for LEGO structures. The system can recognize the current step of the LEGO assembly using data captured via Microsoft Kinect while providing visual feedback through a mobile application. To identify the current step, the system obtains the color and depth data from the Kinect camera and converts the data into a point cloud, which is compared to stored LEGO model data. The system was evaluated based on the accuracy of the recognition, latency of the feedback and the assembly time of the user.
Paper
Full text
Using Augmented-Reality to Aid in Lego Construction
Semantic Scholar · Engineering · 2019
Abstract
LEGO structures are generally constructed by following an instruction manual in paper or digital form, which shows the LEGO model at different stages of assembly. Some instructions can be very complicated and difficult to illustrate on paper. Augmented reality (AR) is a technology that superimposes 3D models onto the physical world. This chapter explores the use of AR for assembly through a mobile application for Android devices that serves as an assembly guide for LEGO structures. The system can recognize the current step of the LEGO assembly using data captured via Microsoft Kinect while providing visual feedback through a mobile application. To identify the current step, the system obtains the color and depth data from the Kinect camera and converts the data into a point cloud, which is compared to stored LEGO model data. The system was evaluated based on the accuracy of the recognition, latency of the feedback and the assembly time of the user.