AI Assisted AR Assembly: Object Recognition and Computer Vision for Augmented Reality Assisted Assembly

We present an AI-assisted Augmented Reality assembly workflow that uses deep learning-based object recognition to identify different assembly components and display step-by-step instructions. For each assembly step, the system displays a bounding box around the corresponding components in the physical space and indicates where the component should be placed. By linking assembly instructions to the real-time locations of relevant components, the system eliminates the need for manual searching, sorting, or labeling of components before each assembly. To demonstrate the feasibility of using object recognition for AR-assisted assembly, we present a case study on assembling LEGO sculptures.