Recently, research has been conducted on mixed reality (MR), which provides immersive visualization and interaction experiences, and on mapping human motions directly onto a robot in a mixed reality (MR) space to achieve a high level of immersion. However, although the robot itself is mapped onto the MR space, the robot’s environment itself is not mapped, making it difficult to comfortably perform tasks that require detailed manipulation or manipulate objects that are difficult to see from the human perspective. Therefore, we propose a system in which the environment around the robot itself is also mapped on the MR space, and operations can be performed on the MR space, enabling immersive real-space operations.
Paper
Full text
Human-Robot Interaction System based on MR object manipulation
Semantic Scholar · Engineering · 2023
Abstract
Recently, research has been conducted on mixed reality (MR), which provides immersive visualization and interaction experiences, and on mapping human motions directly onto a robot in a mixed reality (MR) space to achieve a high level of immersion. However, although the robot itself is mapped onto the MR space, the robot’s environment itself is not mapped, making it difficult to comfortably perform tasks that require detailed manipulation or manipulate objects that are difficult to see from the human perspective. Therefore, we propose a system in which the environment around the robot itself is also mapped on the MR space, and operations can be performed on the MR space, enabling immersive real-space operations.