Demonstrating Cloth Folding to Robots: Design and Evaluation of a 2D and a 3D User Interface

An appropriate user interface to collect human demonstration data for\ndeformable object manipulation has been mostly overlooked in the literature. We\npresent an interaction design for demonstrating cloth folding to robots. Users\nchoose pick and place points on the cloth and can preview a visualization of a\nsimulated cloth before real-robot execution. Two interfaces are proposed: A 2D\ndisplay-and-mouse interface where points are placed by clicking on an image of\nthe cloth, and a 3D Augmented Reality interface where the chosen points are\nplaced by hand gestures. We conduct a user study with 18 participants, in which\neach user completed two sequential folds to achieve a cloth goal shape. Results\nshow that while both interfaces were acceptable, the 3D interface was found to\nbe more suitable for understanding the task, and the 2D interface suitable for\nrepetition. Results also found that fold previews improve three key metrics:\ntask efficiency, the ability to predict the final shape of the cloth and\noverall user satisfaction.\n

Paper

Similar papers

© 2026 NYSGPT2525 LLC