Library

Intuitive Human-Robot Interaction: Development and Evaluation of a Gesture-Based User Interface for Object Selection

Gestures are a natural form of communication between humans and can also be leveraged for human-robot interaction. This work presents a gesture-based user interface for object selection using pointing and click gestures. An experiment with 20 participants evaluates accuracy and selection time, demonstrating the potential for efficient collaboration.

cs.ROcs.HCComputer ScienceEngineering
View graphSource

Paper

References (11)

01YOLOv11: An Overview of the Key Architectural EnhancementsRahima Khanam, Muhammad Hussain2024 · arXiv.org · 3.2k citations In Library
02SAM 2: Segment Anything in Images and VideosNikhila Ravi, Valentin Gabeur, Yuan-Ting Hu et al.2024 · International Conference on Learning Representations · 3.8k citations In Library
03Co-Speech Gestures for Human-Robot CollaborationA. Ekrekli, Alexandre Angleraud, Gaurang Sharma et al.2023 · International Conference on Robotic Computing · 11 citations In Library
04Faster Segment Anything: Towards Lightweight SAM for Mobile ApplicationsChaoning Zhang, Dongshen Han, Yu Qiao et al.2023 · arXiv.org · 661 citations In Library
05Hand and Arm Gesture-based Human-Robot Interaction: A ReviewXihao Wang, Hao Shen, Hui Yu et al.2022 · International Conference on Advancements in Computational Sciences · 15 citations In Library
06Gesture Recognition and Effective Interaction Based Dining Table Cleaning RobotJ. Moh, T. Kijima, Bin Zhang et al.2019 · International Conference on Robot Intelligence Technology and Applications · 4 citations
07Personalized Robot Assistant for Support in DressingA. Jevtić, Andrés Flores Valle, G. Alenyà et al.2019 · IEEE Transactions on Cognitive and Developmental Systems · 65 citations
08MediaPipe: A Framework for Building Perception PipelinesCamillo Lugaresi, Jiuqiang Tang, H. Nash et al.2019 · arXiv.org · 2.3k citations
09Visual pointing gestures for bi-directional human robot interaction in a pick-and-place taskC. P. Quintero, R. T. Fomena, Mona Gridseth et al.2015 · IEEE International Symposium on Robot and Human Interactive Communication · 33 citations
10SEPO: Selecting by pointing as an intuitive human-robot command interfaceC. P. Quintero, R. T. Fomena, A. Shademan et al.2013 · IEEE International Conference on Robotics and Automation · 45 citations
11Gesten mit der Apple Vision Pro verwenden2025 · support

Similar papers

A human-centered approach to robot gesture based communication within collaborative working processesTobias Ende, S. Haddadin, Sven Parusel et al.2011 · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · 91 citations In Library
Pointing Gestures for Human-Robot Interaction with the Humanoid Robot DigitViktor Lorentz, Manuel Weiß, Kristian Hildebrand et al.2023 · IEEE International Symposium on Robot and Human Interactive Communication · 13 citations In Library
Hands-On Robotics: Enabling Communication Through Direct Gesture ControlMax Pascher, Alia Saad, J. Liebers et al.2024 · IEEE/ACM International Conference on Human-Robot Interaction · 6 citations In Library
Gestural and Touchscreen Interaction for Human-Robot Collaboration: a Comparative StudyAntonino Bongiovanni, Alessio De Luca, Luna Gava et al.2022 · arXiv (Cornell University) In Library
Non-verbal Interaction and Interface with a Quadruped Robot using Body and Hand Gestures: Design and User Experience EvaluationS. Shin, Trevor Evetts, Hunter Saylor et al.2024 · ECCV Workshops · 6 citations In Library
Augmented Pointing Gesture Estimation for Human-Robot InteractionZhixian Hu, Yingtian Xu, Waner Lin et al.2022 · IEEE International Conference on Robotics and Automation · 8 citations In Library
Designing Gesture-Based Interfaces for Cobots: Insights from a Mixed Reality Elicitation StudyPatricia Pons, José L. Soler-Domínguez, Samuel Navas Medrano2025 · ACM Transactions on Human-Robot Interaction In Library
Hand Gesture-Guided Manipulator for Enhancing Human-Robot CollaborationNorapath Arjanurak, Tanyaton Oranrigsupak, Yada Suksawasdi et al.2025 In Library
Communicative Gesturing in Interaction with RobotsKristiina Jokinen2024 · Cambridge University Press eBooks In Library
Robots and Wizards: An Investigation Into Natural Human–Robot InteractionDominykas Strazdas, Jan Hintz, Anna-Maria Felbberg et al.2020 · IEEE Access In Library
© 2026 NYSGPT2525 LLC