Open Access
ARTICLE
Immersive Technologies for Remote Human-Robot Interaction: A Systematic Literature Review
Issue Vol. 1 No. 01 (2024): Volume 01 Issue 01 --- Section Articles --- Published Date: 2024-12-04
Abstract
The integration of robotic systems into diverse applications necessitates robust and intuitive remote human-robot interaction (RHRI) capabilities. Traditional teleoperation methods often fall short in providing comprehensive situational awareness, immersive feedback, and intuitive control, leading to increased cognitive load and reduced performance. Extended Reality (XR), encompassing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), presents a promising paradigm shift for RHRI by offering enhanced immersion, rich sensory feedback, and natural interaction modalities. This systematic literature review comprehensively analyzes the current landscape of XR-enabled RHRI systems. We categorize existing approaches by XR technology (VR, AR, MR), examine various interaction modalities (visual, haptic, auditory, gesture, eye-tracking), and explore key application domains such as industrial manufacturing, hazardous environments, medical, and space exploration. The review highlights the significant benefits of XR in improving situational awareness, control intuition, and collaborative capabilities. Furthermore, it identifies persistent challenges, including latency, field of view limitations, usability, and hardware constraints. Finally, we discuss critical future research directions, emphasizing adaptive interfaces, standardization, enhanced multimodal feedback, and long-term human factors studies, to foster more efficient, safer, and natural human-robot interactions in remote settings.
Keywords
References
Mahmoud Abdulsalam and Nabil Aouf. 2023. VitRob pipeline: A seamless teleoperation pipeline for advanced virtual reality-robot interface applied for precision agriculture. In Proceedings of the 2023 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 1–6.
Dmytro Adamenko, Steffen Kunnen, Robin Pluhnau, André Loibl, and Arun Nagarajah. 2020. Review and comparison of the methods of designing the digital twin. Procedia CIRP 91 (2020), 27–32.
Zhuming Ai, Mark A. Livingston, and Ira S. Moskowitz. 2016. Real-time unmanned aerial vehicle 3D environment exploration in a mixed reality environment. In Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE, 664–670.
Ian F. Akyildiz and Hongzhi Guo. 2022. Wireless communication research challenges for extended reality (XR). ITU Journal on Future and Evolving Technologies 3, 1 (2022), 1–15.
Rachel Albert, Anjul Patney, David Luebke, and Joohwan Kim. 2017. Latency requirements for foveated rendering in virtual reality. ACM Transactions on Applied Perception (TAP) 14, 4 (2017), 1–13.
Open Access Journal
Submit a Paper
Propose a Special lssue
pdf