论文标题

I-GSI:基于增强现实和眼睛追踪的快速可靠的掌握式切换接口

i-GSI: A Fast and Reliable Grasp-type Switching Interface based on Augmented Reality and Eye-tracking

论文作者

Shi, Chunyuan, Yang, Dapeng, Qiu, Siyang, Zhao, Jingdong

论文摘要

由于缺乏直观,有效的抓握型切换界面(GSI),对多指的灵义义义手的控制仍然具有挑战性。我们提出了一种新的GSI(I-GSI),它集成了眼睛追踪和增强现实技术的多种力量,以解决此问题。它完全在HoloLens2头盔中运行,用户可以在其中浏览全息界面上的图标,以迅速在六种每日抓握类型之间切换。与传统的GSI(基于FSM,基于PR和基于移动应用程序的基于FSM)相比,I-GSI在八个健康受试者的实验中取得了最佳效果,其切换时间为0.84 s,开关成功率为99.0%,学习效率为93.50%。通过验证一名先天性上肢缺乏症的患者,I-GSI取得了同等的良好结果,与健康人员相同,切换时间为0.78 s,成功率为100%。新的I-GSI作为独立模块,可以与传统的比例肌电控制结合在一起,形成一个混合控制的假体系统,可以帮助患者在各种日常生活中完成灵活的操作。

The control of multi-fingered dexterous prosthetics hand remains challenging due to the lack of an intuitive and efficient Grasp-type Switching Interface (GSI). We propose a new GSI (i-GSI) t hat integrates the manifold power of eye-tracking and augmentced reality technologies to solve this problem. It runs entirely in a HoloLens2 helmet, where users can glance at icons on the holographic interface to switch between six daily grasp types quickly. Compared to traditional GSIs (FSM-based, PR-based, and mobile APP-based), i-GSI achieved the best results in the experiment with eight healthy subjects, achieving a switching time of 0.84 s, a switching success rate of 99.0%, and learning efficiency of 93.50%. By verifying on one patient with a congenital upper limb deficiency, i-GSI achieved an equivalent great outcome as on healthy people, with a switching time of 0.78 s and switching success rate of 100%. The new i-GSI, as a standalone module, can be combined with traditional proportional myoelectric control to form a hybrid-controlled prosthetic system that can help patients accomplish dexterous operations in various daily-life activities.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源