辅助震颤患者人机交互的增强现实系统研究

Various functional disorders caused by tremor diseases have long plagued trembling people, seriously affecting their daily life, such as human-computer interaction, walking, etc., especially with computers, touch screen devices, household appliances, etc. Because the mechanism of tremor is still not clear, the cause is difficult to determine, the current medical level cannot effectively treat tremor, facing many problems such as clinical cure rate, low side effects, easy to cause limb fatigue and so on. Aiming at the problem of human-computer interaction in patients with tremor, on the basis of previous research on key-press interaction optimization, this research presents the techniques and methods of touch and sensory interaction optimization for tremor, to solve the problems in the different interaction tasks. Key research techniques include the virtual static algorithm for identifying intentional activities from complex limb tremor models, dynamic mapping of virtual images and entities and the reflection compensation, and the methods for transferring touch of distant objects to fingers. An interactive prototype system integrating multiple interaction modes will be established, to recognize tremor gestures/postures in real time, to map virtual stabilized gestures after tremor image stabilization, to analyze the interaction intention of target hot spots, and to make anticipated responses for patients with assisted tremor. The system also will be applied and verified. Through this research, trembling people will be further improved in using keyboards, touch screens, somatosensory interaction, are enhanced the interaction ability, and are obtained with optimized interactive experience.

由震颤疾病产生的各种功能障碍却长期困扰着震颤患者，严重地影响日常生活，诸如人机交互、行走等活动，特别是与计算机、触屏设备、家用电器等设备的交互。本课题针对震颤患者的人机交互问题，在先前研究基础上解决震颤患者触控和体感交互和不同类型交互任务的问题，研究辅助震颤患者的人机交互增强现实技术。关键的研究技术包括从复杂的肢体震颤模型中识别意向活动的虚拟静态化算法，虚拟图像与实体的动态映射及反射补偿，向手指传递远处对象触感的手段和方法等。建立一个集成多种交互模式、实时识别震颤手势/姿势并映射消震稳像后的虚拟手势/姿势、预测交互行为意向的目标热点/热区并做出期待响应的辅助震颤患者交互的系统并应用验证。通过本课题研究，震颤患者在人机交互—按键、触屏、体感交互三个方面的问题将进一步得到完善，增强震颤患者的交互能力，为其提供优化的交互体验。

由震颤疾病产生的各种功能障碍却长期困扰着震颤患者，严重地影响日常生活，诸如人机交互、行走等活动，特别是与计算机、触屏设备、家用电器等设备的交互。本课题针对震颤患者的人机交互问题，在先前研究基础上解决震颤患者触控和体感交互和不同类型交互任务的问题，研究辅助震颤患者的人机交互增强现实技术。关键的研究技术包括从复杂的肢体震颤模型中识别意向活动的虚拟静态化算法，虚拟图像与实体的动态映射及反射补偿，向手指传递远处对象触感的手段和方法等。建立一个集成多种交互模式、实时识别震颤手势/姿势并映射消震稳像后的虚拟手势/姿势、预测交互行为意向的目标热点/热区并做出期待响应的辅助震颤患者交互的系统并应用验证。通过本课题研究，震颤患者在人机交互—按键、触屏、体感交互三个方面的问题将进一步得到完善，增强震颤患者的交互能力，为其提供优化的交互体验。