力-触觉感知和情绪心理参与的虚拟手术增强训练关键技术研究

The sense perception and psychological participation of surgeons are important ingredients to increase the effectiveness of virtual surgery training. Existing interaction training between surgeons and operated organs is mainly based on surgeon’s visual participation without involving the surgeon’s force-haptic perception and emotional psychological participation. From the perspective of fine operations during surgery training, research on key technologies of virtual surgery training enhanced by force-haptic perception and emotional psychological participation will be conducted. The proposal mainly covers the following elements: (i)Study representation methods on deformation and force feedback of soft body to set up a force perception model based on spherical harmonic functions and radial basis function neural network. (ii)Study textural feature extraction methods from medical images and the mapping relation between the textural feature and three-dimensional force field to construct a vivid haptic perception model based on image texture. (iii)Study emotion classification methods based on physiological response to design a surgery training task classification method based on emotion classification to motivate emotional psychological participation in surgery training. (iv)Taking heart surgery training as an example, we’ll construct an experimental platform to verify the effectiveness of virtual surgery training method proposed. By executing this project, we will improve the technical level of human-computer collaborative training, and provide theoretical and technical support for harmonious interaction between the surgeon and surgery training system.

外科医生的感官感知和心理参与是增强虚拟手术训练效果的重要手段。现有的外科医生与手术器官之间的交互训练主要以受训医生的“视觉”参与为主，未能考虑“力-触觉”的深度感知和“情绪心理”的主动参与。本项目拟从提高外科医生手术训练精细操作水平角度出发，开展基于力-触觉感知和情绪心理参与的虚拟手术增强训练关键技术研究，具体包括：（i）研究柔性体三维变形和力觉反馈的再现方法，构建基于球面调和函数拟合和径向基函数神经网络预测的力觉感知模型；（ii）研究图像纹理特征及其与三维力场的映射关系，建立逼真的纹理触觉感知模型；（iii）研究基于生理响应的情绪分类方法，设计诱发情绪心理参与手术训练的情绪分类和任务分级方法；（iv）以心脏手术训练为例，搭建实验平台，验证虚拟手术训练效果。本项目研究成果将进一步完善和提高人机协作手术训练水平，为实现受训医生与手术训练系统之间和谐交互协作提供理论依据和技术支撑。

外科医生的感官感知和心理参与是增强虚拟手术训练效果的重要手段。现有的外科医生与手术器官之间的交互训练主要以受训医生的“视觉”参与为主，未能考虑“力-触觉”的深度感知和“情绪心理”的主动参与。本项目拟从提高外科医生手术训练精细操作水平角度出发，开展基于力-触觉感知和情绪心理参与的虚拟手术增强训练关键技术研究，具体包括：（1）研究软组织力-触觉模型；(2)研究力-触觉交互纹理再现方法；(3)研究不同情绪诱发下情绪调节系统；(4)搭建虚拟手术系统；(5)研究泊松曲面重建算法；(6)研究黑色素瘤自动检测方法。本项目研究成果将进一步完善和提高人机协作手术训练水平，为实现受训医生与手术训练系统之间和谐交互协作提供理论依据和技术支撑。