多模态数据融合理论及应用研究

Multi-modal data fusion (MDF) study integrating data from multiple modals to predict unknown samples is one of the basic goals of artificial intelligence. Existing MDF studies have a number of limitations to be further addressed, such as focusing on the extraction of common information of multi-modal data by ignoring their complementary information, seldom studying the multi-modal data with the special structures common for practical applications, and studying either static data or dynamic data alone. With the aim of solving the problems that arise in the MDF study of the needs of modern requirements, this project intends to firstly propose efficient methods for solving all kinds of issues of MDF based on the basic theory and practical applications of data fusion methods, and then to apply the resulting methods to the applications of the computer aided diagnosis of health big data which is an important basic strategic resource in our country. The goals of this project are to build a computer aided diagnosis and demo platform based on the application requirements of neuroimaging data, so that our study is of great significance to the development of multi-modal data fusion theory and to the study of reliefing the existing social problems of the aging population & low birth rate and the serious shortage of medical staffs via using our healthcare big data to serve the health care systems in our country.

多模态数据融合研究整合多个数据源的数据对未知目标进行预测，是人工智能基本目标之一。现有多模态融合研究集中在提取多模态数据的公共信息而忽略互补信息，很少研究实际应用常见特殊限制的多模态数据和只单一的研究静态和动态信息等。针对多模态数据融合这一具有时代需求的课题研究过程中出现的问题，本项目拟从基础理论和实际应用出发，对各种多模态数据融合问题提出高效的解决方法，并应用到健康大数据这一国家重要的基础性战略资源的计算机辅助诊断应用领域。项目以建立基于神经影像等数据的计算机辅助诊断模拟平台为应用导向，对于多模态数据融合理论发展和利用健康大数据服务我国医疗体系以探索缓解现有老年少子化和医务人员严重短缺的社会问题有一定意义。

多模态数据融合研究整合多个数据源的数据对未知目标进行预测，是人工智能基本目标之一。现有多模态融合研究集中在提取多模态数据的公共信息而忽略互补信息，很少研究实际应用常见特殊限制的多模态数据和只单一的研究静态和动态信息等。针对多模态数据融合这一具有时代需求的课题研究过程中出现的问题，本项目拟从基础理论和实际应用出发，对各种多模态数据融合问题提出高效的解决方法，并应用到健康大数据这一国家重要的基础性战略资源的计算机辅助诊断应用领域。项目以建立基于神经影像等数据的计算机辅助诊断模拟平台为应用导向，对于多模态数据融合理论发展和利用健康大数据服务我国医疗体系以探索缓解现有老年少子化和医务人员严重短缺的社会问题有一定意义。