流体场景声音仿真的关键技术研究

Auditory information, the second sensing channel next only to the visual information, is indispensable for immersive virtual reality. However, the traditional simulation techniques mostly tend to focus on visual effect, ignoring the sound rendering, and thereby reduce the real feeling of the user experience. As a kind of important natural phenomena, fluid scenes are important elements in the virtual environment, which contain rich sound effects. With the rapid development of computer technology, realistic sound rendering has become possible. This project aims to study the key techniques and basic algorithms of sound simulation for different fluid scenes. Specifically, the main research contents of this project include sound representation and modeling for fluid scenes, fluid sound propagation and user perception modeling, real-time sound rendering for fluid scenes, and the synchronous rendering for visual information and soundinformation for fluid scenes. Eventually, we will integrate the above techniques to complete a realistic sound simulation prototype system for fluid scenes. The research of this project will lay a solid theoretical and algorithmic foundation for building a highly realistic and immersive virtual reality system, which can be widely used in military simulation, education, games, training systems, etc. so as to improve the human-computer interaction.

听觉信息是仅次于视觉信息的第二传感通道，对于沉浸式的真实感体验是不可或缺的。然而，传统的仿真技术往往以视觉效果优先，大多忽略声音绘制，大大降低了用户的真实感体验。作为一类重要的自然景观，流体场景是虚拟环境的重要组成元素，包含丰富的声音效果。随着计算机技术的飞速发展，真实感声音绘制已经成为可能。本项目拟对流体场景的声音仿真的关键技术和基础算法展开系统研究。具体地，本项目的主要研究内容包括流体场景的声音表示与建模；流体场景的声音传播及用户感知模拟；流体场景的声音实时绘制；流体场景的声音信号与视觉信号的同步绘制，最终完成一个集成上述技术的流体场景真实感声音仿真原型系统。本项目的研究能为构建高度真实感和沉浸感的虚拟现实系统提供坚实的理论和算法基础，可广泛应用于军事演练、教育、游戏、培训等系统，改善人机交互效果。

本项目对流体场景声音仿真理论与关键技术进行了深入研究，包括流体场景的声音表示与建模、流体场景的声音传播及用户感知模拟、流体场景的声音实时绘制及流体场景的声音信号与视觉信号的同步绘制等。设计并实现了一系列流体场景声音合成、传播、同步融合等算法，包括火焰声、爆炸声、水声、海浪声、雨声、流固耦合声等的合成算法、室外声音传播模拟算法、多模态信号（视觉、听觉及触觉）的同步融合算法等。同时，实现了触觉力引导的声音环境软件系统。本项目的研究为构建高度真实感和沉浸感的虚拟现实系统提供坚实的理论和算法基础，在军事演练、教育、游戏、培训等领域具有较强的应用前景。