VLBI分布式数据传输与协同相关处理技术研究

Next generation astrometry and geodesy observation system VGOS and high precision astrophysical observations exponentially increases the data rate of VLBI raw observation. To resolve the limitation of single VLBI correlating center lack of enough resources and capability to do real-time big data processing, researches on cooperative distributing big data transmission and correlating technology is highly needed, so as to implementing multi-center real-time parallel processing. In the future, the multi-mission and multi-target VLBI tracking and measuring system for deep space exploration in China needs to adopting dynamic subnet array observation mode to realize the simultaneous tracking, measurement and orbit determination of multiple deep space aircraft. It is also urgent to realize the distributed transmission and processing among multiple systems in the VLBI subnet array. This research project will develop universal integrated data system for recording and transmission which is capable of high speed of 32Gbps and above. Then will carry out researches on networking distributed big data transmission and processing methods, focuses on developing distributed cooperative control software by using software middle-ware technology and messaging queue protocol, to fulfill real-time intelligent high -speed transmission and continuous processing among multi stations and multi correlator centers, so can finally realize automatically parallelly and efficiently remote cooperative distributed big data transmission and processing prototype system. At last, will develop big data management technology and system based on virtual astronomical observatory framework. With this key technology and system developed, it will greatly improve the capability of real-time unattended continuous observation and data processing, capable of serving the next generation of astrophysical, geodesic, and multi-mission multi-target deep space exploration VLBI measurement systems.

下一代测地系统VGOS和高精度天体物理观测使VLBI原始观测数据率呈指数增长，为解决单个VLBI相关处理中心受资源和能力瓶颈等限制无法满足实时大数据处理要求的问题，亟需研究分布式数据传输与协同相关处理技术实现多中心实时并行处理。我国深空探测多任务多目标VLBI测量系统采用动态子网组阵观测实现多飞行器同时跟踪测量与测轨定位，也亟需实现子网组阵时多系统间的分布式传输与处理。课题首先开发32Gbps速率通用型一体化数据终端，然后研究网络协同分布式大数据传输与处理方法，基于软件中间件和消息传递协议开发分布式协同运控系统原型，进行部署测试与验证，实现自动并行高效多测站多处理机中心之间实时可靠高速传输与处理，最后基于虚拟天文台框架研发大数据管理和共享系统。通过上述研发，更好地服务于下一代天物、测地以及多任务多目标深空探测VLBI测定轨系统。

为满足下一代测地系统VGOS运行、高精度天体物理观测、我国月球与深空探测多任务VLBI测量需求，适应多站多中心多任务运行特点，开展分布式数据传输与协同相关处理技术，开发实现32Gbps速率通用型一体化数据记录传输终端；开发实现基于网络协同分布式传输与处理运控原型验证系统，并开展了测试；研制了VLBI大数据管理系统并用于VLBI数据的共享使用。通过研究解决VLBI分布式数据传输与协同相关处理关键技术，可应用于VLBI数据处理中心服务国际天体测量和大地测量服务组织（IVS）开展VGOS系统的高效观测传输与数据处理，缩短试验周期；可应用于我国探月工程四期和行星探测工程，有望应用于载人探月和近地小行星防御VLBI测量系统等重大航天专项。