大数据背景下基金委共享航次科学调查数据的管理与统计分析

With the implementation of the Sharing Voyage Project funded by National Natural Science Foundation of China (NSFC), the amount of data produced growing up at an exponential rate. The Qingdao Oceanographic Data Sharing Service System of NSFC has accomplished the management and sharing of the metadata of the survey data set by using relational database, but the scientific value of the precious survey data is far from being fully explored as the result of an insufficient use of the entity data.The big data technology, being extensively applied in various fields and affecting natural science research ideas, provides techniques and methods for the management of sharing voyage scientific survey data.Aiming at the aquired multi-source heterogeneous sharing voyage data, the project takes big data thinking mode and technology to explore and select the suitable methods for data management, processing and mining algorithm. It tries to design systematic architecture for sharing voyage data management and analysis to cover the work of data management, processing, analysis, data mining, results display, with the hope that the potential value of sharing voyage survey data can be fully exploited and amplified, and the data collecting and sharing functions can be further improved.

随着基金委共享航次项目持续推行，产生的数据量以指数级速度不断增长。运行中的基金委青岛海洋资料共享服务平台利用关系型数据库实现了调查数据集的元数据的管理与共享，但对调查实体数据没有被真正利用起来，导致珍贵的调查数据科学价值未充分发挥。广泛应用多领域的大数据技术将影响自然科学研究思路，为共享航次科学调查大数据管理提供技术和方法。本项目针对已获取的多源异构的共享航次科学调查数据，采用大数据思维模式和技术支撑，探索选取适合共享航次科学调查数据的管理处理方法及挖掘算法，设计共享航次科学调查数据管理与分析体系架构，完成管理、处理、分析、挖掘、成果展示等工作。充分发挥和增值共享航次调查数据的潜在价值，促进共享航次调查数据汇交与共享工作进展。

随着基金委共享航次项目持续推行，运行中的基金委青岛海洋资料共享服务平台从数据管理制度和信息系统建设都不能满足当前的工作需求。本项目应用大数据技术为共享航次科学调查大数据管理提供技术、方法和理念。本项目针对已获取的多源异构的共享航次科学调查数据，探索选取适合共享航次科学调查数据的管理处理方法，从制度建设到系统改版，完成管理、分发、统计、成果展示等工作。在保护数据知识产权的同时充分发挥和增值共享航次调查数据价值，促进规范化共享航次调查数据汇交与共享工作进展。