高级检索

大数据分析平台建设与应用综述

Review on Construction and Application of Big Data Analytical Platform

  • 摘要: 大数据分析平台是开展大数据处理与分析应用所必需的基础设施。文章基于课题组开展大数据分析平台建设的科研成果与实践经验, 结合大型企业实施行业应用项目的切身感受, 从大数据分析平台设计、主流热点技术、行业应用案例三个方面进行介绍。文章首先分析了大数据分析平台的主要功能和体系架构, 然后介绍了大数据分析平台的关键技术, 重点介绍了 Spark 技术的体系架构及核心组件, 最后介绍了大数据技术在大规模制造业、零售业和智能电网三个领域的应用案例。

     

    Abstract: The big data analytics platform is an indispensable infrastructure for big data processing and applications. Based on our research activities, practical experiences with big data analytics, and lessons learnt from industrial projects, this paper addressed the platform design, mainstream technologies, and industrial cases of big data analytics platforms. Firstly, the main functions and architecture of such platforms were analyzed. Then the key enabling technologies were introduced with a focus on the architecture of Spark and its core components. Finally three application case studies were presented in the areas of massive manufacture, retail, and smart grids.

     

/

返回文章
返回