高级检索

基于Transformer的复杂工业过程质量预测方法综述

Transformer-Based Quality Prediction Methods for Complex Industrial Processes: A Review

  • 摘要: 与传统的统计分析与浅层机器学习相比,基于深度学习的质量预测能更有效地应对非线性、高维度等问题,现已成为软测量领域的主流方法之一。Transformer是一种基于自注意力机制的深度学习模型架构,在序列建模中具有独特优势,为工业质量预测提供了新的研究路径。本文系统综述了Transformer在工业过程质量预测领域的发展与应用。首先阐述了经典深度学习在动态工业过程中的局限,通过分析Transformer模型的自注意力机制对动态全局特征的建模能力,指出其在工业过程软测量问题中的基本应用原理;其次,梳理了现有文献对经典Transformer方法的主要改进方向,包括Crossformer、iTransformer、Informer、PatchTST和Autoformer等,总结了其在实际复杂工业过程中的应用案例;最后,探讨了工业质量预测的当前挑战,并对未来研究方向进行展望。

     

    Abstract: Quality prediction modeling based on deep learning has become one of the mainstream methods in the field of soft sensor, it can more effectively address complex problems such as nonlinearity and high-dimensionality compared to traditional statistical analysis and shallow machine learning. Transformer, a deep learning model based on the self-attention mechanism, offers a new research avenue for industrial quality prediction due to its unique advantages in sequence modeling. This paper systematically reviews the technological evolution and applications of Transformer in the industrial process quality prediction. Initially, the limitations of classic deep learning models in dynamic industrial processes are discussed. By analyzing the ability of the Transformer model's self-attention mechanism to model dynamic global features of industrial processes, its fundamental application principles in industrial process soft sensor problems are highlighted. Subsequently, the main improvement directions of the classic Transformer method in existing literature, including Crossformer, iTransformer, Informer, PatchTST, and Autoformer, are summarized, along with their application cases in complex real-world industrial processes. Finally, current challenges in industrial quality prediction are discussed, and future research directions are prospected.

     

/

返回文章
返回