高级检索

基于大模型的时态数据分析算法综述

A Survey of Temporal Data Analysis Algorithms Based on Large Models

  • 摘要: 时态数据分析通过捕捉时态数据的变化趋势,揭示数据中潜在的规律和模式,从而帮助做出精准的预测和决策。近年来,受大模型强泛化能力的启发,许多工作将原本用于自然语言的大模型拓展至时态数据分析领域,赋予了时态数据分析模型零样本、多模态推理的能力。但现有工作对基于大模型的时态数据分析算法的系统性分类与讨论较少。因此,本文首先将基于大语言模型的时态数据分析模型和时态基座模型的相关工作分别按照在大模型工作流程中的针对性优化方向进行分类,阐述了将大模型应用至时态分析算法的各类方法,并进行优缺点评估与适用场景分析,为将大模型嵌入时态分析算法提供了参考;其次,总结出基于大模型的时态数据分析模型在零样本推理任务下的性能较强;再次,与时态基座模型相比,由于基于大语言模型的时态分析模型能利用预训练知识,因此表现出较好的泛化能力,且计算成本较低,但分析性能不如时态基座模型;最后,本文强调了未来的工作挑战和可能发展方向。

     

    Abstract: Temporal data analysis helps to make accurate predictions and decisions by capturing the changing trends of temporal data and revealing the underlying rules and patterns. In recent years, inspired by the strong generalization ability of large models, many works have extended the large models originally designed for natural language processing to the field of temporal data analysis, which empowers the temporal data analysis models with zero-shot and multimodal inferences. However, there are fewer systematic classifications and discussions on temporal data analysis algorithms based on large models in the existing works. The authors classify the related works of temporal data analysis models based on large language models and temporal foundation models respectively according to the directions of targeted optimization in the large model pipeline, describe the various types of methods for applying the large models to the temporal data analysis algorithms, evaluate the strengths and weaknesses and analyze the applicability scenarios of each type of method, to provide methodological references for applying the large model to the temporal data analysis model. Then it is concluded that the temporal data analysis models based on large models perform strongly under the zero-shot inference task. Because the temporal data analysis models based on large language models can utilize the pre-training knowledge, they exhibit better generalization ability with lower computational cost compared to the temporal foundation model. However, the analysis performance is not as good as that of the temporal foundation model. Finally, the remaining challenges and potential future research directions are highlighted.

     

/

返回文章
返回