基于领域自适应预训练的黑暗场景下行为识别研究
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP183

基金项目:

国家重点研发计划项目(2022ZD0160505);国家自然科学基金项目(62272450)


Domain-Adaptive Pretraining for Action Recognition in the Dark Scenes
Author:
Affiliation:

Fund Project:

This work is supported by National Key Research and Development Program of China (2022ZD0160505), National Natural Science Foundation of China (62272450)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    黑暗场景与传统预训练模型所使用的数据之间的域差距导致传统的预训练-微调策略难以达到理想效果,而从头开始的预训练则代价高昂。针对此问题,该研究提出一种领域自适应预训练方法,旨在改善黑暗场景下的行为识别性能。该方法通过融合外部视觉去暗增强模型,引入关键的去暗知识,并利用跨领域自蒸馏框架优化预训练模型,可有效减小明暗场景间视觉表征的域差异。在一系列黑暗场景行为识别实验中,该方法在全监督的黑暗场景行为识别数据集中的准确率达 97.19%;在无源领域自适应场景数据集中的准确率提升至 49.11%;而在多源领域自适应场景数据集中的准确率达54.63%。

    Abstract:

    The domain gap between dark scenes and the data used by traditional pretrained models leads to suboptimal performance with the conventional pretrain-finetune approach, and pretraining from scratch is costly. To address this issue, a domain-adaptive pretraining method is proposed to improve action recognition performance in the dark environments. The method integrates an external vision enhancement model for de darkening to introduce critical knowledge for dark scene processing. It also employs a cross-domain self distillation framework to reduce the domain gap of visual representations between illuminated and dark scenes. Through extensive experiments in various dark environment action recognition settings, the proposed approach can achieve a Top1 accuracy of 97.19% on the dark dataset of fully supervised action recognition. In the source-free domain adaptation on the Daily-DA dataset, the accuracy can be improved to 49.11%. In the multi source domain adaptation scenario on the Daily-DA dataset, the Top1 accuracy can reach 54.63%.

    参考文献
    相似文献
    引证文献
引用本文

引文格式
许清林,乔 宇,王亚立.基于领域自适应预训练的黑暗场景下行为识别研究 [J].集成技术,2025,14(1):25-38

Citing format
XU Qinglin, QIAO Yu, WANG Yali. Domain-Adaptive Pretraining for Action Recognition in the Dark Scenes[J]. Journal of Integration Technology,2025,14(1):25-38

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-12-25
  • 最后修改日期:2023-12-25
  • 录用日期:
  • 在线发布日期: 2024-03-27
  • 出版日期:
文章二维码