基于 MacBERT 和对抗训练的城市内涝信息识别方法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家重点研发计划项目(物理—数字空间交融的城市管理和服务技术:2019YFB2102503);中国测绘科学研究院基本科研业务费项目(地理空间大数据治理关键技术研究:AR2111)


Urban Waterlogging Information Recognition Method Based on MacBERT and Adversarial Training
Author:
Affiliation:

Fund Project:

National Key Research and Development Program of China (Urban Management and Service Technology for Physical and Digital Spatial Integration: 2019YFB2102503), Basic Research Funds of the Chinese Academy of Surveying and Mapping (Key Technology Research of Geospatial Big Data Governance: AR2111)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    BERT 与神经网络模型相结合等方法,已逐渐应用于获取灾害信息,但此类方法存在参数量繁多、数据集和微调数据集不一致、局部不稳定等问题。针对上述问题,该文提出一种基于 MacBERT 和对抗训练的信息识别模型,该模型利用 MacBERT 预训练模型获得初始向量表示,再加入些许扰动生成对抗样本,然后依次输入双向长短期记忆网络和条件随机场。该模型不仅减少了预训练次数和微调阶段差异,还提高了模型的鲁棒性。实验结果表明,在微博数据集和 1998 年人民日报数据集上,基于 MacBERT 和对抗训练的信息识别模型的精确率和 F1 值均有所提升,性能较其他模型更优,将该模型用于城市内涝信息识别具有一定的可行性。

    Abstract:

    Methods such as BERT and the combination of neural network model have been gradually applied to the acquisition of disaster information. However, such methods have many problems, such as large number of parameters, inconsistent data sets and fine-tuning data sets, and local instability. In this paper, an information recognition model based on MacBERT and adversarial training is proposed. The model obtains the initial vector representation through MacBERT pre-training model, and then adds some perturbations to generate adversarial samples. Then input to the bi-directional long short-term memory and conditional random field in turn, which not only reduces the pre-training times and fine-tuning stage differences, but also improves the robustness of the model. The experimental results show that the information recognition model based on MacBERT and adversarial training are improved the accuracy rate and F1 value on the microblog dataset and the 1998 People’s Daily dataset, and the execution is excellent than other models, which indicates that the model has certain feasibility for urban waterlogging information recognition.

    参考文献
    相似文献
    引证文献
引用本文

引文格式
方美丽,郑莹莹,陶坤旺,等.基于 MacBERT 和对抗训练的城市内涝信息识别方法 [J].集成技术,2023,12(1):56-67

Citing format
FANG Meili, ZHENG Yingying, TAO Kunwang, et al. Urban Waterlogging Information Recognition Method Based on MacBERT and Adversarial Training[J]. Journal of Integration Technology,2023,12(1):56-67

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-01-12
  • 出版日期:
文章二维码