铁路外部环境无人机图像未知风险检测方法

  • 孟凡腾 ,
  • 秦勇 ,
  • 崔京 ,
  • 吴云鹏 ,
  • 张紫城 ,
  • 魏少伟
展开
  • 1. 北京交通大学
    2. 昆明理工大学
    3. 中国铁道科学研究院集团有限公司

收稿日期: 2024-09-24

  修回日期: 2024-11-25

  网络出版日期: 2025-01-16

基金资助

中央高校基本科研业务费专项资金资助;国家重点研发计划

Unknown Risk Detection Method for UAV Images in External Environment of Railroad

  • MENG Fan-Teng ,
  • QIN Yong ,
  • CUI Jing ,
  • WU Yun-Peng ,
  • ZHANG Zi-Cheng ,
  • WEI Shao-Wei
Expand

Received date: 2024-09-24

  Revised date: 2024-11-25

  Online published: 2025-01-16

Supported by

the Fundamental Research Funds for the Central Universities;National Key R&D Program of China

摘要

铁路外部环境的常见隐患以及未知风险(包括泥石流、落石、动物入侵等)严重威胁到铁路安全运行,需要巡检人员耗时费力地频繁检查,但巡检范围仍非常有限。目前,低空经济已成为国家新质生产力代表,无人机具备高空、远距离、受地形和铁路维修天窗影响小,具有先天巡检优势。针对铁路外部环境未知风险样本稀疏且具有随机不确定性的挑战,本文利用无人机进行沿线遥感图像采集,并基于Faster R-CNN提出了一种未知风险检测框架。首先,设计了一种新颖的目标性与多分类解耦训练策略,并融合在未知风险检测框架中,显著提升了通用目标检测性能,避免将未知风险目标错分为背景;其次,改进了VOS的虚拟特征合成方法,提出了基于相似度的特征空间采样,在构建实例级目标特征空间基础上进行多元高斯分布参数估计与重采样,获得泛化性的未知风险目标特征表示;随后,利用基于能量的不确定性度量,对实例级特征进行不确定性度量,并据此计算损失以诱导网络优化常见类别和未知风险类别的决策边界。最终,在采集的铁路外部环境数据集、开源无人机数据集以及泛化性测试数据上进行了定量与定性实验分析,本文提出的方法在常见隐患识别上取得了95.7% mAP50,同时在测试集和泛化性测试数据上分别取得了98%和80.8% Recall50,实验结果表明本文方法在保证常见隐患类别高识别率的基础上对于未知风险目标也有较高的检测能力。

本文引用格式

孟凡腾 , 秦勇 , 崔京 , 吴云鹏 , 张紫城 , 魏少伟 . 铁路外部环境无人机图像未知风险检测方法[J]. 航空学报, 0 : 1 -0 . DOI: 10.7527/S1000-6893.2024-31262

Abstract

Common hazards as well as unknown risks (including mudslides, rockfalls, animal intrusion, etc.) in the external environment of railroad seriously threaten the safe operation of railroads, requiring frequent time-consuming and laborious inspections by inspectors, but the scope of inspections is still very limited. At present, the low-altitude economy has become the country's new quality productivity representatives, and the UAV has innate inspection advantages of high altitude, long distance, and small influence by the terrain and railroad maintenance skylight. Aiming at the challenge of sparse unknown risk samples with random uncertainty in the external environment of the railroad, this paper utilizes UAVs for remote sensing image acquisition along the line and proposes an unknown risk detection framework based on Faster R-CNN. First, a novel objectness and multi-classification decoupling training strategy is designed and integrated in the unknown risk detection framework, which significantly improves the generalized object detection performance and avoids misclassifying unknown risk objects as background. Second, the virtual feature synthesis method of VOS has been improved, and similarity-based feature space sampling has been designed to obtain a generalized unknown risk object feature representation by performing multivariate Gaussian distribution parameter estimation and resampling based on the construction of instance-level object feature space. Subsequently, an energy-based uncertainty measurement is utilized to measure the uncertainty of the instance-level features, and losses are calculated accordingly to induce the network to optimize the decision boundaries for common and unknown risk categories. Finally, quantitative and qualitative experimental analysis are conducted on the collected external environment of railroad dataset, open-source drone dataset, and generalization test data. The proposed method achieved 95.7% mAP50 in common hazard identification, while achieving 98% and 80.8% Recall50 in the test set and generalization test data, respectively. The experimental results show that the proposed method has high detection ability for unknown risk objects while ensuring high recognition rate of common hazard categories.
文章导航

/