首页 >

基于稀疏点匹配的协同式未知目标跟踪方法-多域协同与智能目标状态感知关键技术”专刊

郎荣玲1,魏才伦2,范亚2,高飞3   

  1. 1. 北京航空航天大学,电子信息工程学院
    2. 北京航空航天大学
    3. 北航空航天大学
  • 收稿日期:2025-06-17 修回日期:2025-09-19 出版日期:2025-09-24 发布日期:2025-09-24
  • 通讯作者: 范亚
  • 基金资助:
    陕西省组合与智能导航重点实验室开放基金资助项目

Sparse Point Matching-Based Collaborative Category-Agnostic Object Tracking Methode

  • Received:2025-06-17 Revised:2025-09-19 Online:2025-09-24 Published:2025-09-24

摘要: 对未知目标的实时感知与持续跟踪是智能系统自主决策的重要前提,在实际应用中存在缺乏目标类别先验信息和训练样本匮乏的问题,使得未知目标的感知与跟踪更具挑战性。针对此问题,提出了一种基于任意分割模型(Segment Anything Model,SAM)与稀疏特征点匹配的未知目标跟踪方法。该方法首先通过提示点引导SAM模型感知并分割图像中的未知目标,随后利用基于卷积神经网络的特征点提取模型,获取目标图像的稀疏特征点作为目标信息,并通过基于注意力机制的匹配网络在后续帧中匹配这些特征点,完成目标信息传播。在此基础上,设计了一个基于特征点一致性的迭代式SAM模块(ISPC),利用匹配的特征点持续引导SAM模型对后续图像帧的目标进行分割,从而实现未知目标的稳定跟踪。此外基于稀疏特征点的轻量化目标信息,可以在多智能体之间高效共享,构建了一个协同式目标跟踪系统。在DAVIS 2017数据集和自构建的近红外视频数据集上,评估了系统的目标跟踪性能与零训练样本目标的泛化能力。实验结果表明,该方法在处理未知类别目标的协同感知与跟踪任务中,表现出良好的鲁棒性和准确性。

关键词: 目标跟踪, 目标分割, 特征提取, 特征匹配, 协同感知

Abstract: Real-time perception and continuous tracking of unknown objects are critical for autonomous intelligent systems. However, the absence of prior category knowledge and limited training samples make this task highly challenging. We propose a cate-gory-agnostic object tracking method based on the Segment Anything Model (SAM) and sparse feature point matching. The approach first guides SAM to segment unknown objects using prompt points, then extracts sparse keypoints via a CNN-based model, and matches them across frames using an attention-based network to propagate object information. An Iterative SAM with Point Consensus (ISPC) is introduced to maintain segmentation and achieve stable tracking over time. The light-weight feature representation enables efficient sharing among multiple agents, supporting collaborative tracking. Experiments on the DAVIS 2017 dateset and a self-constructed near-infrared video dataset demonstrate strong robustness and accuracy in tracking unknown-category objects.

Key words: object tracking, object segmentation,, feature extraction, feature matching, collaborative perception

中图分类号: