航空学报 > 2012, Vol. 33 Issue (11): 2065-2073

航拍视频的多向条带拼接算法

廖超1, 王贵锦1, 沈永玲2, 何贝1, 林行刚1   

  1. 1. 清华大学 电子工程系, 北京 100084;
    2. 中国电子科技集团第54研究所, 河北 石家庄 050081
  • 收稿日期:2011-11-16 修回日期:2011-12-27 出版日期:2012-11-25 发布日期:2012-11-22
  • 通讯作者: 王贵锦 E-mail:wangguijin@tsinghua.edu.cn
  • 基金资助:

    国家自然科学基金(61132007)

Aerial Video Stitching via Multi-direction Strips

LIAO Chao1, WANG Guijin1, SHEN Yongling2, HE Bei1, LIN Xinggang1   

  1. 1. Department of Electronic Engineering, Tsinghua University, Beijing 100084, China;
    2. 54th Institute of China Electronics Technology Group Corporation, Shijiazhuang 050081, China
  • Received:2011-11-16 Revised:2011-12-27 Online:2012-11-25 Published:2012-11-22
  • Supported by:

    National Natural Science Foundation of China (61132007)

摘要: 无人机航拍视频中经常出现航向频繁改变的情况。基于条带的视频拼接算法尽管在处理速度上有很大优势,但是限制了相机的拍摄方式,主要处理平动相机拍摄的视频。用于采集全景图信息的纵向条带如用来扫描非平动场景会使效率降低甚至失效,所以不能直接拼接航拍视频。针对该问题,本文提出一种多向条带拼接算法,通过量化场景运动方向到预先定义的多个区间,分情况选取最佳方向的条带,控制了条带扫描方向与场景运动方向之间的最大夹角,从而避免了采集效率的降低。实验结果表明这种方法能有效拼接航向变化的仿真视频,全景图结果覆盖的场景范围大于原算法,证明了算法的有效性。

关键词: 航拍视频, 视频拼接, 流形投影, 条带拼接, 航空摄影, 图像配准, 图像融合

Abstract: The regular manifold projection method for video stitching is very efficient but it requires an invariant dominant motion. However, aerial videos captured on unmanned aerial vehicles cannot be stitched by it due to the flexibility in their flight routes. This paper proposes an improved method to handle the varying direction problems via multi-direction strips. First, various slope strips for different scan directions are defined. When the major motion direction in the aerial video changes, the most appropriate strip are chosen to minimize the bias angle between the scan direction and the motion direction. Experiments show our method can generate better panorama result as compared with other methods.

Key words: aerial video, video stitching, manifold projection, strip stitching, aerial photography, image registration, image fusion

中图分类号: