虚拟现实飞行模拟训练中的视觉交互技术研究

doi:10.7527/S1000-6893.2013.0290

电子与控制

本期目录 | 过刊浏览 | 高级检索

前一篇 | 后一篇

虚拟现实飞行模拟训练中的视觉交互技术研究

周来¹, 郑丹力¹, 顾宏斌^2,3

1. 上海航天技术研究院上海机电工程研究所, 上海 201109;
2. 南京航空航天大学民航学院, 江苏南京 210016;
3. 南京航空航天大学自动化学院, 江苏南京 210016

收稿日期:2013-01-11 修回日期:2013-05-22 出版日期:2013-10-25 发布日期:2013-06-17
通讯作者: 顾宏斌,Tel.: 025-84893501 E-mail: ghb@nuaa.edu.cn E-mail:ghb@nuaa.edu.cn
作者简介:周来男, 博士, 工程师。主要研究方向: 虚拟现实系统应用、视景仿真应用。 Tel: 021-24185289 E-mail: zhoulai@nuaa.edu.cn;郑丹力女, 硕士, 研究员。主要研究方向: 软件及可视化技术等。 Tel: 021-24185280 E-mail: dlzheng1968@yahoo.com.cn;顾宏斌男, 博士, 教授, 博士生导师。主要研究方向: 飞行模拟仿真、飞机系统设计、虚拟现实系统应用等。 Tel: 025-84893501 E-mail: ghb@nuaa.edu.cn;王得宝男, 本科生。主要研究方向: 计算机视觉、数字图像处理。 Tel: 025-84890755 E-mail: 674364511@qq.com
基金资助:
国家自然科学基金(51305255,61039002);上海市自然科学基金(13ZR1455900)

Research of Visual Interaction for Virtual Reality Flight Training

ZHOU Lai¹, ZHENG Danli¹, GU Hongbin^2,3

1. Shanghai Electro-Mechanical Engineering Institute, Shanghai Academy of Spaceflight Technology, Shanghai 201109, China;
2. College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China;
3. College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China

Received:2013-01-11 Revised:2013-05-22 Online:2013-10-25 Published:2013-06-17
Supported by:
National Natural Science Foundation of China (51305255,61039002);Natural Science Foundation of Shanghai City (13ZR1455900)

摘要/Abstract

摘要：

为实现半虚拟现实座舱环境中的人机自然交互,使用基于表观的视觉手姿态估计方法。针对基于表观方法在大容量高维度手势特征检索过程中所存在的时间效率低、内存消耗大等问题,提出了引入多探测原理和近邻特征表的改进局部敏感哈希(LSH)索引,并提出了索引性能预测模型和基于性能预测模型的索引参数优化方法,提高了索引方法的检索性能。实验结果表明,预测模型能反映实际的索引性能,使用参数优化后的改进LSH索引进行10近邻特征检索,可保证索引召回率基本不变,而使在线实际总耗时减少41.9%。将改进LSH索引应用于视觉手姿态估计,可实现虚拟手可视化,再现用户真实手的各种动作和状态。

关键词: 虚拟现实, 人机交互, 索引, 姿态估计, 敏感哈希, 飞行模拟器

Abstract:

Appearance-based hand pose estimation which relies on computer vision techniques is adopted to realize natural interaction in a semi-virtual reality cockpit. To cope with the low efficiency and high memory consumption in large capacity and high-dimension feature indexing, an improved locality sensitive Hashing (LSH) method is proposed in this paper which combines the multi-probe principle with the nearest-neighbor table. Moreover, a forecast model which predicts indexing performance and a parameter optimization method are used to achieve better indexing performance. Experimental results show that the forecast model is appropriate for practical indexing performances and the time consumption is reduced by 41.9% at the cost of a slight recall rate drop. In summary, the application of the improved LSH to hand pose estimations able to upgrade virtual hand visualization and hand posture reconstruction in a semi-virtual reality cockpit.

Key words: virtual reality, human-computer interaction, indexing, pose estimation, sensitive Hashing, flight simulator

中图分类号:

V216.8

周来, 郑丹力, 顾宏斌, 王得宝. 虚拟现实飞行模拟训练中的视觉交互技术研究[J]. 航空学报, 2013, 34(10): 2391-2401.

ZHOU Lai, ZHENG Danli, GU Hongbin, WANG Debao. Research of Visual Interaction for Virtual Reality Flight Training[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2013, 34(10): 2391-2401.

参考文献

[1] Gu H B, Wu D S, Liu H. Development of a novel low-cost flight simulator for pilot training. World Academy of Science, Engineering and Technology, 2009, 60: 685-689.

[2] Han Y. A low-cost visual motion data glove as an input device to interpret human hand gestures. IEEE Transactions on Consumer Electronics, 2010, 56(2): 501-509.

[3] Wang B, Dai S L. Experience based grasping gesture synthesis and data glove calibration. Journal of Beijing University of Aeronautics and Astronautics, 2010, 36(9):1084-1088. (in Chinese) 王滨, 戴树岭. 基于经验的抓取姿态构造及数据手套校正. 北京航空航天大学学报, 2010, 36(9): 1084-1088.

[4] Zhou L, Gu H B, Sun J, et al. Hand pose estimation based on maximum a posteriori framework in semi-virtual reality cockpit. Acta Aeronautica et Astronautica Sinica, 2011, 32(7): 1252-1259. (in Chinese) 周来, 顾宏斌, 孙瑾, 等. 半虚拟现实座舱中基于最大后验概率框架的手姿态估计. 航空学报, 2011, 32(7): 1252-1259.

[5] Causo A, Matsuo M, Ueda E, et al. Hand pose estimation using voxel-based individualized hand model. IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 2009: 451-456.

[6] De La Gorce M, Fleet D J, Paragios N. Model-based 3D hand pose estimation from monocular video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(9): 1793-1805.

[7] Athitsos V, Sclaroff S. An appearance-based framework for 3D hand shape classification and camera viewpoint estimation. IEEE International Conference on Automatic Face and Gesture Recognition, 2002: 40-45.

[8] Nolker C, Ritter H. Visual recognition of continuous hand postures. IEEE Transactions on Neural Networks, 2002, 13(4): 983-994.

[9] Shih B Y, Lo T W, Chen C Y. The research of quad-tree search algorithms for anti-collision in radio frequency identification systems. Scientific Research and Essays, 2011, 6(25): 5342-5350.

[10] Zhang X B, Cheng L L, Zhu Q M. Improvement of filtering algorithm for RFID middleware using KDB-tree query index. Journal of Software, 2011, 6(12): 2521-2527.

[11] Kao B, Lee S D, Lee F KF, et al. Clustering uncertain data using voronoi diagrams and R-tree index. IEEE Transactions on Knowledge and Data Engineering, 2010, 22(9): 1219-1233.

[12] Venkateswaran J, Subramanya S R. Schemes for SR-tree packing. Proceedings of the ACM Symposium on Applied Computing, 2006: 73-77.

[13] Berchtold S, Bohm C, Kriegal H P. The pyramid-technique: towards breaking the curse of dimensionality. ACM Special Interest Group on Management of Data Record, 1998, 27(2): 142-153.

[14] Lavergne P, Patilea V. Breaking the curse of dimensionality in nonparametric testing. Journal of Econometrics, 2008, 143(1): 103-122.

[15] Cui J T, Tang J X, Jiang L. Efficient multi-resolution histogram matching for bag-of-features. IEEE International Conference on Image and Graphics. Washington D.C.: IEEE Computer Society, 2011: 406-411.

[16] Paliwal A, Jayaraman U, Gupta P. A score based indexing scheme for palmprint databases. 2010 17th IEEE International Conference on Image Processing, 2010: 2377-2380.

[17] Indyk P, Motwani R. Approximate nearest neighbors: towards removing the curse of dimensionality. Proceedings of the 13th Annual ACM Symposium on Theory of Computing, 1998: 604-613.

[18] Gionis A, Indyk P, Motwani R. Similarity search in high dimensions via hashing. International Conference on Very Large Data Bases, 1999: 518-529.

[19] Datar M, Immorlica N, Indyk P, et al. Locality-sensitive hashing scheme based on p-stable distributions. Proceeding of the 20th Annual Symposium on Computational Geometry, 2004: 253-262.

[20] Lv Q, Josephson W, Wang Z, et al. Multi-probe LSH: efficient indexing for high-dimensional similarity search. Proceedings of the 33rd International Conference on Very Large Data Bases. 2007: 950-961.

[21] Dong W, Wang Z, Josephson W, et al. Modeling LSH for performance tuning. Proceedings of the 17th ACM Conference on Information and Knowledge Management, 2008: 669-678.

[22] Zhou L, Gu H B, Tang Y. Hand pose estimation in head-mounted display virtual environments. Journal of Computer-Aided Design & Computer Graphics, 2011, 23(7): 1179-1185. (in Chinese) 周来, 顾宏斌, 汤勇. 头盔式虚拟环境中的人手姿态参数估计方法. 计算机辅助设计与图形学学报, 2011, 23(7): 1179-1185.

[23] Andoni A, Indyk P. Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. IEEE Symposium on Foundations of Computer Science, 2006: 459-468.

E-mail：hkxb@buaa.edu.cn

关于我们

期刊社服务

专业学科

封面文章

友情链接

主管单位：中国科学技术协会主办单位：中国航空学会北京航空航天大学

虚拟现实飞行模拟训练中的视觉交互技术研究

Research of Visual Interaction for Virtual Reality Flight Training

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	沈笑云, 张硕, 张思远. 终端区航空器三维实时监视系统仿真[J]. 航空学报, 2023, 44(S1): 727598-727598.
[2]	苏翎菲, 化永朝, 董希旺, 任章. 人与无人机集群多模态智能交互方法[J]. 航空学报, 2022, 43(S1): 727001-727001.
[3]	陈呈, 赵丹, 王岳青, 邓亮, 杨超, 苏铖宇, 王昉. NNW-TopViz流场可视分析系统[J]. 航空学报, 2021, 42(9): 625747-625747.
[4]	王崴, 赵敏睿, 高虹霓, 朱帅, 瞿珏. 基于脑电和眼动信号的人机交互意图识别[J]. 航空学报, 2021, 42(2): 324290-324290.
[5]	张杰, 季宝宁, 杨宁, 唐文斌. 一种装配体模型的离散量化与相似性分析方法[J]. 航空学报, 2021, 42(10): 524992-524992.
[6]	李海君, 赵国荣, 黄婧丽, 周大旺. 一种基于NGA-QPF的航天器姿态估计方法[J]. 航空学报, 2014, 35(6): 1694-1702.
[7]	魏喜庆, 宋申民. 基于改进容积卡尔曼滤波的奇异避免姿态估计[J]. 航空学报, 2013, 34(3): 610-619.
[8]	周来, 顾宏斌, 孙瑾, 汤勇. 半虚拟现实座舱中基于最大后验概率框架的手姿态估计[J]. 航空学报, 2011, 32(7): 1252-1259.
[9]	刘彦文, 王广雄, 李佳. 飞行模拟器操纵负荷系统的无源性设计[J]. 航空学报, 2011, 32(12): 2303-2309.
[10]	韩柯;金仲和;王昊. 皮卫星姿态估计及粗太阳敏感器标定算法研究[J]. 航空学报, 2010, 31(5): 1038-1044.
[11]	潘文俊;王立新. 持续载荷飞行模拟器过载模拟新原理[J]. 航空学报, 2010, 31(11): 2159-2165.
[12]	苗育红;周江滑. 基于可观测度分析的稳定姿态滤波器[J]. 航空学报, 2010, 31(1): 165-171.
[13]	禹鑫燚;高海波;邓宗全. 崎岖地形中关节式月球车姿态估计数值求解方法[J]. 航空学报, 2009, 30(8): 1521-1530.
[14]	杨新颖;龚光红;王行仁. 飞行模拟器中的虚拟声音建模与实时渲染技术[J]. 航空学报, 2009, 30(7): 1305-1311.
[15]	韦艺;康锐. 装备虚拟保障系统的概念及其技术框架[J]. 航空学报, 2009, 30(4): 654-659.