机载嵌入式系统基准测试方法
收稿日期: 2015-05-28
修回日期: 2015-07-20
网络出版日期: 2015-07-30
基金资助
国家科技重大专项(2012ZX01041-006);航空科学基金(2012ZC31006,2013ZC31005);工信部民机专项基金(MJ-S-2012-05)
Avionics embedded system benchmark test method
Received date: 2015-05-28
Revised date: 2015-07-20
Online published: 2015-07-30
Supported by
National Science and Technology Major Project Foundation of China (2012ZX01041-006);Aeronautic Science Foundation of China (2012ZC31006,2013ZC31005);MIIT Specific Research Projects Foundation for Civil Aircraft (MJ-S-2012-05)
性能评测是查找嵌入式计算机系统性能瓶颈、指导设备选型、平衡相关部件、优化系统结构以及提高系统实际性能的重要方法。在介绍了机载嵌入式计算机系统性能评测的指标和基本方法之后,重点分析了使用基准测试程序的测试方法和特点,以及基准测试方法的对比测试原理、不同测试环境的构建以及主要测试过程;选取了SPEC CPU 2000基准测试程序集针对机载嵌入式环境进行裁剪和移植,对某国产机载嵌入式实时操作系统分别以不同的嵌入式操作系统、嵌入式文件系统和编译选项为变量参数进行对比测试,得出了国产操作系统与国外同类商用操作系统运行实际应用程序的性能基本相当的结论,另外也得出文件系统对计算类基准程序的结果影响较小以及编译优化后能够大幅提高嵌入式系统性能等结论。
郝玉锴 , 崔西宁 , 李雷雷 , 杨琼 . 机载嵌入式系统基准测试方法[J]. 航空学报, 2016 , 37(4) : 1327 -1335 . DOI: 10.7527/S1000-6893.2015.0204
Performance evaluation is an important method to find the performance bottleneck of embedded computer systems, guide equipment selection, balance related components, optimize the system structure and improve the system's actual performance. After the introduction of indicators and benchmarks of embedded computer systems performance evaluation, we analyze the characteristics of benchmark test methods and test procedures, build different test environments, as well as the comparative testing principle of benchmark method, and the main testing process. Then, select the SPEC CPU 2000 benchmarks set, cut and transplant them under the airborne embedded environment for comparison test on a domestic airborne embedded real-time operating system using different embedded operating systems, embedded file systems and compiler options as variable parameters. Conclusions show that the performance of a domestic real-time operating system for airborne embedded computer is roughly equal to similar foreign commercial operating system, file system has less effect on the benchmark results and compiler optimization can significantly improve the performance of embedded systems.
[1] 罗志强. 航空电子综合化系统[M]. 北京:北京航空航天大学出版社, 1990:26-31. LUO Z Q. Integrated avionics systems[M]. Beijing:Beijing University of Aeronautics and Astronautics Press, 1990:26-31(in Chinese).
[2] Aeronautical Radio, Inc. ARINC specification 653:Avionics application software standard interface part 1 required services[S]. Annapolis:Aeronautical Radio, Inc., 2006.
[3] Aeronautical Radio, Inc. ARINC speecification 653:Avionics application software standard interface part 2 extended services[S]. Annapolis:Aeronautical Radio, Inc., 2007.
[4] 高晓光, 薛亚勇, 温增葵. IMA双层调度算法中的任务可调度性分析方法[J]. 航空学报, 2015, 36(2):585-595. GAO X G, XUE Y Y, WEN Z K. Task schedulability analyzing method of two-level hierarchical scheduling algorithm in integrated modular avionics[J]. Acta Aeronautica et Astronautica Sinica, 2015, 36(2):585-595(in Chinese).
[5] 张海涛, 龚龙庆. 用于嵌入式计算机性能评测技术及其方法研究[J]. 现代电子技术, 2008, 31(14):49-54. ZHANG H T, GONG L Q. Research of embedded computer performance evaluation technology[J]. Modern Electronics Technique, 2008, 31(14):49-54(in Chinese).
[6] 李向东, 张晓红, 戴小氐, 等. 机载嵌入式系统中多种机内自测试的软件设计[J]. 计算机测量与控制, 2014, 22(4):1310-1313. LI X D, ZHANG X H, DAI X D, et al. Design of build-in test in embedded systems onboard[J]. Computer Measurement & Control, 2014, 22(4):1310-1313(in Chinese).
[7] SIEH V, TSCHACHE O, BALBACH F. VERIFY:Evaluation of reliability using VHDL models with embedded fault descriptions[C]//Proceedings of the 27th International Symposium on Fault-Tolerant Computing. Piscataway, NJ:IEEE Press, 1997:32-36.
[8] YIN Y F, LIU B, NI H Y. Real-time embedded software testing method based on extended finite state machine[J]. Journal of Systems Engineering and Electronics, 2012, 23(2):276-285.
[9] ARLAT J. Conceptual framework, deliverable CF1, state of the art:IST 2000-25425[R]. 2001.
[10] HENNESSY J L, PATTERSON D A. Computer architecture:A quantitative approach[M]. 5th ed. San Francisco:Morgan Kaufmann, 2011:125-135.
[11] WEISS A R, CLUCAS R. The standardization of embedded benchmarking:The pitfalls and the opportunities[C]//Proceedings of Embedded Systems Conference. Piscataway, NJ:IEEE Press, 1999:492-508.
[12] HALANG W A, GUMZEJ R, COLNARIC M, et al. Measuring the performance of real-time systems[J]. The International Journal of Time-Critical Computing System, 2000, 18(1):59-68.
[13] WANG A J A. Using Java Hartstone benchmark in a realtime systems course[C]//Proceedings of 201232nd Annual Frontiers in Education. Piscataway, NJ:IEEE Press, 2002:S2F-25-S2F-30.
[14] KRISHNASWAMY U, SCHERSON I D. A framework for computer performance evaluation using benchmark sets[J]. IEEE Transactions on Computers, 2000, 49(12):1325-1338.
[15] 徐钦桂, 李勇, 张杰明, 等. 基于比较策略的嵌入式系统性能基准测试研究[J]. 计算机工程与应用, 2005, 41(19):93-96. XU Q G, LI Y, ZHANG J M, et al. Research of performance benchmark for embedded systems based on comparison strategy[J]. Computer Engineering and Applications, 2005, 41(19):93-96(in Chinese).
[16] Standard Performance Evaluation Corporation. SPEC CPU 2000 V1.3[EB/OL]. (2007-6-7)[2015-1-15]. http://www.spec.org/cpu2000/index.html.
[17] KLEINOSOWSKI A, LILJA D J. MinneSPEC:A new SPEC benchmark workload for simulation-based computer architecture research[R]. Minnesota:University of Minnesota ARCTiC Labs, 2002.
[18] 葛仁北. SPEC CPU 2000基准程序运行路径分析[J]. 计算机工程, 2007, 33(7):38-40. GE R B. Path analysis of SPEC CPU 2000 benchmark[J]. Computer Engineering, 2007, 33(7):38-40(in Chinese).
[19] HENNING J L. SPEC CPU 2000:Measuring CPU performance in the new millennium[J]. Computing Practices, 2000, 33(7):25-26.
[20] Wind River Systems Inc. Tornado user's guide (Windows Version 1.0)[M]. Alameda, CA:Wind River Systems Inc., 1996:34-40.
[21] Wind River Systems Inc. VxWorks programmer's guide 5.5[M]. Alameda, CA:Wind River Systems Inc., 1996:62-65.
/
| 〈 |
|
〉 |
CJA