一种变信噪比条件下的恒虚警野值检测方法

doi:10.7527/S1000-6893.2015.0348

Abstract

Abstract:

Outlier detection, also called anomaly detection, is a commonly encountered problem in areas such as pattern recognition, machine intelligence and knowledge discovery. When environmental mismatch occurs and the signal-to-noise ratio (SNR) of data changes, the noise variances in testing and training instances will be different, resulting in the ineffectiveness of previous outlier detection methods which aim to control the false-alarm probability. To solve the problem, an outlier detection method based on normalized residual (NR) is proposed in this paper. This method first calculates the outlier detection threshold according to the desired false-alarm probability and the change of noise variance; second measures the NR value of the query pattern using training instances; and then compares this NR value with the predefined detection threshold to determine whether the query pattern is an outlier or not. The detection threshold defined in this paper is adaptive to the desired false-alarm probability and the varying noise variance, thus can realize constant false-alarm rate (CFAR) outlier detection under varying SNR conditions. Simulation experiments validate the superior performance of the proposed method on false-alarm probability controlling and outlier detection.

Key words: pattern recognition, outlier detection, constant false-alarm rate (CFAR), false-alarm probability, normalized residual

CLC Number:

O235
TP391.4

RU Xiaohu, LIU Zheng, JIANG Wenli, HUANG Zhitao. A CFAR outlier detection method under varying SNR conditions[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2016, 37(7): 2259-2268.

References

[1] HAWKINS D. Identification of outliers[M]. London:Chapman and Hall, 1980:1-25.
[2] DANESHPAZHOUH A, SAMI A. Entropy-based outlier detection using semi-supervised approach with few positive examples[J]. Pattern Recognition Letters, 2014, 49:77-84.
[3] ALBANESE A, PAL S K, PETROSINO A. Rough sets, kernel set, and spatiotemporal outlier detection[J]. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(1):194-207.
[4] WESTERWEEL J, SCARANO F. Universal outlier detection for PIV data[J]. Experiments in Fluids, 2005, 39(6):1096-1100.
[5] DUNCAN J, DABIRI D, HOVE J, et al. Universal outlier detection for particle image velocimetry (PIV) and particle tracking velocimetry (PTV) data[J]. Measurement Science and Technology, 2010, 21(5):57002-57006.
[6] LIU J, WAN J, ZHENG H, et al. A method of specific emitter verification based on CSDA and SVDD[C]//Proceedings of the IEEE 2nd International Conference on Computer Science and Network Technology. Piscataway, NJ:IEEE Press, 2012:562-565.
[7] RU X H, LIU Z, JIANG W L. Normalized residual-based outlier detection[C]//Proceedings of the IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC). Piscataway, NJ:IEEE Press, 2014:190-193.
[8] NATTORN B, ARTHORN L, KRUNG S. Outlier detection score based on ordered distance difference[C]//Proceedings of the IEEE International Computer Science and Engineering Conference (ICSEC). Piscataway, NJ:IEEE Press, 2013:157-162.
[9] ZHAO M, SALIGRAMA V. Anomaly detection with score functions based on nearest neighbor graphs[J]. Advances in Neural Information Processing Systems, 2009, 22(1):2250-2258.
[10] QIAN J, SALIGRAMA V. New statistic in p-value estimation for anomaly detection[C]//Proceedings of the IEEE Statistical Signal Processing Workshop (SSP). Piscataway, NJ:IEEE Press, 2012:393-396.
[11] CHEN Y T, QIAN J, SALIGRAMA V. A new one-class SVM for anomaly detection[C]//Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Piscataway, NJ:IEEE Press, 2013:3567-3571.
[12] SCHÖLKOPF B, PLATT J C, SHAWE-TAYLOR J C, et al. Estimating the support of a high-dimensional distribution[J]. Neural Computation, 2001, 13(7):1443-1471.
[13] FURLANI M, TUIA D, MUNOZ-MARI J, et al. Discovering single classes in remote sensing images with active learning[C]//Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS). Piscataway, NJ:IEEE Press, 2012:7341-7344.
[14] JUMUTC V, SUYKENS J. Multi-class supervised novelty detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(12):2510-2523.
[15] XUE Z, SHANG Y, FENG A. Semi-supervised outlier detection based on fuzzy rough C-means clustering[J]. Mathematics and Computers in Simulation, 2010, 80(9):1911-1921.
[16] HUNG J W, FAN H T. Subband feature statistics normalization techniques based on a discrete wavelet transform for robust speech recognition[J]. IEEE Signal Processing Letters, 2009, 16(9):806-809.
[17] SQUARTINI S, PRINCIPI E, ROTILI R, et al. Environmental robust speech and speaker recognition through multi-channel histogram equalization[J]. Neurocomputing, 2012, 78(1):111-120.
[18] DAI P, SOON I Y. An improved model of masking effects for robust speech recognition system[J]. Speech Communication, 2013, 55(3):387-396.
[19] VALENZUELA O, PASADAS M. Fuzzy data approximation using smoothing cubic splines:Similarity and error analysis[J]. Applied Mathematical Modelling, 2011, 35(5):2122-2144.
[20] FREI M G, OSORIO I. Intrinsic time-scale decomposition:Time-frequency-energy analysis and real-time filtering of non-stationary signals[J]. Royal Society of London Proceedings, 2007, 463(2078):321-342.
[21] ZENG J X, WANG G F, ZHANG F Q, et al. The de-noising algorithm based on intrinsic time-scale decomposition[J]. Advanced Materials Research, 2011, 422:347-352.

A CFAR outlier detection method under varying SNR conditions

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 8

Recommended Articles

Metrics

Comments

[1]	WANG Zhigang, WANG Yeguang, YANG Ning, MI Yufeng, QU Xiaolei. Construction method of flight data mining model based on LSTM [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(8): 525800-525800.
[2]	ZHANG Zhexuan, LONG Teng, XU Guangtong, WANG Yangjie. Revisit mechanism driven multi-UAV cooperative search planning method for moving targets [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2020, 41(5): 323314-323314.
[3]	SUN Canfei, WANG Youren. Advance in study of fault diagnosis of helicopter planetary gears [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2017, 38(7): 20892-20892.
[4]	LIU Yuan, PANG Baojun, CHI Runqiang, CAI Yuan. A damage pattern recognition method for hypervelocity impact on aluminum honeycomb core sandwich based on acoustic emission [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2017, 38(5): 220401-220401.
[5]	HUANG Xiang-hua;DING Yi. Engine Sensor Fault Diagnosis Based on Geometric Pattern Recognition [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2006, 27(6): 1018-1022.
[6]	ZHU Jia-yuan;ZHANG Heng-xi;ZHANG Xi-bin. Reliability Distributions Automatic Identification Based on Intelligent Combined Structure Model [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2003, 24(3): 207-211.
[7]	CHEN Guo;ZUO Hong-fu. CLASSING PARAMETER'S STUDY OF LUBRICATING OIL METAL DEBRIS [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2002, 23(3): 279-281.
[8]	Yang Guo-qing;Chen Song-can;Lu Jun. A MULTI-LAYER ADAPTIVE PATLERN RECOGNITION SYSTEM MODEL [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 1993, 14(2): 26-32.