弱光环境下基于深度学习的单光子计数成像去噪方法

doi:10.7527/S1000-6893.2024.30531

Abstract

Abstract:

The high sensitivity of single-pixel single-photon counting imaging makes it extremely advantageous in low-light detection， but the quality of the reconstructed images with this method will still degrade with the weakening of light flux. A single-pixel single-photon counting imaging method based on deep learning denoising is designed to improve the signal-to-noise ratio of reconstructed images in low-light environment. Firstly， a single-pixel single-photon counting imaging system is established. Then， the compressed sensing algorithm is used to reconstruct the image. Finally， the 3D block matching algorithm and the deep learning algorithm are used to denoise the reconstructed image， and the denoising effects of the two algorithms are compared. Ther results show that both of the deep learning algorithm and the 3D block matching algorithm can improve the signal-to-noise ratio of the image. The signal-to-noise ratio of the image obtained by the single-pixel single-photon counting imaging method based on deep learning image denoising is increased by 12.97 dB，which has a great increase of the image signal-to-noise ratio in the low-light environment， and has a higher signal-to-noise ratio than that obtained by the 3D block matching algorithm. Therefore， this method provides a new idea for improving the quality of the image reconstructed by the single-pixel single-photon imaging system in the low-light environment.

Key words: single-pixel imaging, photon counting imaging, image denoising, deep learning, low-light detection

CLC Number:

Zhihao ZHAO, Zhaohua YANG, Yun WU, Yuanjin YU. Single-photon counting imaging denoising method based on deep learning in low-light environment[J]. Acta Aeronautica et Astronautica Sinica, 2025, 46(3): 630531.

Figures/Tables 9

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

References 27

1	KALIRAI J. Scientific discovery with the James Webb Space Telescope‍［J］. Contemporary Physics， 2018， 59（3）： 251-290.
2	STELZER E H K， STROBL F， CHANG B J， et al. Light sheet fluorescence microscopy［J］. Nature Reviews Methods Primers， 2021， 1： 73.
3	TSUCHIDA K， IWASA T， KOBAYASHI M. Imaging of ultraweak photon emission for evaluating the oxidative stress of human skin‍［J］. Journal of Photochemistry and Photobiology B： Biology， 2019， 198： 111562.
4	JOHNSON S D， MOREAU P A， GREGORY T， et al. How many photons does it take to form an image？［J］. Applied Physics Letters， 2020， 116（26）： 260504.
5	MORRIS P A， ASPDEN R S， BELL J E C， et al. Imaging with a small number of photons［J］. Nature Communications， 2015， 6： 5913.
6	MANDRACCHIA B， HUA X W， GUO C L， et al. Fast and accurate sCMOS noise correction for fluorescence microscopy‍［J］. Nature Communications， 2020， 11： 94.
7	TAKHAR D， LASKA J N， WAKIN M B， et al. A new compressive imaging camera architecture using optical-domain compression‍［C］‍∥Computational Imaging IV-Proceedings of SPIE-IS and T Electronic Imaging. 2006： 43-52.
8	DUARTE M F， DAVENPORT M A， TAKHAR D， et al. Single-pixel imaging via compressive sampling［J］. IEEE Signal Processing Magazine， 2008， 25（2）： 83-91.
9	EDGAR M P， GIBSON G M， PADGETT M J. Principles and prospects for single-pixel imaging［J］. Nature Photonics， 2019， 13： 13-20.
10	LIU X L， SHI J H， SUN L， et al. Photon-limited single-pixel imaging［J］. Optics Express， 2020， 28（6）： 8132-8144.
11	WANG H Y， BIAN L H， ZHANG J. Depth acquisition in single-pixel imaging with multiplexed illumination［J］. Optics Express， 2021， 29（4）： 4866-4874.
12	JAUREGUI-SÁNCHEZ Y， CLEMENTE P， LATORRE-CARMONA P， et al. Signal-to-noise ratio of single-pixel cameras based on photodiodes‍［J］. Applied Optics， 2018， 57（7）： B67-B73.
13	俞文凯，姚旭日，刘雪峰，等. 压缩传感用于极弱光计数成像［J］. 光学精密工程， 2012， 20（10）： 2283-2292.
	YU W K， YAO X R， LIU X F， et al. Compressed sensing for ultra-weak light counting imaging［J］. Optics and Precision Engineering， 2012， 20（10）： 2283-2292 （in Chinese）.
14	DABOV K， FOI A， KATKOVNIK V， et al. Image denoising by sparse 3-D transform-domain collaborative filtering‍［J］. IEEE Transactions on Image Processing， 2007， 16（8）： 2080-2095.
15	YAHYA A A， TAN J Q， SU B Y， et al. BM3D image denoising algorithm based on an adaptive filtering‍［J］. Multimedia Tools and Applications， 2020， 79（27）： 20391-20427.
16	LEBRUN M. An analysis and implementation of the BM3D image denoising method［J］. Image Processing On Line， 2012， 2： 175-213.
17	EKSIOGLU E M， TANC A K. Denoising AMP for MRI reconstruction： BM3D-AMP-MRI［J］. SIAM Journal on Imaging Sciences， 2018， 11（3）： 2090-2109.
18	ZHANG K， ZUO W M， CHEN Y J， et al. Beyond a Gaussian denoiser： Residual learning of deep CNN for image denoising‍［J］. IEEE Transactions on Image Processing， 2017， 26（7）： 3142-3155.
19	ZHANG K， ZUO W M， ZHANG L. FFDNet： Toward a fast and flexible solution for CNN-based image denoising［J］. IEEE Transactions on Image Processing， 2018， 27（9）： 4608-4622.
20	ZHANG K， LI Y W， ZUO W M， et al. Plug-and-play image restoration with deep denoiser prior［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2022， 44（10）： 6360-6376.
21	SANKARANARAYANAN A C， XU L N， STUDER C， et al. Video compressive sensing for spatial multiplexing cameras using motion-flow models［J］. SIAM Journal on Imaging Sciences， 2015， 8（3）： 1489-1518.
22	LI C B， YIN W T， JIANG H， et al. An efficient augmented Lagrangian method with applications to total variation minimization‍［J］. Computational Optimization and Applications， 2013， 56（3）： 507-530.
23	孙鸣捷，闫崧明，王思源. 鬼成像和单像素成像技术中的重建算法［J］. 激光与光电子学进展， 2022， 59（2）： 0200001.
	SUN M J， YAN S M， WANG S Y. Reconstruction algorithms for ghost imaging and single-pixel imaging［J］. Laser & Optoelectronics Progress， 2022， 59（2）： 0200001 （in Chinese）.
24	HE K M， ZHANG X Y， REN S Q， et al. Deep residual learning for image recognition‍［C］‍∥2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2016： 770-778.
25	RONNEBERGER O， FISCHER P， BROX T. U-Net： Convolutional networks for biomedical image segmentation‍［C］‍∥International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham： Springer International Publishing， 2015： 234-241.
26	李明飞，阎璐，杨然，等. 日光强度涨落自关联消湍流成像［J］. 物理学报， 2019， 68（9）： 149-156.
	LI M F， YAN L， YANG R， et al. Turbulence-free intensity fluctuation self-correlation imaging with sunlight［J］. Acta Physica Sinica， 2019， 68（9）： 149-156 （in Chinese）.
27	YU W K. Super sub-Nyquist single-pixel imaging by means of cake-cutting Hadamard basis sort［J］. Sensors， 2019， 19（19）： 4122.

[1]	Yiquan WU, Kang TONG. Research advances on deep learning-based small object detection in UAV aerial images [J]. Acta Aeronautica et Astronautica Sinica, 2025, 46(3): 30848-030848.
[2]	Jiaqi LIU, Rongqian CHEN, Jinhua LOU, Xu HAN, Hao WU, Yancheng YOU. Aerodynamic shape optimization of high-speed helicopter rotor airfoil based on deep learning [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(9): 529828-529828.
[3]	Xudong LUO, Yiquan WU, Jinlin CHEN. Research progress on deep learning methods for object detection and semantic segmentation in UAV aerial images [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(6): 28822-028822.
[4]	Haiqiao LIU, Meng LIU, Zichao GONG, Jing DONG. A review of image matching methods based on deep learning [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(3): 28796-028796.
[5]	Yueteng WU, Dun BA, Juan DU, Yunfei LI, Juntao CHANG. Compressor flow field reconstruction method based on deep attention networks [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(24): 630580-630580.
[6]	Zi WANG, Jinghao WANG, Yang LI, Zhang LI, Qifeng YU. Non-cooperative target pose estimation from monocular images based on lightweight neural network [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(22): 330248-330248.
[7]	Tiancai WU, Honglun WANG, Bin REN, Guocheng YAN, Xingyu WU. Learning-based hierarchical coordination fault-tolerant method for hypersonic vehicles [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(22): 330191-330191.
[8]	Yunxiang FAN, Huanan AI, Mingzhen WANG, Kai CAO, Xuejun LIU, Hongqiang LYU. Unsteady hydrodynamic load reconstruction of seaplane based on deep learning [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(20): 129882-129882.
[9]	Junshen LI, Xiangyan MENG, Nuannuan SHI, Wei LI, Ninghua ZHU, Ming LI. Intelligent processing of optical neural networks: Technological evolution and future prospects [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(20): 630439-630439.
[10]	Shaoyi LI, Yaqi ZHANG, Yue CHENG, Xi YANG, Liang ZHANG, Jian LIN, Zhongjie MENG. Scene abstract semantic synthesis model and its application in infrared dim and small target detection [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(20): 630702-630702.
[11]	Xiangxi KONG, Wenyuan QIN, Piaoyi SU, Yongzhao HUA, Xiwang DONG, Li WANG, Ying SU, Kun LYU. Damage assessment algorithm based on deep learning and fuzzy analytic hierarchy process [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(19): 329503-329503.
[12]	Zhaochen CHU, Tao SONG, Ren JIN, Defu LIN. Vision-based air-to-air multi-UAVs tracking [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(14): 629379-629379.
[13]	Junyu LI, Qiankun LIU, Ying FU. Infrared small object detection based on attention mechanism [J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(14): 628959-628959.
[14]	Xin SU, Runcheng GUAN, Qiao WANG, Weizheng YUAN, Xianglian LYU, Yang HE. Ice area and thickness detection method based on deep learning [J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(S2): 729283-729283.
[15]	Liqun CHEN, Xu ZOU, Lei ZHANG, Yingpan ZHU, Gang WANG, Jinyong CHEN. On⁃board intelligent target detection technology based on domestic commercial components [J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(S2): 728860-728860.

Single-photon counting imaging denoising method based on deep learning in low-light environment

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 27

Related Articles 15

Recommended Articles

Metrics

Comments