导航

ACTA AERONAUTICAET ASTRONAUTICA SINICA ›› 2021, Vol. 42 ›› Issue (6): 24504-024504.doi: 10.7527/S1000-6893.2020.24504

• Review • Previous Articles     Next Articles

Binary convolutional neural network: Review

DING Wenrui1, LIU Chunlei2, LI Yue2, ZHANG Baochang3   

  1. 1. Unmanned System Research Institute, Beihang University, Beijing 100083, China;
    2. School of Electronic and Information Engineering, Beihang University, Beijing 100083, China;
    3. School of Automation Science and Electrical Engineering, Beihang University, Beijing 100083, China
  • Received:2020-07-07 Revised:2020-08-03 Online:2021-06-15 Published:1900-01-01
  • Supported by:
    National Natural Science Foundation of China (U20B2042); National Natural Science Foundation of China (62076019); Science and Technology Innovation 2030-Key Project of "New Generation Artificial Intelligence" (2020AAA0108200)

Abstract: In recent years, Binary Convolutional Neural Networks (BNNs) have attracted much attention owing to their low storage and high computational efficiency. However, the mismatch between forward and backward quantization results in a huge performance gap between the BNN and the full-precision convolutional neural network, affecting the deployment of the BNN on resource-constrained platforms. Researchers have proposed a series of algorithms and training methods to reduce the performance gap during the binarization process, thereby promoting the application of BNNs to embedded portable devices. This paper makes a comprehensive review of BNNs, mainly from the perspectives of improving network representative capabilities and fully exploring the network training potential. Specifically, improving network representative capabilities includes the design of the binary quantization method and structure design, while fully exploring the network training potential involves loss function design and the training strategy. Finally, we discuss the performance of BNNs in different tasks and hardware platforms, and summarize the challenges in future research.

Key words: binary convolutional neural networks, full-precision convolutional neural networks, binarization, quantization, model compression, lightweight, deep learning

CLC Number: