The search functionality is under construction.
The search functionality is under construction.

Combining Spiking Neural Networks with Artificial Neural Networks for Enhanced Image Classification

Naoya MURAMATSU, Hai-Tao YU, Tetsuji SATOH

  • Full Text Views

    0

  • Cite this

Summary :

With the continued innovation of deep neural networks, spiking neural networks (SNNs) that more closely resemble biological brain synapses have attracted attention because of their low power consumption. Unlike artificial neural networks (ANNs), for continuous data values, they must employ an encoding process to convert the values to spike trains, suppressing the SNN's performance. To avoid this degradation, the incoming analog signal must be regulated prior to the encoding process, which is also realized in living things eg, the basement membranes of humans mechanically perform the Fourier transform. To this end, we combine an ANN and an SNN to build ANN-to-SNN hybrid neural networks (HNNs) that improve the concerned performance. To qualify this performance and robustness, MNIST and CIFAR-10 image datasets are used for various classification tasks in which the training and encoding methods changes. In addition, we present simultaneous and separate training methods for the artificial and spiking layers, considering the encoding methods of each. We find that increasing the number of artificial layers at the expense of spiking layers improves the HNN performance. For straightforward datasets such as MNIST, similar performances as ANN's are achieved by using duplicate coding and separate learning. However, for more complex tasks, the use of Gaussian coding and simultaneous learning is found to improve the accuracy of the HNN while lower power consumption.

Publication
IEICE TRANSACTIONS on Information Vol.E106-D No.2 pp.252-261
Publication Date
2023/02/01
Publicized
2022/11/07
Online ISSN
1745-1361
DOI
10.1587/transinf.2021EDP7237
Type of Manuscript
PAPER
Category
Biocybernetics, Neurocomputing

Authors

Naoya MURAMATSU
  University of Cape Town
Hai-Tao YU
  University of Tsukuba
Tetsuji SATOH
  University of Tsukuba

Keyword