The search functionality is under construction.
The search functionality is under construction.

Open Access
Multi Model-Based Distillation for Sound Event Detection

Yingwei FU, Kele XU, Haibo MI, Qiuqiang KONG, Dezhi WANG, Huaimin WANG, Tie HONG

  • Full Text Views

    106

  • Cite this
  • Free PDF (325.8KB)

Summary :

Sound event detection is intended to identify the sound events in audio recordings, which has widespread applications in real life. Recently, convolutional recurrent neural network (CRNN) models have achieved state-of-the-art performance in this task due to their capabilities in learning the representative features. However, the CRNN models are of high complexities with millions of parameters to be trained, which limits their usage for the mobile and embedded devices with limited computation resource. Model distillation is effective to distill the knowledge of a complex model to a smaller one, which can be deployed on the devices with limited computational power. In this letter, we propose a novel multi model-based distillation approach for sound event detection by making use of the knowledge from models of multiple teachers which are complementary in detecting sound events. Extensive experimental results demonstrated that our approach achieves a compression ratio about 50 times. In addition, better performance is obtained for the sound event detection task.

Publication
IEICE TRANSACTIONS on Information Vol.E102-D No.10 pp.2055-2058
Publication Date
2019/10/01
Publicized
2019/07/08
Online ISSN
1745-1361
DOI
10.1587/transinf.2019EDL8062
Type of Manuscript
LETTER
Category
Artificial Intelligence, Data Mining

Authors

Yingwei FU
  National Key Laboratory of Parallel and Distributed Processing,National University of Defense Technology
Kele XU
  National Key Laboratory of Parallel and Distributed Processing,National University of Defense Technology
Haibo MI
  National Key Laboratory of Parallel and Distributed Processing,National University of Defense Technology
Qiuqiang KONG
  University of Surrey
Dezhi WANG
  National University of Defense Technology
Huaimin WANG
  National Key Laboratory of Parallel and Distributed Processing,National University of Defense Technology
Tie HONG
  National University of Defense Technology

Keyword