Header menu link for other important links
X
DNN acoustic models for dysarthric speech
Published in Institute of Electrical and Electronics Engineers Inc.
2017
Abstract
In this paper, we investigate various training methods for building deep neural network (DNN) based acoustic models for dysarthric speech data. Methods like multitask learning, knowledge distillation and model adaptation, which overcome data sparsity and model over-fitting problems are employed to study the merits of each method. In Knowledge distillation framework, some privilege information in addition to featurelabels pairs available only during training, is exploited to help the model learn better without using such previleged information during testing [1]; knowledge from one model can be distilled to another and thereby guiding it in learning better [2]. In this work, a DNN acoustic model trained using data pooled from Dysarthric speech data and parallel un-impaired data is used as the intelligent teacher while the student DNN model is trained using only Dysarthric speech. The target label for training the student model is a combination of hard aligned labels and those obtained from forward-pass through the teacher model. In addition to this technique, other knowledge sharing techniques like multitask learning were explored for Dysarthric speech data and have found to show a relative improvement of 11% over the corresponding baseline models. © 2017 IEEE.
About the journal
JournalData powered by Typeset2017 23rd National Conference on Communications, NCC 2017
PublisherData powered by TypesetInstitute of Electrical and Electronics Engineers Inc.
Open AccessNo
Concepts (18)
  •  related image
    Deep learning
  •  related image
    Distillation
  •  related image
    Education
  •  related image
    Learning systems
  •  related image
    Multitasking
  •  related image
    Personnel training
  •  related image
    Speech
  •  related image
    Speech recognition
  •  related image
    Teaching
  •  related image
    BASELINE MODELS
  •  related image
    DYSARTHRIA
  •  related image
    KNOWLEDGE-SHARING
  •  related image
    MODEL ADAPTATION
  •  related image
    Multitask learning
  •  related image
    OVER FITTING PROBLEM
  •  related image
    STUDENT MODELING
  •  related image
    Training methods
  •  related image
    Deep neural networks