Data Augmentation Techniques for Speech Emotion Recognition and Deep Learning

  1. José Antonio Nicolás 1
  2. Javier de Lope 1
  3. Manuel Graña 2
  1. 1 Universidad Politécnica de Madrid
    info

    Universidad Politécnica de Madrid

    Madrid, España

    ROR https://ror.org/03n6nwv02

  2. 2 University of the Basque Country (UPV/EHU), Leioa, Spain
Book:
Bio-inspired Systems and Applications: from Robotics to Ambient Intelligence: 9th International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2022, Puerto de la Cruz, Tenerife, Spain, May 31 – June 3, 2022, Proceedings, Part II
  1. José Manuel Ferrández Vicente (dir. congr.)
  2. José Ramón Alvarez Sánchez (dir. congr.)
  3. Félix de la Paz López (dir. congr.)
  4. Hojjat Adeli

Publisher: Springer Suiza

ISBN: 978-3-031-06527-9

Year of publication: 2022

Pages: 279-288

Type: Book chapter

Abstract

This paper introduces innovations both in data augmentation and deep neural network architecture for speech emotion recognition (SER). The novel architecture combines a series of convolutional layers with a final layer of long short-term memory cells to determine emotions in audio signals. The audio signals are conveniently processed to generate mel spectrograms, which are used as inputs to the deep neural network architecture. This paper proposes a selected set of data augmentation techniques that allow to reduce the network overfitting. We achieve an average recognition accuracy of 86.44% on publicly distributed databases, outperforming state-of-the-art methods.