CIVILICA We Respect the Science
(ناشر تخصصی کنفرانسهای کشور / شماره مجوز انتشارات از وزارت فرهنگ و ارشاد اسلامی: ۸۹۷۱)

Speech Emotion Recognition using Enriched Spectrogram and Deep Convolutional Neural Network Transfer Learning

عنوان مقاله: Speech Emotion Recognition using Enriched Spectrogram and Deep Convolutional Neural Network Transfer Learning
شناسه ملی مقاله: JR_JADM-10-4_008
منتشر شده در در سال 1401
مشخصات نویسندگان مقاله:

B. Z. Mansouri - Electrical and Computer Engineering Department, Ferdows branch, Islamic Azad University, Ferdows, Iran.
H.R. Ghaffary - Electrical and Computer Engineering Department, Ferdows branch, Islamic Azad University, Ferdows, Iran.
A. Harimi - Electrical and Computer Engineering Department, Ferdows branch, Islamic Azad University, Ferdows, Iran.

خلاصه مقاله:
Speech emotion recognition (SER) is a challenging field of research that has attracted attention during the last two decades. Feature extraction has been reported as the most challenging issue in SER systems. Deep neural networks could partially solve this problem in some other applications. In order to address this problem, we proposed a novel enriched spectrogram calculated based on the fusion of wide-band and narrow-band spectrograms. The proposed spectrogram benefited from both high temporal and spectral resolution. Then we applied the resultant spectrogram images to the pre-trained deep convolutional neural network, ResNet۱۵۲. Instead of the last layer of ResNet۱۵۲, we added five additional layers to adopt the model to the present task. All the experiments performed on the popular EmoDB dataset are based on leaving one speaker out of a technique that guarantees the speaker's independency from the model. The model gains an accuracy rate of ۸۸.۹۷% which shows the efficiency of the proposed approach in contrast to other state-of-the-art methods.

کلمات کلیدی:
Wideband and narrowband spectrogram, ResNet۱۵۲, DCNN, Transfer learning, Speech emotion recognition

صفحه اختصاصی مقاله و دریافت فایل کامل: https://civilica.com/doc/1570956/