The Library
Learning spontaneity to improve emotion recognition in speech
Tools
Tools
Tools
Mangalam, Karttikeya and Guha, Tanaya (2018) Learning spontaneity to improve emotion recognition in speech. In: INTERSPEECH 2018, Hyderabad, India, 2-6 Sep 2018. Published in: Proceedings of INTERSPEECH 2018 pp. 946-950. doi:10.21437/Interspeech.2018-1872
|
PDF
WRAP-learning-spontaneity-improve-emotion-speech-Mangalam-2018.pdf - Accepted Version - Requires a PDF viewer. Download (835Kb) | Preview |
Official URL: https://doi.org/10.21437/Interspeech.2018-1872
Abstract
We investigate the effect and usefulness of spontaneity (i.e. whether a given speech is spontaneous or not) in speech in the context of emotion recognition. We hypothesize that emotional content in speech is interrelated with its spontaneity, and use spontaneity classification as an auxiliary task to the problem of emotion recognition. We propose two supervised learning settings that utilize spontaneity to improve speech emotion recognition: a hierarchical model that performs spontaneity detection before performing emotion recognition, and a multitask learning model that jointly learns to recognize both spontaneity and emotion. Through various experiments on the well known IEMOCAP database, we show that by using spontaneity detection as an additional task, significant improvement can be achieved over emotion recognition systems that are unaware of spontaneity. We achieve state-of-the-art emotion recognition accuracy (4-class, 69.1%) on the IEMOCAP database outperforming several relevant and competitive baselines.
| Item Type: | Conference Item (Paper) | ||||||
|---|---|---|---|---|---|---|---|
| Subjects: | B Philosophy. Psychology. Religion > BF Psychology | ||||||
| Divisions: | Faculty of Science > Computer Science | ||||||
| Library of Congress Subject Headings (LCSH): | Spontaneity (Personality trait), Emotion recognition -- Mathematical models, Speech | ||||||
| Journal or Publication Title: | Proceedings of INTERSPEECH 2018 | ||||||
| Publisher: | 2018 International Speech Communication Association | ||||||
| Official Date: | 2018 | ||||||
| Dates: |
|
||||||
| Date of first compliant deposit: | 3 September 2018 | ||||||
| Page Range: | pp. 946-950 | ||||||
| DOI: | 10.21437/Interspeech.2018-1872 | ||||||
| Status: | Peer Reviewed | ||||||
| Publication Status: | Published | ||||||
| Access rights to Published version: | Restricted or Subscription Access | ||||||
| Conference Paper Type: | Paper | ||||||
| Title of Event: | INTERSPEECH 2018 | ||||||
| Type of Event: | Conference | ||||||
| Location of Event: | Hyderabad, India | ||||||
| Date(s) of Event: | 2-6 Sep 2018 | ||||||
| Related URLs: | |||||||
| Open Access Version: |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
