List of facial expression databases: Difference between revisions

Revision as of 04:19, 5 July 2023

Latest revision as of 18:47, 26 August 2025

(8 intermediate revisions by 5 users not shown)

Line 1:

{{short description|none}}

A '''facial expression database''' is a collection of images or video clips with [[facial expression]]s of a range of [[emotions]].

Well-annotated ([[emotion]]-tagged) media content of facial behavior is essential for training, testing, and validation of [[algorithm]]s for the development of [[Emotion recognition|expression recognition systems]]. The emotion annotation can be done in [[discrete emotion theory|discrete emotion]] labels or on a continuous scale. Most of the databases are usually based on the [[basic emotions]] theory (by [[Paul Ekman]]) which assumes the existence of six discrete basic emotions (anger, fear, disgust, surprise, joy, sadness). However, some databases include the emotion tagging in continuous arousal-valence scale.

Line 26 ⟶ 27:

|Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) <ref>Livingstone & Russo (2018). The Ryerson Audio-Visual Database of

Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. {{doi|10.1371/journal.pone.0196391

|doi-access=free}}</ref>

|Speech: Calm, happy, sad, angry, fearful, surprise, disgust, and neutral.

Song: Calm, happy, sad, angry, fearful, and neutral.

Line 88 ⟶ 89:

|

|-

|Indian Semi-Acted Facial Expression Database (iSAFE)<ref>{{Cite journalbook|last1=Singh|first1=Shivendra|last2=Benedict|first2=Shajulin|title=Advances in Signal Processing and Intelligent Recognition Systems |chapter=Indian Semi-Acted Facial Expression (ISAFE) Dataset for Human Emotions Recognition |date=2020|editor-last=Thampi|editor-first=Sabu M.|editor2-last=Hegde|editor2-first=Rajesh M.|editor3-last=Krishnan|editor3-first=Sri|editor4-last=Mukhopadhyay|editor4-first=Jayanta|editor5-last=Chaudhary|editor5-first=Vipin|editor6-last=Marques|editor6-first=Oge|editor7-last=Piramuthu|editor7-first=Selwyn|editor8-last=Corchado|editor8-first=Juan M.|title=Indian Semichapter-Acted Facial Expression (iSAFE) Dataset for Human Emotions Recognition|url=https://link.springer.com/chapter/10.1007/978-981-15-4828-4_13|journal=Advances in Signal Processing and Intelligent Recognition Systems|series=Communications in Computer and Information Science|volume=1209 |language=en|___location=Singapore|publisher=Springer|pages=150–162|doi=10.1007/978-981-15-4828-4_13|isbn=978-981-15-4828-4}}</ref>

|Happy, Sad, Fear, Surprise, Angry, Neutral, Disgust

|44

Line 180 ⟶ 181:

|Posed

|-

|Aff-Wild<ref>{{Cite journalbook|last1=Zafeiriou|first1=S.|last2=Kollias|first2=D.|last3=Nicolaou|first3=M.A.|last4=Papaioannou|first4=A.|last5=Zhao|first5=G.|last6=Kotsia|first6=I.|datetitle=2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) |titlechapter=Aff-Wild: Valence and Arousal in'In-the-wildWild' Challenge |date=2017|chapter-url=httphttps://openaccesseprints.thecvfmdx.comac.uk/content_cvpr_2017_workshops22045/w331/papers/Zafeiriou_Aff-Wild_Valence_and_CVPR_2017_paperaff_wild_kotsia.pdf|journal=Computer Vision and Pattern Recognition Workshops (CVPRW), 2017|pages=1980–1987|doi=10.1109/CVPRW.2017.248|isbn=978-1-5386-0733-6|s2cid=3107614|url=http://urn.fi/urn:nbn:fi-fe201902276466 }}</ref><ref>{{Cite journal|last1=Kollias|first1=D.|last2=Tzirakis|first2=P.|last3=Nicolaou|first3=M.A.|last4=Papaioannou|first4=A.|last5=Zhao|first5=G.|last6=Schuller|first6=B.|last7=Kotsia|first7=I.|last8=Zafeiriou|first8=S.|date=2019|title=Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond|url=https://rdcu.be/bmGm2|journal=International Journal of Computer Vision |volume=127|issue=6–7|pages=907–929|doi=10.1007/s11263-019-01158-4|s2cid=13679040|doi-access=free|arxiv=1804.10938}}</ref>

|valence and arousal

|200

Line 189 ⟶ 190:

|In-the-Wild setting

|-

|Aff-Wild2<ref>{{Cite journal|last1=Kollias|first1=D.|last2=Zafeiriou|first2=S.|date=2019|title=Expression, affect, action unit recognition: Aff-wild2, multi-task learning and arcface|url=https://bmvc2019.org/wp-content/uploads/papers/0399-paper.pdf|journal=British Machine Vision Conference (BMVC), 2019|arxiv=1910.04855}}</ref><ref>{{Cite journalbook|last1=Kollias|first1=D.|last2=Schulc|first2=A.|last3=Hajiyev|first3=E.|last4=Zafeiriou|first4=S.|datetitle=2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020) |titlechapter=Analysing affectiveAffective behaviorBehavior in the firstFirst abawABAW 2020 competitionCompetition |date=2020|chapter-url=https://www.computer.org/csdl/proceedings-article/fg/2020/307900a794/1kecIYu9wL6|journal=IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2020|pages=637–643|doi=10.1109/FG47880.2020.00126|arxiv=2001.11409|isbn=978-1-7281-3079-8|s2cid=210966051}}</ref>

|neutral, happiness, sadness, surprise, fear, disgust, anger + valence-arousal + action units 1,2,4,6,12,15,20,25

|458

Line 198 ⟶ 199:

|In-the-Wild setting

|-

|Real-world Affective Faces Database (RAF-DB)<ref>{{Cite web|last=Li.|first=S.|title=RAF-DB|url=http://www.whdeng.cn/RAF/model1.html|website=Real-world Affective Faces Database}}</ref><ref>{{Cite journalbook|last1=Li|first1=S.|last2=Deng|first2=W.|last3=Du|first3=J.|datetitle=2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) |titlechapter=Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild |url=https://ieeexplore.ieee.org/document/8099760|journaldate=2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)|pages=2584–2593|doi=10.1109/CVPR.2017.277|isbn=978-1-5386-0457-1|s2cid=11413183}}</ref>

|6 classes of '''basic emotions''' (Surprised, Fear, Disgust, Happy, Sad, Angry) plus Neutral and 12 classes of '''compound emotions''' (Fearfully Surprised, Fearfully Disgusted, Sadly Angry, Sadly Fearful, Angrily Disgusted, Angrily Surprised, Sadly Disgusted, Disgustedly Surprised, Happily Surprised, Sadly Surprised, Fearfully Angry, Happily Disgusted)

|

Line 215 ⟶ 216:

{{Nonverbal communication}}

[[Category:Database-related lists|Facial expression]]

[[Category:Facial expressions]]