Challenges and opportunities in portraying emotion in generated sign language
By: John C. McDonald, Rosalee Wolfe, Fabrizio Nunnari
Potential Business Impact:
Makes computer sign language avatars show feelings.
Non-manual signals in sign languages continue to be a challenge for signing avatars. More specifically, emotional content has been difficult to incorporate because of a lack of a standard method of specifying the avatar's emotional state. This paper explores the application of an intuitive two-parameter representation for emotive non-manual signals to the Paula signing avatar that shows promise for facilitating the linguistic specification of emotional facial expressions in a more coherent manner than previous methods. Users can apply these parameters to control Paula's emotional expressions through a textual representation called the EASIER notation. The representation can allow avatars to express more nuanced emotional states using two numerical parameters. It also has the potential to enable more consistent specification of emotional non-manual signals in linguistic annotations which drive signing avatars.
Similar Papers
Perspectives on Capturing Emotional Expressiveness in Sign Language
Human-Computer Interaction
Helps computers understand feelings in sign language.
Emotion Recognition in Signers
CV and Pattern Recognition
Helps computers understand sign language emotions better.
Multimodal Integration Challenges in Emotionally Expressive Child Avatars for Training Applications
Human-Computer Interaction
Makes computer faces show feelings from voices.