DI-UMONS : Dépôt institutionnel de l’université de Mons

Recherche transversale
(titres de publication, de périodique et noms de colloque inclus)
2009-09-10 - Colloque/Article dans les actes avec comité de lecture - Anglais - 8 page(s)

Gilroy Stephen W., Cavazza Marc, Niiranen Marcus, André Elisabeth, Vogt Thurid, Urbain Jérôme , Benayoun Maurice, Seichter Hartmut, Billinghurst Mark, "PAD-based multimodal affective fusion" in Third International Conference on Affective Computing and Intelligent Interaction, 161-168, Amsterdam, Netherlands, 2009

  • Codes CREF : Informatique appliquée logiciel (DI2570)
  • Unités de recherche UMONS : Théorie des circuits et traitement du signal (F105)
Texte intégral :

Abstract(s) :

(Anglais) The study of multimodality is comparatively less developed for Affective interfaces than for their traditional counterparts. However, one condition for the successful development of Affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores.