DI-UMONS : Dépôt institutionnel de l’université de Mons

Recherche transversale
(titres de publication, de périodique et noms de colloque inclus)
2010-09-28 - Article/Dans un journal avec peer-review - Anglais - 12 page(s)

Urbain Jérôme, Niewiadomski R., Bevacqua Elisabetta, Dutoit Thierry , Moinet Alexis, Pelachaud C., Picart Benjamin, Tilmanne Joëlle , Wagner Johannes, "AVLaughterCycle" in Journal on Multimodal User Interfaces, 4, 1, 47-58, december 2010

  • Edition : Springer (Germany)
  • Codes CREF : Informatique appliquée logiciel (DI2570), Electricité courants faibles (DI2500)
  • Unités de recherche UMONS : Information, Signal et Intelligence artificielle (F105)
  • Instituts UMONS : Institut NUMEDIART pour les Technologies des Arts Numériques (Numédiart)
Texte intégral :

Abstract(s) :

(Anglais) The AVLaughterCycle project aims at developing an audiovisual laughing machine, able to detect and respond to user’s laughs. Laughter is an important cue to reinforce the engagement in human-computer interactions. As a first step toward this goal, we have implemented a system capable of recording the laugh of a user and responding to it with a similar laugh. The output laugh is automatically selected from an audiovisual laughter database by analyzing acoustic similarities with the input laugh. It is displayed by an Embodied Conversational Agent, animated using the audio-synchronized facial movements of the subject who originally uttered the laugh. The application is fully implemented, works in real time and a large audiovisual laughter database has been recorded as part of the project. This paper presents AVLaughterCycle, its underlying components, the freely available laughter database and the application architecture. The paper also includes evaluations of several core components of the application. Objective tests show that the similarity search engine, though simple, significantly outperforms chance for grouping laughs by speaker or type. This result can be considered as a first measurement for computing acoustic similarities between laughs. A subjective evaluation has also been conducted to measure the influence of the visual cues on the users’ evaluation of similarity between laughs.

Identifiants :
  • ISSN : 1783-7677
  • DOI : 10.1007/s12193-010-0053-1