PAD-based multimodal affective fusion

Stephen W. Gilroy; Marc Cavazza; Marcus Niiranen; Elisabeth André; Thurid Vogt; Jérôme Urbain; Maurice Benayoun; Hartmut Seichter; Mark Billinghurst

doi:10.1109/ACII.2009.5349552

PAD-based multimodal affective fusion

Stephen W. Gilroy
, Marc Cavazza
, Marcus Niiranen
, Elisabeth André
, Thurid Vogt
, Jérôme Urbain
, Maurice Benayoun
, Hartmut Seichter
, Mark Billinghurst

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

26 Citations (Scopus)

Abstract

The study of multimodality is comparatively less developed for Affective interfaces than for their traditional counterparts. However, one condition for the successful development of Affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. ©2009 IEEE.

Original language	English
Title of host publication	Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
DOIs	https://doi.org/10.1109/ACII.2009.5349552
Publication status	Published - 2009
Externally published	Yes
Event	2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009 - Amsterdam, Netherlands Duration: 10 Sept 2009 → 12 Sept 2009

Conference

Conference	2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
Place	Netherlands
City	Amsterdam
Period	10/09/09 → 12/09/09

Access Output

10.1109/ACII.2009.5349552

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

@inproceedings{58b2573667b642c583de5581e9b67ceb,

title = "PAD-based multimodal affective fusion",

abstract = "The study of multimodality is comparatively less developed for Affective interfaces than for their traditional counterparts. However, one condition for the successful development of Affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. {\textcopyright}2009 IEEE.",

author = "Gilroy, \{Stephen W.\} and Marc Cavazza and Marcus Niiranen and Elisabeth Andr{\'e} and Thurid Vogt and J{\'e}r{\^o}me Urbain and Maurice Benayoun and Hartmut Seichter and Mark Billinghurst",

year = "2009",

doi = "10.1109/ACII.2009.5349552",

language = "English",

isbn = "9781424447992",

booktitle = "Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009",

note = "2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009 ; Conference date: 10-09-2009 Through 12-09-2009",

}

Gilroy, SW, Cavazza, M, Niiranen, M, André, E, Vogt, T, Urbain, J, Benayoun, M, Seichter, H & Billinghurst, M 2009, PAD-based multimodal affective fusion. in Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009., 5349552, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009, Amsterdam, Netherlands, 10/09/09. https://doi.org/10.1109/ACII.2009.5349552

PAD-based multimodal affective fusion. / Gilroy, Stephen W.; Cavazza, Marc; Niiranen, Marcus et al.
Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009. 2009. 5349552.

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - PAD-based multimodal affective fusion

AU - Gilroy, Stephen W.

AU - Cavazza, Marc

AU - Niiranen, Marcus

AU - André, Elisabeth

AU - Vogt, Thurid

AU - Urbain, Jérôme

AU - Benayoun, Maurice

AU - Seichter, Hartmut

AU - Billinghurst, Mark

PY - 2009

Y1 - 2009

N2 - The study of multimodality is comparatively less developed for Affective interfaces than for their traditional counterparts. However, one condition for the successful development of Affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. ©2009 IEEE.

AB - The study of multimodality is comparatively less developed for Affective interfaces than for their traditional counterparts. However, one condition for the successful development of Affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. ©2009 IEEE.

UR - https://www.scopus.com/pages/publications/77949344247

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-77949344247&origin=recordpage

U2 - 10.1109/ACII.2009.5349552

DO - 10.1109/ACII.2009.5349552

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9781424447992

BT - Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

T2 - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Y2 - 10 September 2009 through 12 September 2009

ER -

PAD-based multimodal affective fusion

Abstract

Conference

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this