e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors

Akino Umezawa; Yoshinari Takegawa; Katsuhiro Suzuki; Katsutoshi Masai; Yuta Sugiura; Maki Sugimoto; Yutaka Tokuda; Diego Martinez Plasencia; Sriram Subramanian; Masafumi Takahashi; Hiroaki Taka; Keiji Hirata

doi:10.1145/3384657.3385332

e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors

Akino Umezawa, Yoshinari Takegawa, Katsuhiro Suzuki, Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto, Yutaka Tokuda, Diego Martinez Plasencia, Sriram Subramanian, Masafumi Takahashi, Hiroaki Taka, Keiji Hirata

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

1 Citation (Scopus)

Abstract

The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.

Original language	English
Title of host publication	AHs '20
Subtitle of host publication	Proceedings of the Augmented Humans International Conference
Publisher	Association for Computing Machinery
ISBN (Print)	9781450376037
DOIs	https://doi.org/10.1145/3384657.3385332
Publication status	Published - Mar 2020
Externally published	Yes
Event	2020 Augmented Humans International Conference, AHs 2020 - Kaiserslautern, Germany Duration: 16 Mar 2020 → 17 Mar 2020

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	2020 Augmented Humans International Conference, AHs 2020
Country/Territory	Germany
City	Kaiserslautern
Period	16/03/20 → 17/03/20

Research Keywords

Augmented Face
Communication
Human Agent Interaction

Access Output

10.1145/3384657.3385332

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Umezawa, A., Takegawa, Y., Suzuki, K., Masai, K., Sugiura, Y., Sugimoto, M., Tokuda, Y., Plasencia, D. M., Subramanian, S., Takahashi, M., Taka, H., & Hirata, K. (2020). e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. In AHs '20: Proceedings of the Augmented Humans International Conference Article 36 (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3384657.3385332

@inproceedings{bcc36ae004b24cb7b5c03223cd4ec19d,

title = "e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors",

abstract = "The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.",

keywords = "Augmented Face, Communication, Human Agent Interaction",

author = "Akino Umezawa and Yoshinari Takegawa and Katsuhiro Suzuki and Katsutoshi Masai and Yuta Sugiura and Maki Sugimoto and Yutaka Tokuda and Plasencia, {Diego Martinez} and Sriram Subramanian and Masafumi Takahashi and Hiroaki Taka and Keiji Hirata",

year = "2020",

month = mar,

doi = "10.1145/3384657.3385332",

language = "English",

isbn = "9781450376037",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

booktitle = "AHs '20",

address = "United States",

note = "2020 Augmented Humans International Conference, AHs 2020 ; Conference date: 16-03-2020 Through 17-03-2020",

}

Umezawa, A, Takegawa, Y, Suzuki, K, Masai, K, Sugiura, Y, Sugimoto, M, Tokuda, Y, Plasencia, DM, Subramanian, S, Takahashi, M, Taka, H & Hirata, K 2020, e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. in AHs '20: Proceedings of the Augmented Humans International Conference., 36, ACM International Conference Proceeding Series, Association for Computing Machinery, 2020 Augmented Humans International Conference, AHs 2020, Kaiserslautern, Germany, 16/03/20. https://doi.org/10.1145/3384657.3385332

e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. / Umezawa, Akino; Takegawa, Yoshinari; Suzuki, Katsuhiro et al.
AHs '20: Proceedings of the Augmented Humans International Conference. Association for Computing Machinery, 2020. 36 (ACM International Conference Proceeding Series).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - e2-MaskZ

T2 - 2020 Augmented Humans International Conference, AHs 2020

AU - Umezawa, Akino

AU - Takegawa, Yoshinari

AU - Suzuki, Katsuhiro

AU - Masai, Katsutoshi

AU - Sugiura, Yuta

AU - Sugimoto, Maki

AU - Tokuda, Yutaka

AU - Plasencia, Diego Martinez

AU - Subramanian, Sriram

AU - Takahashi, Masafumi

AU - Taka, Hiroaki

AU - Hirata, Keiji

PY - 2020/3

Y1 - 2020/3

N2 - The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.

AB - The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.

KW - Augmented Face

KW - Communication

KW - Human Agent Interaction

UR - http://www.scopus.com/inward/record.url?scp=85086274254&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85086274254&origin=recordpage

U2 - 10.1145/3384657.3385332

DO - 10.1145/3384657.3385332

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9781450376037

T3 - ACM International Conference Proceeding Series

BT - AHs '20

PB - Association for Computing Machinery

Y2 - 16 March 2020 through 17 March 2020

ER -

Umezawa A, Takegawa Y, Suzuki K, Masai K, Sugiura Y, Sugimoto M et al. e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. In AHs '20: Proceedings of the Augmented Humans International Conference. Association for Computing Machinery. 2020. 36. (ACM International Conference Proceeding Series). doi: 10.1145/3384657.3385332

e2-MaskZ: a Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors

Abstract

Publication series

Conference

Research Keywords

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this