Generating Natural Language Responses in Robot-Mediated Referential Communication Tasks to Simulate Theory of Mind

Ziming Liu*, Yigang Qin, Huiqi Zou, Eun Jin Paek, Devin Casenhiser, Wenjun Zhou, Xiaopeng Zhao

*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

1 Citation (Scopus)

Abstract

With advances in neural network-based computation, socially assistive robots have been endowed with the ability to provide natural conversation to users. However, the lack of transparency in the computation models results in unexpected robot behaviors and feedback, which may cause users to lose their trust in the robot. Theory of mind (ToM) in cooperative tasks has been considered as a key factor in understanding the relationship between user acceptance and the explainability of robot behaviors. Therefore, we develop a dialog system using previously collected data from a robot-mediated cooperative communication task data to simulate natural language smart feedback. The system is designed based on the mechanism of ToM and validated with a simulation test. Based on the result, we believe the designed dialog system bears the feasibility of simulating ToM and can be used as a research tool for further studying the importance of simulating ToM in human-robot communication. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2022.
Original languageEnglish
Title of host publicationSocial Robotics
Subtitle of host publication14th International Conference, ICSR 2022, Florence, Italy, December 13–16, 2022, Proceedings, Part I
EditorsFilippo Cavallo, John-John Cabibihan, Laura Fiorini, Alessandra Sorrentino, Hongsheng He, Xiaorui Liu, Yoshio Matsumoto, Shuzhi Sam Ge
Place of PublicationCham
PublisherSpringer 
Pages100-109
ISBN (Electronic)978-3-031-24667-8
ISBN (Print)978-3-031-24666-1
DOIs
Publication statusPublished - Dec 2022
Event14th International Conference on Social Robotics (ICSR 2022) - Florence, Italy
Duration: 13 Dec 202216 Dec 2022

Publication series

NameLecture Notes in Artificial Intelligence (including subseries Lecture Notes in Computer Science)
Volume13817
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Social Robotics (ICSR 2022)
PlaceItaly
CityFlorence
Period13/12/2216/12/22

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Research Keywords

  • Human robot interaction
  • Natural language processing
  • Theory of mind

Fingerprint

Dive into the research topics of 'Generating Natural Language Responses in Robot-Mediated Referential Communication Tasks to Simulate Theory of Mind'. Together they form a unique fingerprint.

Cite this