3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System

Xinyu Liu; Chun Ho So; Hongli Huang; Yuxuan Xue; Yichen Wang; King Wai Chiu Lai; Vellaisamy A. L. Roy; Ning Xi

doi:10.1109/ROBIO55434.2022.10011747

3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System

Xinyu Liu, Chun Ho So, Hongli Huang, Yuxuan Xue, Yichen Wang, King Wai Chiu Lai, Vellaisamy A. L. Roy, Ning Xi^*

^*Corresponding author for this work

Department of Biomedical Engineering

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

4 Citations (Scopus)

Abstract

In traditional teleoperation systems, the single video feedback provided to an operator generally suffers from a lack of spatial depth information. In this paper, we propose to provide real-time 3D stereoscopic visual feedback for the operator, so that they can accurately acquire information about the working environment with a sense of depth. However, due to the randomness of the Internet delay, the received video tends to be stuck or interrupted, which makes the operator manipulate without obtaining the information of the remote operating environment. In this paper, an event-based robot teleoperation system is designed and constructed to ensure the synchronization of control commands and feedback events. Experiments have been conducted to reveal that the use of real-time 3D stereoscopic video feedback in the event-based robotic teleoperation system can enable operators to perform tasks more safely, accurately, and efficiently. © 2022 IEEE.

Original language	English
Title of host publication	The 2022 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2022
Publisher	IEEE
Pages	2299-2304
ISBN (Electronic)	9781665481090
ISBN (Print)	9781665481106
DOIs	https://doi.org/10.1109/ROBIO55434.2022.10011747
Publication status	Published - Dec 2022
Event	2022 IEEE International Conference on Robotics and Biomimetics (ROBIO 2022) - China Sheraton Grand Xishuangbanna Hotel, Jinghong, China Duration: 5 Dec 2022 → 9 Dec 2022 http://irmv.sjtu.edu.cn/robio2022/venue.html

Publication series

Name	IEEE International Conference on Robotics and Biomimetics, ROBIO

Conference

Conference	2022 IEEE International Conference on Robotics and Biomimetics (ROBIO 2022)
Abbreviated title	IEEE ROBIO 2022
Country/Territory	China
City	Jinghong
Period	5/12/22 → 9/12/22
Internet address	http://irmv.sjtu.edu.cn/robio2022/venue.html

Funding

This work was partially supported by grants from the Research Grants Council of the Hong Kong Special Administrative Region, China (Project No. C7174-20G, and 17209521), the Basic Research Program of Shenzhen (JCYJ20170818105718495, and JCYJ20180504170303184) and the National Natural Science Foundation of China (Grant Nos. 61727811, U1813214, and U1813210).

Access Output

10.1109/ROBIO55434.2022.10011747

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Liu, X., So, C. H., Huang, H., Xue, Y., Wang, Y., Chiu Lai, K. W., Roy, V. A. L., & Xi, N. (2022). 3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System. In The 2022 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2022 (pp. 2299-2304). (IEEE International Conference on Robotics and Biomimetics, ROBIO). IEEE. https://doi.org/10.1109/ROBIO55434.2022.10011747

@inproceedings{26a933baf45f455eb2e537fc6a4b68a0,

title = "3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System",

abstract = "In traditional teleoperation systems, the single video feedback provided to an operator generally suffers from a lack of spatial depth information. In this paper, we propose to provide real-time 3D stereoscopic visual feedback for the operator, so that they can accurately acquire information about the working environment with a sense of depth. However, due to the randomness of the Internet delay, the received video tends to be stuck or interrupted, which makes the operator manipulate without obtaining the information of the remote operating environment. In this paper, an event-based robot teleoperation system is designed and constructed to ensure the synchronization of control commands and feedback events. Experiments have been conducted to reveal that the use of real-time 3D stereoscopic video feedback in the event-based robotic teleoperation system can enable operators to perform tasks more safely, accurately, and efficiently. {\textcopyright} 2022 IEEE.",

author = "Xinyu Liu and So, {Chun Ho} and Hongli Huang and Yuxuan Xue and Yichen Wang and {Chiu Lai}, {King Wai} and Roy, {Vellaisamy A. L.} and Ning Xi",

year = "2022",

month = dec,

doi = "10.1109/ROBIO55434.2022.10011747",

language = "English",

isbn = "9781665481106",

series = "IEEE International Conference on Robotics and Biomimetics, ROBIO",

publisher = "IEEE",

pages = "2299--2304",

booktitle = "The 2022 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2022",

address = "United States",

note = "2022 IEEE International Conference on Robotics and Biomimetics (ROBIO 2022), IEEE ROBIO 2022 ; Conference date: 05-12-2022 Through 09-12-2022",

url = "http://irmv.sjtu.edu.cn/robio2022/venue.html",

}

Liu, X, So, CH, Huang, H, Xue, Y, Wang, Y, Chiu Lai, KW , Roy, VAL & Xi, N 2022, 3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System. in The 2022 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2022. IEEE International Conference on Robotics and Biomimetics, ROBIO, IEEE, pp. 2299-2304, 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO 2022), Jinghong, China, 5/12/22. https://doi.org/10.1109/ROBIO55434.2022.10011747

3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System. / Liu, Xinyu; So, Chun Ho; Huang, Hongli et al.
The 2022 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2022. IEEE, 2022. p. 2299-2304 (IEEE International Conference on Robotics and Biomimetics, ROBIO).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - 3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System

AU - Liu, Xinyu

AU - So, Chun Ho

AU - Huang, Hongli

AU - Xue, Yuxuan

AU - Wang, Yichen

AU - Chiu Lai, King Wai

AU - Roy, Vellaisamy A. L.

AU - Xi, Ning

PY - 2022/12

Y1 - 2022/12

N2 - In traditional teleoperation systems, the single video feedback provided to an operator generally suffers from a lack of spatial depth information. In this paper, we propose to provide real-time 3D stereoscopic visual feedback for the operator, so that they can accurately acquire information about the working environment with a sense of depth. However, due to the randomness of the Internet delay, the received video tends to be stuck or interrupted, which makes the operator manipulate without obtaining the information of the remote operating environment. In this paper, an event-based robot teleoperation system is designed and constructed to ensure the synchronization of control commands and feedback events. Experiments have been conducted to reveal that the use of real-time 3D stereoscopic video feedback in the event-based robotic teleoperation system can enable operators to perform tasks more safely, accurately, and efficiently. © 2022 IEEE.

AB - In traditional teleoperation systems, the single video feedback provided to an operator generally suffers from a lack of spatial depth information. In this paper, we propose to provide real-time 3D stereoscopic visual feedback for the operator, so that they can accurately acquire information about the working environment with a sense of depth. However, due to the randomness of the Internet delay, the received video tends to be stuck or interrupted, which makes the operator manipulate without obtaining the information of the remote operating environment. In this paper, an event-based robot teleoperation system is designed and constructed to ensure the synchronization of control commands and feedback events. Experiments have been conducted to reveal that the use of real-time 3D stereoscopic video feedback in the event-based robotic teleoperation system can enable operators to perform tasks more safely, accurately, and efficiently. © 2022 IEEE.

UR - http://www.scopus.com/inward/record.url?scp=85147328762&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85147328762&origin=recordpage

U2 - 10.1109/ROBIO55434.2022.10011747

DO - 10.1109/ROBIO55434.2022.10011747

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9781665481106

T3 - IEEE International Conference on Robotics and Biomimetics, ROBIO

SP - 2299

EP - 2304

BT - The 2022 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2022

PB - IEEE

T2 - 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO 2022)

Y2 - 5 December 2022 through 9 December 2022

ER -

Liu X, So CH, Huang H, Xue Y, Wang Y, Chiu Lai KW et al. 3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System. In The 2022 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2022. IEEE. 2022. p. 2299-2304. (IEEE International Conference on Robotics and Biomimetics, ROBIO). doi: 10.1109/ROBIO55434.2022.10011747

3D Stereoscopic Display in the Event-Based Real-Time Internet-Based Robotic Teleoperation System

Abstract

Publication series

Conference

Funding

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this