Prediction-based gesture detection in lecture videos by combining visual, speech and electronic slides

Feng Wang; Chong-Wah Ngo; Ting-Chuen Pong

doi:10.1109/ICME.2006.262530

Prediction-based gesture detection in lecture videos by combining visual, speech and electronic slides

Feng Wang, Chong-Wah Ngo, Ting-Chuen Pong

Department of Computer Science

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

3 Citations (Scopus)

Abstract

This paper presents an efficient algorithm for gesture detection in lecture videos by combining visual, speech and electronic slides. Besides accuracy, response time is also considered to cope with the efficiency requirements of real-time applications. Candidate gestures are first detected by visual cue. Then we modifity HMM models for complete gestures to predict and recognize incomplete gestures before the whole gestures paths are observed. Gesture recognition is used to verify the results of gesture detection. The relations between visual, speech and slides are analyzed. The correspondence between speech and gesture is employed to improve the accuracy and the responsiveness of gesture detection. © 2006 IEEE.

Original language	English
Title of host publication	2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings
Pages	653-656
Volume	2006
DOIs	https://doi.org/10.1109/ICME.2006.262530
Publication status	Published - 2006
Event	2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Toronto, ON, Canada Duration: 9 Jul 2006 → 12 Jul 2006

Publication series

Name
Volume	2006

Conference

Conference	2006 IEEE International Conference on Multimedia and Expo, ICME 2006
Place	Canada
City	Toronto, ON
Period	9/07/06 → 12/07/06

Access Output

10.1109/ICME.2006.262530

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

@inproceedings{d30c48a703914783b9f5202c7863c48c,

title = "Prediction-based gesture detection in lecture videos by combining visual, speech and electronic slides",

abstract = "This paper presents an efficient algorithm for gesture detection in lecture videos by combining visual, speech and electronic slides. Besides accuracy, response time is also considered to cope with the efficiency requirements of real-time applications. Candidate gestures are first detected by visual cue. Then we modifity HMM models for complete gestures to predict and recognize incomplete gestures before the whole gestures paths are observed. Gesture recognition is used to verify the results of gesture detection. The relations between visual, speech and slides are analyzed. The correspondence between speech and gesture is employed to improve the accuracy and the responsiveness of gesture detection. {\textcopyright} 2006 IEEE.",

author = "Feng Wang and Chong-Wah Ngo and Ting-Chuen Pong",

year = "2006",

doi = "10.1109/ICME.2006.262530",

language = "English",

isbn = "1424403677",

volume = "2006",

pages = "653--656",

booktitle = "2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings",

note = "2006 IEEE International Conference on Multimedia and Expo, ICME 2006 ; Conference date: 09-07-2006 Through 12-07-2006",

}

Wang, F, Ngo, C-W & Pong, T-C 2006, Prediction-based gesture detection in lecture videos by combining visual, speech and electronic slides. in 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings. vol. 2006, 4036684, pp. 653-656, 2006 IEEE International Conference on Multimedia and Expo, ICME 2006, Toronto, ON, Canada, 9/07/06. https://doi.org/10.1109/ICME.2006.262530

Prediction-based gesture detection in lecture videos by combining visual, speech and electronic slides. / Wang, Feng; Ngo, Chong-Wah; Pong, Ting-Chuen.
2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings. Vol. 2006 2006. p. 653-656 4036684.

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - Prediction-based gesture detection in lecture videos by combining visual, speech and electronic slides

AU - Wang, Feng

AU - Ngo, Chong-Wah

AU - Pong, Ting-Chuen

PY - 2006

Y1 - 2006

N2 - This paper presents an efficient algorithm for gesture detection in lecture videos by combining visual, speech and electronic slides. Besides accuracy, response time is also considered to cope with the efficiency requirements of real-time applications. Candidate gestures are first detected by visual cue. Then we modifity HMM models for complete gestures to predict and recognize incomplete gestures before the whole gestures paths are observed. Gesture recognition is used to verify the results of gesture detection. The relations between visual, speech and slides are analyzed. The correspondence between speech and gesture is employed to improve the accuracy and the responsiveness of gesture detection. © 2006 IEEE.

AB - This paper presents an efficient algorithm for gesture detection in lecture videos by combining visual, speech and electronic slides. Besides accuracy, response time is also considered to cope with the efficiency requirements of real-time applications. Candidate gestures are first detected by visual cue. Then we modifity HMM models for complete gestures to predict and recognize incomplete gestures before the whole gestures paths are observed. Gesture recognition is used to verify the results of gesture detection. The relations between visual, speech and slides are analyzed. The correspondence between speech and gesture is employed to improve the accuracy and the responsiveness of gesture detection. © 2006 IEEE.

UR - http://www.scopus.com/inward/record.url?scp=34247614632&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-34247614632&origin=recordpage

U2 - 10.1109/ICME.2006.262530

DO - 10.1109/ICME.2006.262530

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 1424403677

SN - 9781424403677

VL - 2006

SP - 653

EP - 656

BT - 2006 IEEE International Conference on Multimedia and Expo, ICME 2006 - Proceedings

T2 - 2006 IEEE International Conference on Multimedia and Expo, ICME 2006

Y2 - 9 July 2006 through 12 July 2006

ER -

Prediction-based gesture detection in lecture videos by combining visual, speech and electronic slides

Abstract

Publication series

Conference

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this