A novel audio-oriented learning strategies for character recognition
- Changbin Lu,
- Guangyu Gao(corresponding author)
- ,
- Beijing Institute of Technology
Output:
Chapter in Book/Report/Conference proceeding
Conference contribution
Academic
Peer-reviewInformation
Output type
Output:
Chapter in Book/Report/Conference proceeding
Conference contribution
Academic
Peer-reviewOriginal language
EnglishArticle number
7938239Pages from-to (Number of pages)
Pages 459-464 (6 pages)Publication milestones
- Published - 2016
Publication status
Published - 2016
Place of publication
PiscatawayPublisher
Institute of Electrical and Electronics Engineers, United StatesISBN (Print)
978-1-5090-5189-2ISBN (Electronic)
978-1-5090-5188-5Host publication title
Proceedings - 2016 International Conference on Virtual Reality and Visualization, ICVRV 2016Host publication editors
- Dandan Ding
- Dangxiao Wang
- Jian Chen
- Xun Luo
Funding Details
National Natural Science Foundation of China under Grant NO. 61401023
Related Event
Title
6th International Conference on Virtual Reality and Visualization (ICVRV 2016)
Event type
ConferenceDate
24/09/2016 - 26/09/2016Location
Hangzhou, ZhejiangChina
Abstract
<p>In this paper, we propose a robust audio-oriented learning strategies to address the issue of character recognition in movie/TV-series. Identifying major characters in movies/TV-series has drawn researcher's great interests. Most of them have explored some character recognition and retrieval applications based on visual appearance, whereas visual appearance is inconsistent throughout the whole video. Our approach, mainly focusing on audio, features that: (i) we extract both spectral and temporal audio features of Mel-scale Frequency Cepstral Coefficients(MFCC), prosodic, average pause length, speaking rate features, pitch and short time energy, and also the complementarity of Gabor features, (ii) we adopt Multi-Task Joint Sparse Representation and Recognition (MTJSRC) model for learning with all the features except Gabor, and SVM model with Gabor features, (iii) regarding these original features as seeds, we extend the training set from talk shows with semi-supervise learning, (iv) the Conditional Random Field (CRF) model with consideration of the constrains in time sequence is introduced to enhance the final labelling. Finally, experimental results demonstrates the effectiveness performance of our approach.</p>
Documents and Links
Metrics
Metrics
SciVal
Author count
2
SciVal
Paper percentile
28
PlumX, opens in new tab
Captures
5
