Gao, X. and Yang, Y. and Tao, D. and Li, Xuelong (2009) Discriminative optical flow tensor for video semantic analysis. Computer Vision and Image Understanding 113 (3), pp. 372-383. ISSN 1077-3142.
Abstract
This paper presents a novel framework for effective video semantic analysis. This framework has two major components, namely, optical flow tensor (OFT) and hidden Markov models (HMMs). OFT and HMMs are employed because: (1) motion is one of the fundamental characteristics reflecting the semantic information in video, so an OFT-based feature extraction method is developed to make full use of the motion information. Thereafter, to preserve the structure and discriminative information presented by OFT, general tensor discriminant analysis (GTDA) is used for dimensionality reduction. Finally, linear discriminant analysis (LDA) is utilized to further reduce the feature dimension for discriminative motion information representation; and (2) video is a sort of information intensive sequential media characterized by its context-sensitive nature, so the video sequences can be more effectively analyzed by some temporal modeling tools. In this framework, we use HMMs to well model different levels of semantic units (SU), e.g., shot and event. Experimental results are reported to demonstrate the advantages of the proposed framework upon semantic analysis of basketball video sequences, and the cross validations illustrate its feasibility and effectiveness.
Metadata
| Item Type: | Article |
|---|---|
| Keyword(s) / Subject(s): | Optical flow tensor, video semantic analysis, general tensor discriminant analysis, linear discriminant analysis, hidden Markov models |
| School: | Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences |
| Depositing User: | Sarah Hall |
| Date Deposited: | 11 Jul 2013 10:13 |
| Last Modified: | 09 Aug 2023 12:33 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/7635 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
