Gao, X. and Li, Xuelong and Feng, J. and Tao, D. (2009) Shot-based video retrieval with optical flow tensor and HMMs. Pattern Recognition Letters 30 (2), pp. 140-147. ISSN 0167-8655.
Abstract
Video retrieval and indexing research aims to efficiently and effectively manage very large video databases, e.g., CCTV records, which is a key component in video-based object and event analysis. In this paper, for the purpose of video retrieval, we propose a novel method to represent video data by developing an optical flow tensor (OFT) and incorporating hidden Markov models (HMMs). As video is content-sensitive and normally carries rich motion information of objects, optical flow field is first employed to estimate such motion. Then, a shot HMMs tree is built to model video clips in different levels in a database. Experimental results demonstrate that the newly developed method inherits advantages of both optical flow and HMMs in video representation. With the newly developed video representation, in video retrieval and indexing tasks, no need to exhaustively compare a query video shot with all video shot records in the database. Moreover, the novel representation method works well when linear discriminant analysis (LDA) is utilized to reduce the feature dimensionality and further speed up the retrieval procedure.
Metadata
| Item Type: | Article |
|---|---|
| Keyword(s) / Subject(s): | Shot-based video retrieval, optical flow tensor, HMMs, shot HMMs tree |
| School: | Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences |
| Depositing User: | Administrator |
| Date Deposited: | 07 Feb 2011 12:06 |
| Last Modified: | 09 Aug 2023 12:30 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/1868 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
