Zhang, Y. and Zhang, X. and Maybank, Stephen J. and Yu, R. (2013) An IR and visible image sequence automatic registration method based on optical flow. Machine Vision and Applications 24 (5), pp. 947-958. ISSN 0932-8092.
Abstract
IR–visible camera registration is required for multi-sensor fusion and cooperative processing. Image sequences can provide motion information, which is useful for sequence registration. The existing methods mainly focus on registration using moving objects which are observed by both cameras. However, accurate motion feature extraction for a whole moving object is difficult, because of the complex environment and different imaging mechanism of two sensors. To overcome this problem, we use motion features associated with single pixels in the two image sequences to carry out automatic registration. A normalized optical flow time sequence for each image pixel is constructed. The matching of pixels between the IR image and the visible light image is carried out using a fast similarity measurement and a three stage correspondence selection method. Finally cascaded random sample consensus is adopted to remove outlying matches, and least-square method and Levenberg–Marquardt method are used to estimate the transformation from the IR image to the visible image. The effectiveness of our method is demonstrated using several real datasets and simulated datasets.
Metadata
| Item Type: | Article |
|---|---|
| Keyword(s) / Subject(s): | image sequences registration, visible image sequence, IR image sequence, optical flow |
| School: | Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences |
| Depositing User: | Sarah Hall |
| Date Deposited: | 25 Jul 2013 11:26 |
| Last Modified: | 09 Aug 2023 12:33 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/7779 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
