BIROn - Birkbeck Institutional Research Online

    An IR and visible image sequence automatic registration method based on optical flow

    Zhang, Y. and Zhang, X. and Maybank, Stephen J. and Yu, R. (2013) An IR and visible image sequence automatic registration method based on optical flow. Machine Vision and Applications 24 (5), pp. 947-958. ISSN 0932-8092.

    Full text not available from this repository.


    IR–visible camera registration is required for multi-sensor fusion and cooperative processing. Image sequences can provide motion information, which is useful for sequence registration. The existing methods mainly focus on registration using moving objects which are observed by both cameras. However, accurate motion feature extraction for a whole moving object is difficult, because of the complex environment and different imaging mechanism of two sensors. To overcome this problem, we use motion features associated with single pixels in the two image sequences to carry out automatic registration. A normalized optical flow time sequence for each image pixel is constructed. The matching of pixels between the IR image and the visible light image is carried out using a fast similarity measurement and a three stage correspondence selection method. Finally cascaded random sample consensus is adopted to remove outlying matches, and least-square method and Levenberg–Marquardt method are used to estimate the transformation from the IR image to the visible image. The effectiveness of our method is demonstrated using several real datasets and simulated datasets.


    Item Type: Article
    Keyword(s) / Subject(s): image sequences registration, visible image sequence, IR image sequence, optical flow
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences
    Depositing User: Sarah Hall
    Date Deposited: 25 Jul 2013 11:26
    Last Modified: 09 Aug 2023 12:33


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item