BIROn - Birkbeck Institutional Research Online

    Wide-angle image rectification: a survey

    Fan, J. and Zhang, J. and Maybank, Stephen and Tao, D. (2022) Wide-angle image rectification: a survey. International Journal of Computer Vision , ISSN 0920-5691. (In Press)

    [img] Text
    47481a.pdf - Author's Accepted Manuscript
    Restricted to Repository staff only until 31 January 2023.

    Download (10MB) | Request a copy


    Wide field-of-view (FOV) cameras, which capture a larger scene area than narrow FOV cameras, are used in many applications including 3D reconstruction, autonomous driving, and video surveillance. However, wide-angle images contain distortions that violate the assumptions underlying pinhole camera models, resulting in object distortion, difficulties in estimating scene distance, area, and direction, and preventing the use of off-the-shelf deep models trained on undistorted images for downstream computer vision tasks. Image rectification, which aims to correct these distortions, can solve these problems. In this paper we comprehensively survey progress in wide-angle image rectification from transformation models to rectification methods. Specifically, we first present a detailed description and discussion of the camera models used in different approaches. Then we summarize several distortion models including radial distortion and projection distortion. Next, we review both traditional geometry-based image rectification methods and deep learning based methods, where the former formulates disortion parameter estimation as an optimization problem and the latter treats it as a regression problem by leveraging the power of deep neural networks. We evaluate the performance of state-of-the-art methods on public databases and show that although both kinds of methods can achieve good results, these methods only work well for specific camera models and distortion types. We also provide a strong baseline model and carry out an empirical study of different distortion models on synthetic datasets and real-world wide-angle images. Finally, we discuss several potential research directons that are expected to further advance this area in the future.


    Item Type: Article
    School: School of Business, Economics & Informatics > Computer Science and Information Systems
    Depositing User: Steve Maybank
    Date Deposited: 09 Feb 2022 18:50
    Last Modified: 11 Feb 2022 07:06


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item