To read this content please select one of the options below:

A fisheye image correction method based on deep learning

Shuli Gai (School of Computer and Information Engineering, University of Science and Technology Liaoning, Anshan, China and School of Automotive and Transportation Engineering, Shenzhen Polytechnic University, Shenzhen, China)
Wenhua Cui (School of Computer and Information Engineering, University of Science and Technology Liaoning, Anshan, China)
Bodong Liang (Shenzhen Polytechnic University, Shenzhen, China)

Robotic Intelligence and Automation

ISSN: 2754-6969

Article publication date: 28 November 2024

21

Abstract

Purpose

Fisheye camera is a wide-angle camera with a large field of view, which can obtain more information than conventional cameras, but its own disadvantage of large distortion can lead to shape distortion of objects in the captured image. To correct lens distortion, most scholars use manual calibration methods. The traditional manual calibration method relies on complex data computation and specialized mathematical knowledge, but the method is complex and not universal. Considering the nonlinear features of neural networks can be used to fit the nonlinear distortion of distorted images, this paper aims to correct the distortion of a fisheye image based on convolutional neural networks.

Design/methodology/approach

By generating fisheye distortion images using readily available cityscape road data sets, this paper designs an effective correction model by taking advantage of the fact that the relationship between the pixel coordinates is basically stable after uniform distortion. In our training process, the corresponding distortion is firstly synthesized using the original image, the loss function is constructed using the geometric means of the Hough transform, the whole model is then trained with the help of the loss of the linear slope, and finally the predicted parameters are used to correct the fisheye image, which realizes the overall end-to-end framework.

Findings

Experimental results show that the method proposed in this paper outperforms similar methods in terms of correction performance.

Originality/value

This paper proposed a fisheye distortion correction algorithm based on convolutional neural network, which uses distortion-free images based on a generalized fisheye imaging model and maps to generate a fisheye distortion picture data set. It also builds a loss function training model based on line reconstruction error loss of Hough transforms.

Keywords

Acknowledgements

The work described in this paper was partially supported by grants from Guangdong Basic and Applied Basic Research Foundation (No. 2020A1515111024, 2024A1515012610), Key Research Project of Department of Education of Guangdong (No. 2021ZDZX1140), Research Foundation of Shenzhen Polytechnic University (No. 6021310003K, 6023310004K, LHRC20220406, 6024310013K, 6024310019K, 7024310264), Post-doctoral Later-stage Foundation Project of Shenzhen Polytechnic (No. 6019271007K, 6023271002K), University-Industry Collaborative Education Program of Ministry of Education (No. 231006517230628) and Research project of Ministry of Education (No. ZSSZ202421).

Citation

Gai, S., Cui, W. and Liang, B. (2024), "A fisheye image correction method based on deep learning", Robotic Intelligence and Automation, Vol. ahead-of-print No. ahead-of-print. https://doi.org/10.1108/RIA-03-2024-0082

Publisher

:

Emerald Publishing Limited

Copyright © 2024, Emerald Publishing Limited

Related articles