Generalized pupil-centric imaging and analytical calibration for a non-frontal camera

Avinash Kumar, Narendra Ahuja

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We consider the problem of calibrating a small field of view central perspective non-frontal camera whose lens and sensor planes may not be parallel to each other. This can be due to manufacturing defects or intentional tilting. Thus, as such all cameras can be modeled as being non-frontal with varying degrees. There are two approaches to model non- frontal cameras. The first one based on rotation parameter- ization of sensor non-frontalness/tilt increases the number of calibration parameters, thus requiring heuristics to ini- tialize a few calibration parameters for the final non-linear optimization step. Additionally, for this parameterization, while it has been shown that pupil-centric imaging model leads to more accurate rotation estimates than a thin-lens imaging model, it has only been developed for a single axis lens-sensor tilt. But, in real cameras we can have arbitrary tilt. The second approach based on decentering distortion modeling is approximate as it can only handle small tilts and cannot explicitly estimate the sensor tilt. In this paper, we focus on rotation based non-frontal camera calibration and address the aforementioned prob- lems of over-parameterization and inadequacy of existing pupil-centric imaging model. We first derive a generalized pupil-centric imaging model for arbitrary axis lens-sensor tilt. We then derive an analytical solution, in this setting, for a subset of calibration parameters including sensor rotation angles as a function of center of radial distortion (CoD). A radial alignment based constraint is then proposed to com- putationally estimate CoD leveraging on the proposed an- alytical solution. Our analytical technique also estimates pupil-centric parameters of entrance pupil location and op- tical focal length, which have typically been done opti- cally. Given these analytical and computational calibration parameter estimates, we initialize the non-linear calibra- tion optimization for a set of synthetic and real data cap- tured from a non-frontal camera and show reduced pixel re-projection and undistortion errors compared to state of the art techniques in rotation and decentering based ap- proaches to non-frontal camera calibration.

Original languageEnglish (US)
Title of host publicationProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
PublisherIEEE Computer Society
Pages3970-3977
Number of pages8
ISBN (Electronic)9781479951178, 9781479951178
DOIs
StatePublished - Sep 24 2014
Event27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014 - Columbus, United States
Duration: Jun 23 2014Jun 28 2014

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
ISSN (Print)1063-6919

Other

Other27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014
CountryUnited States
CityColumbus
Period6/23/146/28/14

Fingerprint

Cameras
Calibration
Imaging techniques
Sensors
Parameterization
Lenses
Camera lenses
Pixels
Defects

Keywords

  • analytical
  • calibration
  • center of radial distortion
  • pupil-centric

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Kumar, A., & Ahuja, N. (2014). Generalized pupil-centric imaging and analytical calibration for a non-frontal camera. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 3970-3977). [6909902] (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition). IEEE Computer Society. https://doi.org/10.1109/CVPR.2014.507

Generalized pupil-centric imaging and analytical calibration for a non-frontal camera. / Kumar, Avinash; Ahuja, Narendra.

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, 2014. p. 3970-3977 6909902 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kumar, A & Ahuja, N 2014, Generalized pupil-centric imaging and analytical calibration for a non-frontal camera. in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition., 6909902, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, pp. 3970-3977, 27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, Columbus, United States, 6/23/14. https://doi.org/10.1109/CVPR.2014.507
Kumar A, Ahuja N. Generalized pupil-centric imaging and analytical calibration for a non-frontal camera. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society. 2014. p. 3970-3977. 6909902. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition). https://doi.org/10.1109/CVPR.2014.507
Kumar, Avinash ; Ahuja, Narendra. / Generalized pupil-centric imaging and analytical calibration for a non-frontal camera. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, 2014. pp. 3970-3977 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).
@inproceedings{63e4b23249914402ba9ce897d7615a2e,
title = "Generalized pupil-centric imaging and analytical calibration for a non-frontal camera",
abstract = "We consider the problem of calibrating a small field of view central perspective non-frontal camera whose lens and sensor planes may not be parallel to each other. This can be due to manufacturing defects or intentional tilting. Thus, as such all cameras can be modeled as being non-frontal with varying degrees. There are two approaches to model non- frontal cameras. The first one based on rotation parameter- ization of sensor non-frontalness/tilt increases the number of calibration parameters, thus requiring heuristics to ini- tialize a few calibration parameters for the final non-linear optimization step. Additionally, for this parameterization, while it has been shown that pupil-centric imaging model leads to more accurate rotation estimates than a thin-lens imaging model, it has only been developed for a single axis lens-sensor tilt. But, in real cameras we can have arbitrary tilt. The second approach based on decentering distortion modeling is approximate as it can only handle small tilts and cannot explicitly estimate the sensor tilt. In this paper, we focus on rotation based non-frontal camera calibration and address the aforementioned prob- lems of over-parameterization and inadequacy of existing pupil-centric imaging model. We first derive a generalized pupil-centric imaging model for arbitrary axis lens-sensor tilt. We then derive an analytical solution, in this setting, for a subset of calibration parameters including sensor rotation angles as a function of center of radial distortion (CoD). A radial alignment based constraint is then proposed to com- putationally estimate CoD leveraging on the proposed an- alytical solution. Our analytical technique also estimates pupil-centric parameters of entrance pupil location and op- tical focal length, which have typically been done opti- cally. Given these analytical and computational calibration parameter estimates, we initialize the non-linear calibra- tion optimization for a set of synthetic and real data cap- tured from a non-frontal camera and show reduced pixel re-projection and undistortion errors compared to state of the art techniques in rotation and decentering based ap- proaches to non-frontal camera calibration.",
keywords = "analytical, calibration, center of radial distortion, pupil-centric",
author = "Avinash Kumar and Narendra Ahuja",
year = "2014",
month = "9",
day = "24",
doi = "10.1109/CVPR.2014.507",
language = "English (US)",
series = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",
publisher = "IEEE Computer Society",
pages = "3970--3977",
booktitle = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",

}

TY - GEN

T1 - Generalized pupil-centric imaging and analytical calibration for a non-frontal camera

AU - Kumar, Avinash

AU - Ahuja, Narendra

PY - 2014/9/24

Y1 - 2014/9/24

N2 - We consider the problem of calibrating a small field of view central perspective non-frontal camera whose lens and sensor planes may not be parallel to each other. This can be due to manufacturing defects or intentional tilting. Thus, as such all cameras can be modeled as being non-frontal with varying degrees. There are two approaches to model non- frontal cameras. The first one based on rotation parameter- ization of sensor non-frontalness/tilt increases the number of calibration parameters, thus requiring heuristics to ini- tialize a few calibration parameters for the final non-linear optimization step. Additionally, for this parameterization, while it has been shown that pupil-centric imaging model leads to more accurate rotation estimates than a thin-lens imaging model, it has only been developed for a single axis lens-sensor tilt. But, in real cameras we can have arbitrary tilt. The second approach based on decentering distortion modeling is approximate as it can only handle small tilts and cannot explicitly estimate the sensor tilt. In this paper, we focus on rotation based non-frontal camera calibration and address the aforementioned prob- lems of over-parameterization and inadequacy of existing pupil-centric imaging model. We first derive a generalized pupil-centric imaging model for arbitrary axis lens-sensor tilt. We then derive an analytical solution, in this setting, for a subset of calibration parameters including sensor rotation angles as a function of center of radial distortion (CoD). A radial alignment based constraint is then proposed to com- putationally estimate CoD leveraging on the proposed an- alytical solution. Our analytical technique also estimates pupil-centric parameters of entrance pupil location and op- tical focal length, which have typically been done opti- cally. Given these analytical and computational calibration parameter estimates, we initialize the non-linear calibra- tion optimization for a set of synthetic and real data cap- tured from a non-frontal camera and show reduced pixel re-projection and undistortion errors compared to state of the art techniques in rotation and decentering based ap- proaches to non-frontal camera calibration.

AB - We consider the problem of calibrating a small field of view central perspective non-frontal camera whose lens and sensor planes may not be parallel to each other. This can be due to manufacturing defects or intentional tilting. Thus, as such all cameras can be modeled as being non-frontal with varying degrees. There are two approaches to model non- frontal cameras. The first one based on rotation parameter- ization of sensor non-frontalness/tilt increases the number of calibration parameters, thus requiring heuristics to ini- tialize a few calibration parameters for the final non-linear optimization step. Additionally, for this parameterization, while it has been shown that pupil-centric imaging model leads to more accurate rotation estimates than a thin-lens imaging model, it has only been developed for a single axis lens-sensor tilt. But, in real cameras we can have arbitrary tilt. The second approach based on decentering distortion modeling is approximate as it can only handle small tilts and cannot explicitly estimate the sensor tilt. In this paper, we focus on rotation based non-frontal camera calibration and address the aforementioned prob- lems of over-parameterization and inadequacy of existing pupil-centric imaging model. We first derive a generalized pupil-centric imaging model for arbitrary axis lens-sensor tilt. We then derive an analytical solution, in this setting, for a subset of calibration parameters including sensor rotation angles as a function of center of radial distortion (CoD). A radial alignment based constraint is then proposed to com- putationally estimate CoD leveraging on the proposed an- alytical solution. Our analytical technique also estimates pupil-centric parameters of entrance pupil location and op- tical focal length, which have typically been done opti- cally. Given these analytical and computational calibration parameter estimates, we initialize the non-linear calibra- tion optimization for a set of synthetic and real data cap- tured from a non-frontal camera and show reduced pixel re-projection and undistortion errors compared to state of the art techniques in rotation and decentering based ap- proaches to non-frontal camera calibration.

KW - analytical

KW - calibration

KW - center of radial distortion

KW - pupil-centric

UR - http://www.scopus.com/inward/record.url?scp=84911391436&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84911391436&partnerID=8YFLogxK

U2 - 10.1109/CVPR.2014.507

DO - 10.1109/CVPR.2014.507

M3 - Conference contribution

AN - SCOPUS:84911391436

T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

SP - 3970

EP - 3977

BT - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

PB - IEEE Computer Society

ER -