Non-frontal camera calibration using focal stack imagery

Avinash Kumar, Narendra Ahuja

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A non-frontal camera has its lens and sensor plane misaligned either due to manufacturing limitations or an intentional tilting as in tilt-shift cameras. Under ideal perspective imaging, a geometric calibration of tilt is impossible as tilt parameters are correlated with the principal point location parameter. In other words, there are infinite combinations of principal point and sensor tilt parameters such that the perspective imaging equations are satisfied equally well. Previously, the non-frontal calibration problem (including sensor tilt estimation) has been solved by introducing constraints to align the principal point with the center of radial distortion. In this paper, we propose an additional constraint which incorporates image blur/defocus present in non-frontal camera images into the calibration framework. Specifically, it has earlier been shown that a non-frontal camera rotating about its center of projection captures images with varying focus. This stack of images is referred to as a focal stack. Given a focal stack of a known checkerboard (CB) pattern captured from a non-frontal camera, we combine geometric re-projection error and image bur error computed from current estimate of sensor tilt as the calibration optimization criteria. We show that the combined technique outperforms geometry-only methods while also additionally yielding blur kernel estimates at CB corners.

Original languageEnglish (US)
Title of host publicationProceedings - International Conference on Pattern Recognition
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages202-207
Number of pages6
ISBN (Electronic)9781479952083
DOIs
StatePublished - Dec 4 2014
Event22nd International Conference on Pattern Recognition, ICPR 2014 - Stockholm, Sweden
Duration: Aug 24 2014Aug 28 2014

Publication series

NameProceedings - International Conference on Pattern Recognition
ISSN (Print)1051-4651

Other

Other22nd International Conference on Pattern Recognition, ICPR 2014
CountrySweden
CityStockholm
Period8/24/148/28/14

Fingerprint

Cameras
Calibration
Sensors
Imaging techniques
Lenses
Geometry

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Kumar, A., & Ahuja, N. (2014). Non-frontal camera calibration using focal stack imagery. In Proceedings - International Conference on Pattern Recognition (pp. 202-207). [6976755] (Proceedings - International Conference on Pattern Recognition). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICPR.2014.44

Non-frontal camera calibration using focal stack imagery. / Kumar, Avinash; Ahuja, Narendra.

Proceedings - International Conference on Pattern Recognition. Institute of Electrical and Electronics Engineers Inc., 2014. p. 202-207 6976755 (Proceedings - International Conference on Pattern Recognition).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kumar, A & Ahuja, N 2014, Non-frontal camera calibration using focal stack imagery. in Proceedings - International Conference on Pattern Recognition., 6976755, Proceedings - International Conference on Pattern Recognition, Institute of Electrical and Electronics Engineers Inc., pp. 202-207, 22nd International Conference on Pattern Recognition, ICPR 2014, Stockholm, Sweden, 8/24/14. https://doi.org/10.1109/ICPR.2014.44
Kumar A, Ahuja N. Non-frontal camera calibration using focal stack imagery. In Proceedings - International Conference on Pattern Recognition. Institute of Electrical and Electronics Engineers Inc. 2014. p. 202-207. 6976755. (Proceedings - International Conference on Pattern Recognition). https://doi.org/10.1109/ICPR.2014.44
Kumar, Avinash ; Ahuja, Narendra. / Non-frontal camera calibration using focal stack imagery. Proceedings - International Conference on Pattern Recognition. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 202-207 (Proceedings - International Conference on Pattern Recognition).
@inproceedings{4ed635e1d18b4a9c954453478678f82c,
title = "Non-frontal camera calibration using focal stack imagery",
abstract = "A non-frontal camera has its lens and sensor plane misaligned either due to manufacturing limitations or an intentional tilting as in tilt-shift cameras. Under ideal perspective imaging, a geometric calibration of tilt is impossible as tilt parameters are correlated with the principal point location parameter. In other words, there are infinite combinations of principal point and sensor tilt parameters such that the perspective imaging equations are satisfied equally well. Previously, the non-frontal calibration problem (including sensor tilt estimation) has been solved by introducing constraints to align the principal point with the center of radial distortion. In this paper, we propose an additional constraint which incorporates image blur/defocus present in non-frontal camera images into the calibration framework. Specifically, it has earlier been shown that a non-frontal camera rotating about its center of projection captures images with varying focus. This stack of images is referred to as a focal stack. Given a focal stack of a known checkerboard (CB) pattern captured from a non-frontal camera, we combine geometric re-projection error and image bur error computed from current estimate of sensor tilt as the calibration optimization criteria. We show that the combined technique outperforms geometry-only methods while also additionally yielding blur kernel estimates at CB corners.",
author = "Avinash Kumar and Narendra Ahuja",
year = "2014",
month = "12",
day = "4",
doi = "10.1109/ICPR.2014.44",
language = "English (US)",
series = "Proceedings - International Conference on Pattern Recognition",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "202--207",
booktitle = "Proceedings - International Conference on Pattern Recognition",
address = "United States",

}

TY - GEN

T1 - Non-frontal camera calibration using focal stack imagery

AU - Kumar, Avinash

AU - Ahuja, Narendra

PY - 2014/12/4

Y1 - 2014/12/4

N2 - A non-frontal camera has its lens and sensor plane misaligned either due to manufacturing limitations or an intentional tilting as in tilt-shift cameras. Under ideal perspective imaging, a geometric calibration of tilt is impossible as tilt parameters are correlated with the principal point location parameter. In other words, there are infinite combinations of principal point and sensor tilt parameters such that the perspective imaging equations are satisfied equally well. Previously, the non-frontal calibration problem (including sensor tilt estimation) has been solved by introducing constraints to align the principal point with the center of radial distortion. In this paper, we propose an additional constraint which incorporates image blur/defocus present in non-frontal camera images into the calibration framework. Specifically, it has earlier been shown that a non-frontal camera rotating about its center of projection captures images with varying focus. This stack of images is referred to as a focal stack. Given a focal stack of a known checkerboard (CB) pattern captured from a non-frontal camera, we combine geometric re-projection error and image bur error computed from current estimate of sensor tilt as the calibration optimization criteria. We show that the combined technique outperforms geometry-only methods while also additionally yielding blur kernel estimates at CB corners.

AB - A non-frontal camera has its lens and sensor plane misaligned either due to manufacturing limitations or an intentional tilting as in tilt-shift cameras. Under ideal perspective imaging, a geometric calibration of tilt is impossible as tilt parameters are correlated with the principal point location parameter. In other words, there are infinite combinations of principal point and sensor tilt parameters such that the perspective imaging equations are satisfied equally well. Previously, the non-frontal calibration problem (including sensor tilt estimation) has been solved by introducing constraints to align the principal point with the center of radial distortion. In this paper, we propose an additional constraint which incorporates image blur/defocus present in non-frontal camera images into the calibration framework. Specifically, it has earlier been shown that a non-frontal camera rotating about its center of projection captures images with varying focus. This stack of images is referred to as a focal stack. Given a focal stack of a known checkerboard (CB) pattern captured from a non-frontal camera, we combine geometric re-projection error and image bur error computed from current estimate of sensor tilt as the calibration optimization criteria. We show that the combined technique outperforms geometry-only methods while also additionally yielding blur kernel estimates at CB corners.

UR - http://www.scopus.com/inward/record.url?scp=84919919637&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84919919637&partnerID=8YFLogxK

U2 - 10.1109/ICPR.2014.44

DO - 10.1109/ICPR.2014.44

M3 - Conference contribution

AN - SCOPUS:84919919637

T3 - Proceedings - International Conference on Pattern Recognition

SP - 202

EP - 207

BT - Proceedings - International Conference on Pattern Recognition

PB - Institute of Electrical and Electronics Engineers Inc.

ER -