A hemispherical imaging camera

Chunyu Gao, Hong Hua, Narendra Ahuja

Research output: Contribution to journalArticle

Abstract

Most of the existing panoramic cameras have cylindrical field of view (FOV) which has a 360° width in azimuth, but a limited height in elevation. However, a hemispherical (or near spherical) FOV is highly desirable in many applications such as robot navigation and surveillance. This paper presents a planar-mirror-based panoramic camera (HEM) which is capable of acquiring nearly hemispherical FOV panoramic images at high and substantially uniform resolution, from a single viewpoint, at video rates. The camera consists of multiple imaging sensors and a hexagonal prism made of planar mirror faces. The sensors are positioned in such a way that they image different parts of the scene from the same virtual viewpoint, either directly or after reflections off the prism. A panoramic image is constructed by concatenating the images taken by different sensors. The proposed system is designed such that the resolution across entire FOV has the same level of uniformity as delivered by a conventional, non-panoramic camera over a small FOV, and the sensor area utilization is maximized. We also present a novel camera placement technique that helps co-locate the optic points of all seven sensors at a single viewpoint, and a method to compensate for artifacts near mirror boundaries caused by finite size of lens aperture. An implementation of the proposed system as well as resulting hemispherical panoramic images are included.

Original languageEnglish (US)
Pages (from-to)168-178
Number of pages11
JournalComputer Vision and Image Understanding
Volume114
Issue number2
DOIs
StatePublished - Feb 1 2010

Fingerprint

Cameras
Imaging techniques
Sensors
Mirrors
Prisms
Lenses
Optics
Navigation
Robots

Keywords

  • Catadioptric camera
  • Image mosaicing
  • Omni-directional vision
  • Panoramic vision
  • Single viewpoint imaging system

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition

Cite this

A hemispherical imaging camera. / Gao, Chunyu; Hua, Hong; Ahuja, Narendra.

In: Computer Vision and Image Understanding, Vol. 114, No. 2, 01.02.2010, p. 168-178.

Research output: Contribution to journalArticle

Gao, Chunyu ; Hua, Hong ; Ahuja, Narendra. / A hemispherical imaging camera. In: Computer Vision and Image Understanding. 2010 ; Vol. 114, No. 2. pp. 168-178.
@article{a2d0cb1be6cd499f9a59da753ca45894,
title = "A hemispherical imaging camera",
abstract = "Most of the existing panoramic cameras have cylindrical field of view (FOV) which has a 360° width in azimuth, but a limited height in elevation. However, a hemispherical (or near spherical) FOV is highly desirable in many applications such as robot navigation and surveillance. This paper presents a planar-mirror-based panoramic camera (HEM) which is capable of acquiring nearly hemispherical FOV panoramic images at high and substantially uniform resolution, from a single viewpoint, at video rates. The camera consists of multiple imaging sensors and a hexagonal prism made of planar mirror faces. The sensors are positioned in such a way that they image different parts of the scene from the same virtual viewpoint, either directly or after reflections off the prism. A panoramic image is constructed by concatenating the images taken by different sensors. The proposed system is designed such that the resolution across entire FOV has the same level of uniformity as delivered by a conventional, non-panoramic camera over a small FOV, and the sensor area utilization is maximized. We also present a novel camera placement technique that helps co-locate the optic points of all seven sensors at a single viewpoint, and a method to compensate for artifacts near mirror boundaries caused by finite size of lens aperture. An implementation of the proposed system as well as resulting hemispherical panoramic images are included.",
keywords = "Catadioptric camera, Image mosaicing, Omni-directional vision, Panoramic vision, Single viewpoint imaging system",
author = "Chunyu Gao and Hong Hua and Narendra Ahuja",
year = "2010",
month = "2",
day = "1",
doi = "10.1016/j.cviu.2009.03.005",
language = "English (US)",
volume = "114",
pages = "168--178",
journal = "Computer Vision and Image Understanding",
issn = "1077-3142",
publisher = "Academic Press Inc.",
number = "2",

}

TY - JOUR

T1 - A hemispherical imaging camera

AU - Gao, Chunyu

AU - Hua, Hong

AU - Ahuja, Narendra

PY - 2010/2/1

Y1 - 2010/2/1

N2 - Most of the existing panoramic cameras have cylindrical field of view (FOV) which has a 360° width in azimuth, but a limited height in elevation. However, a hemispherical (or near spherical) FOV is highly desirable in many applications such as robot navigation and surveillance. This paper presents a planar-mirror-based panoramic camera (HEM) which is capable of acquiring nearly hemispherical FOV panoramic images at high and substantially uniform resolution, from a single viewpoint, at video rates. The camera consists of multiple imaging sensors and a hexagonal prism made of planar mirror faces. The sensors are positioned in such a way that they image different parts of the scene from the same virtual viewpoint, either directly or after reflections off the prism. A panoramic image is constructed by concatenating the images taken by different sensors. The proposed system is designed such that the resolution across entire FOV has the same level of uniformity as delivered by a conventional, non-panoramic camera over a small FOV, and the sensor area utilization is maximized. We also present a novel camera placement technique that helps co-locate the optic points of all seven sensors at a single viewpoint, and a method to compensate for artifacts near mirror boundaries caused by finite size of lens aperture. An implementation of the proposed system as well as resulting hemispherical panoramic images are included.

AB - Most of the existing panoramic cameras have cylindrical field of view (FOV) which has a 360° width in azimuth, but a limited height in elevation. However, a hemispherical (or near spherical) FOV is highly desirable in many applications such as robot navigation and surveillance. This paper presents a planar-mirror-based panoramic camera (HEM) which is capable of acquiring nearly hemispherical FOV panoramic images at high and substantially uniform resolution, from a single viewpoint, at video rates. The camera consists of multiple imaging sensors and a hexagonal prism made of planar mirror faces. The sensors are positioned in such a way that they image different parts of the scene from the same virtual viewpoint, either directly or after reflections off the prism. A panoramic image is constructed by concatenating the images taken by different sensors. The proposed system is designed such that the resolution across entire FOV has the same level of uniformity as delivered by a conventional, non-panoramic camera over a small FOV, and the sensor area utilization is maximized. We also present a novel camera placement technique that helps co-locate the optic points of all seven sensors at a single viewpoint, and a method to compensate for artifacts near mirror boundaries caused by finite size of lens aperture. An implementation of the proposed system as well as resulting hemispherical panoramic images are included.

KW - Catadioptric camera

KW - Image mosaicing

KW - Omni-directional vision

KW - Panoramic vision

KW - Single viewpoint imaging system

UR - http://www.scopus.com/inward/record.url?scp=74449085064&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=74449085064&partnerID=8YFLogxK

U2 - 10.1016/j.cviu.2009.03.005

DO - 10.1016/j.cviu.2009.03.005

M3 - Article

AN - SCOPUS:74449085064

VL - 114

SP - 168

EP - 178

JO - Computer Vision and Image Understanding

JF - Computer Vision and Image Understanding

SN - 1077-3142

IS - 2

ER -