A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery

Steven Blair, Missael Garcia, Christian Konopka, Wawrzyniec Dobrucki, Viktor Gruev

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While fluorescence image-guided surgery offers improved treatment outcomes for patients with cancer by permitting the identification of tumors during resection, it has been plagued by slow translation into clinical practice due to the lengthy and costly approval process for fluorescent molecular markers. Label-free approaches to image-guided surgery provide an alternative by discriminating between cancerous and noncancerous tissue based on differences in spectral reflectance and autofluorescence between the tumor microenvironment and the surrounding anatomy. Unfortunately, state-of-the-art hyperspectral imaging systems capable of monitoring spectral differences across the entire surgical site utilize complex optomechanical architectures that contribute to low image resolutions, low frame rates, and co-registration error that cannot be calibrated, making these instruments impractical during demanding surgical workflows. To provide label-free surgical guidance while addressing limitations with existing systems, we have developed a single-chip snapshot hyperspectral imaging system that provides 27 spectral bands from ∼450 nm to ∼750 nm. By monolithically integrating a stacked photodiode image sensor with pixelated interference filters, we have produced a highly compact imaging system that achieves a resolution of 1252-by-852 pixels at a rate of 17.2 frames per second while avoiding co-registration error. The system provides a signal-to-noise ratio of ∼55 dB and a dynamic range of ∼62 dB, and it can enable spectral discrimination under standard broadband surgical light sources. Preclinical images of human prostate tumor implants in a murine model have been examined and presented to demonstrate that the imaging system can differentiate between cancerous and noncancerous tissue and can discriminate between distinct cancer types.

Original languageEnglish (US)
Title of host publicationLabel-Free Biomedical Imaging and Sensing, LBIS 2019
EditorsOliver Hayden, Natan T. Shaked
PublisherSPIE
ISBN (Electronic)9781510624221
DOIs
StatePublished - Jan 1 2019
EventLabel-Free Biomedical Imaging and Sensing 2019, LBIS 2019 - San Francisco, United States
Duration: Feb 2 2019Feb 5 2019

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume10890
ISSN (Print)1605-7422

Conference

ConferenceLabel-Free Biomedical Imaging and Sensing 2019, LBIS 2019
CountryUnited States
CitySan Francisco
Period2/2/192/5/19

Fingerprint

Computer-Assisted Surgery
surgery
Imaging systems
Surgery
Labels
Tumors
tumors
Neoplasms
cancer
Tissue
spectral reflectance
Tumor Microenvironment
Workflow
anatomy
image resolution
Signal-To-Noise Ratio
spectral bands
Image resolution
Photodiodes
Image sensors

Keywords

  • Image-guided surgery in cancer
  • Intraoperative imaging
  • Label-free imaging
  • Pixelated interference filters
  • Snapshot hyperspectral imaging
  • Stacked photodiode image sensor
  • Tumor detection and identification

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Cite this

Blair, S., Garcia, M., Konopka, C., Dobrucki, W., & Gruev, V. (2019). A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery. In O. Hayden, & N. T. Shaked (Eds.), Label-Free Biomedical Imaging and Sensing, LBIS 2019 [108900G] (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 10890). SPIE. https://doi.org/10.1117/12.2508944

A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery. / Blair, Steven; Garcia, Missael; Konopka, Christian; Dobrucki, Wawrzyniec; Gruev, Viktor.

Label-Free Biomedical Imaging and Sensing, LBIS 2019. ed. / Oliver Hayden; Natan T. Shaked. SPIE, 2019. 108900G (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 10890).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Blair, S, Garcia, M, Konopka, C, Dobrucki, W & Gruev, V 2019, A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery. in O Hayden & NT Shaked (eds), Label-Free Biomedical Imaging and Sensing, LBIS 2019., 108900G, Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 10890, SPIE, Label-Free Biomedical Imaging and Sensing 2019, LBIS 2019, San Francisco, United States, 2/2/19. https://doi.org/10.1117/12.2508944
Blair S, Garcia M, Konopka C, Dobrucki W, Gruev V. A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery. In Hayden O, Shaked NT, editors, Label-Free Biomedical Imaging and Sensing, LBIS 2019. SPIE. 2019. 108900G. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE). https://doi.org/10.1117/12.2508944
Blair, Steven ; Garcia, Missael ; Konopka, Christian ; Dobrucki, Wawrzyniec ; Gruev, Viktor. / A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery. Label-Free Biomedical Imaging and Sensing, LBIS 2019. editor / Oliver Hayden ; Natan T. Shaked. SPIE, 2019. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE).
@inproceedings{9b0dcc18ccfb4c108ac1e7be085713fd,
title = "A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery",
abstract = "While fluorescence image-guided surgery offers improved treatment outcomes for patients with cancer by permitting the identification of tumors during resection, it has been plagued by slow translation into clinical practice due to the lengthy and costly approval process for fluorescent molecular markers. Label-free approaches to image-guided surgery provide an alternative by discriminating between cancerous and noncancerous tissue based on differences in spectral reflectance and autofluorescence between the tumor microenvironment and the surrounding anatomy. Unfortunately, state-of-the-art hyperspectral imaging systems capable of monitoring spectral differences across the entire surgical site utilize complex optomechanical architectures that contribute to low image resolutions, low frame rates, and co-registration error that cannot be calibrated, making these instruments impractical during demanding surgical workflows. To provide label-free surgical guidance while addressing limitations with existing systems, we have developed a single-chip snapshot hyperspectral imaging system that provides 27 spectral bands from ∼450 nm to ∼750 nm. By monolithically integrating a stacked photodiode image sensor with pixelated interference filters, we have produced a highly compact imaging system that achieves a resolution of 1252-by-852 pixels at a rate of 17.2 frames per second while avoiding co-registration error. The system provides a signal-to-noise ratio of ∼55 dB and a dynamic range of ∼62 dB, and it can enable spectral discrimination under standard broadband surgical light sources. Preclinical images of human prostate tumor implants in a murine model have been examined and presented to demonstrate that the imaging system can differentiate between cancerous and noncancerous tissue and can discriminate between distinct cancer types.",
keywords = "Image-guided surgery in cancer, Intraoperative imaging, Label-free imaging, Pixelated interference filters, Snapshot hyperspectral imaging, Stacked photodiode image sensor, Tumor detection and identification",
author = "Steven Blair and Missael Garcia and Christian Konopka and Wawrzyniec Dobrucki and Viktor Gruev",
year = "2019",
month = "1",
day = "1",
doi = "10.1117/12.2508944",
language = "English (US)",
series = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",
publisher = "SPIE",
editor = "Oliver Hayden and Shaked, {Natan T.}",
booktitle = "Label-Free Biomedical Imaging and Sensing, LBIS 2019",

}

TY - GEN

T1 - A 27-band snapshot hyperspectral imaging system for label-free tumor detection during image-guided surgery

AU - Blair, Steven

AU - Garcia, Missael

AU - Konopka, Christian

AU - Dobrucki, Wawrzyniec

AU - Gruev, Viktor

PY - 2019/1/1

Y1 - 2019/1/1

N2 - While fluorescence image-guided surgery offers improved treatment outcomes for patients with cancer by permitting the identification of tumors during resection, it has been plagued by slow translation into clinical practice due to the lengthy and costly approval process for fluorescent molecular markers. Label-free approaches to image-guided surgery provide an alternative by discriminating between cancerous and noncancerous tissue based on differences in spectral reflectance and autofluorescence between the tumor microenvironment and the surrounding anatomy. Unfortunately, state-of-the-art hyperspectral imaging systems capable of monitoring spectral differences across the entire surgical site utilize complex optomechanical architectures that contribute to low image resolutions, low frame rates, and co-registration error that cannot be calibrated, making these instruments impractical during demanding surgical workflows. To provide label-free surgical guidance while addressing limitations with existing systems, we have developed a single-chip snapshot hyperspectral imaging system that provides 27 spectral bands from ∼450 nm to ∼750 nm. By monolithically integrating a stacked photodiode image sensor with pixelated interference filters, we have produced a highly compact imaging system that achieves a resolution of 1252-by-852 pixels at a rate of 17.2 frames per second while avoiding co-registration error. The system provides a signal-to-noise ratio of ∼55 dB and a dynamic range of ∼62 dB, and it can enable spectral discrimination under standard broadband surgical light sources. Preclinical images of human prostate tumor implants in a murine model have been examined and presented to demonstrate that the imaging system can differentiate between cancerous and noncancerous tissue and can discriminate between distinct cancer types.

AB - While fluorescence image-guided surgery offers improved treatment outcomes for patients with cancer by permitting the identification of tumors during resection, it has been plagued by slow translation into clinical practice due to the lengthy and costly approval process for fluorescent molecular markers. Label-free approaches to image-guided surgery provide an alternative by discriminating between cancerous and noncancerous tissue based on differences in spectral reflectance and autofluorescence between the tumor microenvironment and the surrounding anatomy. Unfortunately, state-of-the-art hyperspectral imaging systems capable of monitoring spectral differences across the entire surgical site utilize complex optomechanical architectures that contribute to low image resolutions, low frame rates, and co-registration error that cannot be calibrated, making these instruments impractical during demanding surgical workflows. To provide label-free surgical guidance while addressing limitations with existing systems, we have developed a single-chip snapshot hyperspectral imaging system that provides 27 spectral bands from ∼450 nm to ∼750 nm. By monolithically integrating a stacked photodiode image sensor with pixelated interference filters, we have produced a highly compact imaging system that achieves a resolution of 1252-by-852 pixels at a rate of 17.2 frames per second while avoiding co-registration error. The system provides a signal-to-noise ratio of ∼55 dB and a dynamic range of ∼62 dB, and it can enable spectral discrimination under standard broadband surgical light sources. Preclinical images of human prostate tumor implants in a murine model have been examined and presented to demonstrate that the imaging system can differentiate between cancerous and noncancerous tissue and can discriminate between distinct cancer types.

KW - Image-guided surgery in cancer

KW - Intraoperative imaging

KW - Label-free imaging

KW - Pixelated interference filters

KW - Snapshot hyperspectral imaging

KW - Stacked photodiode image sensor

KW - Tumor detection and identification

UR - http://www.scopus.com/inward/record.url?scp=85064855599&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064855599&partnerID=8YFLogxK

U2 - 10.1117/12.2508944

DO - 10.1117/12.2508944

M3 - Conference contribution

AN - SCOPUS:85064855599

T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

BT - Label-Free Biomedical Imaging and Sensing, LBIS 2019

A2 - Hayden, Oliver

A2 - Shaked, Natan T.

PB - SPIE

ER -