All-digital histopathology by infrared-optical hybrid microscopy

Martin Schnell, Shachi Mittal, Kianoush Falahkheirkhah, Anirudh Mittal, Kevin Yeh, Seth Kenkel, Andre Kajdacsy-Balla, P. Scott Carney, Rohit Bhargava

Research output: Contribution to journalArticle

Abstract

Optical microscopy for biomedical samples requires expertise in staining to visualize structure and composition. Midinfrared (mid-IR) spectroscopic imaging offers label-free molecular recording and virtual staining by probing fundamental vibrational modes of molecular components. This quantitative signal can be combined with machine learning to enable microscopy in diverse fields from cancer diagnoses to forensics. However, absorption of IR light by common optical imaging components makes mid-IR light incompatible with modern optical microscopy and almost all biomedical research and clinical workflows. Here we conceptualize an IR-optical hybrid (IR-OH) approach that sensitively measures molecular composition based on an optical microscope with wide-field interferometric detection of absorption-induced sample expansion. We demonstrate that IR-OH exceeds state-of-the-art IR microscopy in coverage (10-fold), spatial resolution (fourfold), and spectral consistency (by mitigating the effects of scattering). The combined impact of these advances allows full slide infrared absorption images of unstained breast tissue sections on a visible microscope platform. We further show that automated histopathologic segmentation and generation of computationally stained (stainless) images is possible, resolving morphological features in both color and spatial detail comparable to current pathology protocols but without stains or human interpretation. IR-OH is compatible with clinical and research pathology practice and could make for a cost-effective alternative to conventional stain-based protocols for stainless, all-digital pathology.
Original languageEnglish (US)
Article number201912400
JournalProceedings of the National Academy of Sciences of the United States of America
DOIs
StatePublished - Feb 3 2020

Fingerprint

pathology
microscopy
staining
machine learning
optical microscopes
chutes
breast
infrared absorption
vibration mode
platforms
spatial resolution
cancer
recording
microscopes
costs
color
expansion
scattering

Keywords

  • infrared spectroscopy
  • imaging
  • quantum cascade laser
  • pathology
  • breast cancer

Cite this

All-digital histopathology by infrared-optical hybrid microscopy. / Schnell, Martin; Mittal, Shachi; Falahkheirkhah, Kianoush; Mittal, Anirudh; Yeh, Kevin; Kenkel, Seth; Kajdacsy-Balla, Andre; Carney, P. Scott; Bhargava, Rohit.

In: Proceedings of the National Academy of Sciences of the United States of America, 03.02.2020.

Research output: Contribution to journalArticle

Schnell, Martin ; Mittal, Shachi ; Falahkheirkhah, Kianoush ; Mittal, Anirudh ; Yeh, Kevin ; Kenkel, Seth ; Kajdacsy-Balla, Andre ; Carney, P. Scott ; Bhargava, Rohit. / All-digital histopathology by infrared-optical hybrid microscopy. In: Proceedings of the National Academy of Sciences of the United States of America. 2020.
@article{48d52db04f07423ab82e5e1cf456cbd2,
title = "All-digital histopathology by infrared-optical hybrid microscopy",
abstract = "Optical microscopy for biomedical samples requires expertise in staining to visualize structure and composition. Midinfrared (mid-IR) spectroscopic imaging offers label-free molecular recording and virtual staining by probing fundamental vibrational modes of molecular components. This quantitative signal can be combined with machine learning to enable microscopy in diverse fields from cancer diagnoses to forensics. However, absorption of IR light by common optical imaging components makes mid-IR light incompatible with modern optical microscopy and almost all biomedical research and clinical workflows. Here we conceptualize an IR-optical hybrid (IR-OH) approach that sensitively measures molecular composition based on an optical microscope with wide-field interferometric detection of absorption-induced sample expansion. We demonstrate that IR-OH exceeds state-of-the-art IR microscopy in coverage (10-fold), spatial resolution (fourfold), and spectral consistency (by mitigating the effects of scattering). The combined impact of these advances allows full slide infrared absorption images of unstained breast tissue sections on a visible microscope platform. We further show that automated histopathologic segmentation and generation of computationally stained (stainless) images is possible, resolving morphological features in both color and spatial detail comparable to current pathology protocols but without stains or human interpretation. IR-OH is compatible with clinical and research pathology practice and could make for a cost-effective alternative to conventional stain-based protocols for stainless, all-digital pathology.",
keywords = "infrared spectroscopy, imaging, quantum cascade laser, pathology, breast cancer",
author = "Martin Schnell and Shachi Mittal and Kianoush Falahkheirkhah and Anirudh Mittal and Kevin Yeh and Seth Kenkel and Andre Kajdacsy-Balla and Carney, {P. Scott} and Rohit Bhargava",
year = "2020",
month = "2",
day = "3",
doi = "10.1073/pnas.1912400117",
language = "English (US)",
journal = "Proceedings of the National Academy of Sciences of the United States of America",
issn = "0027-8424",

}

TY - JOUR

T1 - All-digital histopathology by infrared-optical hybrid microscopy

AU - Schnell, Martin

AU - Mittal, Shachi

AU - Falahkheirkhah, Kianoush

AU - Mittal, Anirudh

AU - Yeh, Kevin

AU - Kenkel, Seth

AU - Kajdacsy-Balla, Andre

AU - Carney, P. Scott

AU - Bhargava, Rohit

PY - 2020/2/3

Y1 - 2020/2/3

N2 - Optical microscopy for biomedical samples requires expertise in staining to visualize structure and composition. Midinfrared (mid-IR) spectroscopic imaging offers label-free molecular recording and virtual staining by probing fundamental vibrational modes of molecular components. This quantitative signal can be combined with machine learning to enable microscopy in diverse fields from cancer diagnoses to forensics. However, absorption of IR light by common optical imaging components makes mid-IR light incompatible with modern optical microscopy and almost all biomedical research and clinical workflows. Here we conceptualize an IR-optical hybrid (IR-OH) approach that sensitively measures molecular composition based on an optical microscope with wide-field interferometric detection of absorption-induced sample expansion. We demonstrate that IR-OH exceeds state-of-the-art IR microscopy in coverage (10-fold), spatial resolution (fourfold), and spectral consistency (by mitigating the effects of scattering). The combined impact of these advances allows full slide infrared absorption images of unstained breast tissue sections on a visible microscope platform. We further show that automated histopathologic segmentation and generation of computationally stained (stainless) images is possible, resolving morphological features in both color and spatial detail comparable to current pathology protocols but without stains or human interpretation. IR-OH is compatible with clinical and research pathology practice and could make for a cost-effective alternative to conventional stain-based protocols for stainless, all-digital pathology.

AB - Optical microscopy for biomedical samples requires expertise in staining to visualize structure and composition. Midinfrared (mid-IR) spectroscopic imaging offers label-free molecular recording and virtual staining by probing fundamental vibrational modes of molecular components. This quantitative signal can be combined with machine learning to enable microscopy in diverse fields from cancer diagnoses to forensics. However, absorption of IR light by common optical imaging components makes mid-IR light incompatible with modern optical microscopy and almost all biomedical research and clinical workflows. Here we conceptualize an IR-optical hybrid (IR-OH) approach that sensitively measures molecular composition based on an optical microscope with wide-field interferometric detection of absorption-induced sample expansion. We demonstrate that IR-OH exceeds state-of-the-art IR microscopy in coverage (10-fold), spatial resolution (fourfold), and spectral consistency (by mitigating the effects of scattering). The combined impact of these advances allows full slide infrared absorption images of unstained breast tissue sections on a visible microscope platform. We further show that automated histopathologic segmentation and generation of computationally stained (stainless) images is possible, resolving morphological features in both color and spatial detail comparable to current pathology protocols but without stains or human interpretation. IR-OH is compatible with clinical and research pathology practice and could make for a cost-effective alternative to conventional stain-based protocols for stainless, all-digital pathology.

KW - infrared spectroscopy

KW - imaging

KW - quantum cascade laser

KW - pathology

KW - breast cancer

U2 - 10.1073/pnas.1912400117

DO - 10.1073/pnas.1912400117

M3 - Article

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

SN - 0027-8424

M1 - 201912400

ER -