Hexachromatic bioinspired camera for image-guided cancer surgery

Steven Blair, Missael Garcia, Tyler Davis, Zhongmin Zhu, Zuodong Liang, Christian Konopka, Kevin Kauffman, Risto Colanceski, Imran Ferati, Borislav Kondov, Sinisa Stojanoski, Magdalena Bogdanovska Todorovska, Natasha Toleska Dimitrovska, Nexhat Jakupi, Daniela Miladinova, Gordana Petrusevska, Goran Kondov, Wawrzyniec Lawrence Dobrucki, Shuming Nie, Viktor Gruev

Research output: Contribution to journalArticlepeer-review


Cancer affects one in three people worldwide. Surgery remains the primary curative option for localized cancers, but good prognoses require complete removal of primary tumors and timely recognition of metastases. To expand surgical capabilities and enhance patient outcomes, we developed a six-channel color/near-infrared image sensor inspired by the mantis shrimp visual system that enabled near-infrared fluorescence image guidance during surgery. The mantis shrimp’s unique eye, which maximizes the number of photons contributing to and the amount of information contained in each glimpse of its surroundings, is recapitulated in our single-chip imaging system that integrates arrays of vertically stacked silicon photodetectors and pixelated spectral filters. To provide information about tumor location unavailable from a single instrument, we tuned three color channels to permit an intuitive perspective of the surgical procedure and three near-infrared channels to permit multifunctional imaging of optical probes highlighting cancerous tissue. In nude athymic mice bearing human prostate tumors, our image sensor enabled simultaneous detection of two tumor-targeted fluorophores, distinguishing diseased from healthy tissue in an estimated 92% of cases. It also permitted extraction of near-infrared structured illumination enabling the mapping of the three-dimensional topography of tumors and surgical sites to within 1.2-mm error. In the operating room, during surgical resection in 18 patients with breast cancer, our image sensor further enabled sentinel lymph node mapping using clinically approved near-infrared fluorophores. The flexibility and performance afforded by this simple and compact architecture highlights the benefits of biologically inspired sensors in image-guided surgery.

Original languageEnglish (US)
Article numbereaaw7067
JournalScience Translational Medicine
Issue number592
StatePublished - May 5 2021

ASJC Scopus subject areas

  • Medicine(all)


Dive into the research topics of 'Hexachromatic bioinspired camera for image-guided cancer surgery'. Together they form a unique fingerprint.

Cite this