TY - JOUR
T1 - Fast Optical Signals for Real-Time Retinotopy and Brain Computer Interface
AU - Perpetuini, David
AU - Günal, Mehmet
AU - Chiou, Nicole
AU - Koyejo, Sanmi
AU - Mathewson, Kyle
AU - Low, Kathy A.
AU - Fabiani, Monica
AU - Gratton, Gabriele
AU - Chiarelli, Antonio Maria
N1 - Funding Information:
This research was funded by MindPortal, 2261 Market Street 4120, San Francisco, CA, 94114, USA.
Publisher Copyright:
© 2023 by the authors.
PY - 2023/5
Y1 - 2023/5
N2 - A brain–computer interface (BCI) allows users to control external devices through brain activity. Portable neuroimaging techniques, such as near-infrared (NIR) imaging, are suitable for this goal. NIR imaging has been used to measure rapid changes in brain optical properties associated with neuronal activation, namely fast optical signals (FOS) with good spatiotemporal resolution. However, FOS have a low signal-to-noise ratio, limiting their BCI application. Here FOS were acquired with a frequency-domain optical system from the visual cortex during visual stimulation consisting of a rotating checkerboard wedge, flickering at 5 Hz. We used measures of photon count (Direct Current, DC light intensity) and time of flight (phase) at two NIR wavelengths (690 nm and 830 nm) combined with a machine learning approach for fast estimation of visual-field quadrant stimulation. The input features of a cross-validated support vector machine classifier were computed as the average modulus of the wavelet coherence between each channel and the average response among all channels in 512 ms time windows. An above chance performance was obtained when differentiating visual stimulation quadrants (left vs. right or top vs. bottom) with the best classification accuracy of ~63% (information transfer rate of ~6 bits/min) when classifying the superior and inferior stimulation quadrants using DC at 830 nm. The method is the first attempt to provide generalizable retinotopy classification relying on FOS, paving the way for the use of FOS in real-time BCI.
AB - A brain–computer interface (BCI) allows users to control external devices through brain activity. Portable neuroimaging techniques, such as near-infrared (NIR) imaging, are suitable for this goal. NIR imaging has been used to measure rapid changes in brain optical properties associated with neuronal activation, namely fast optical signals (FOS) with good spatiotemporal resolution. However, FOS have a low signal-to-noise ratio, limiting their BCI application. Here FOS were acquired with a frequency-domain optical system from the visual cortex during visual stimulation consisting of a rotating checkerboard wedge, flickering at 5 Hz. We used measures of photon count (Direct Current, DC light intensity) and time of flight (phase) at two NIR wavelengths (690 nm and 830 nm) combined with a machine learning approach for fast estimation of visual-field quadrant stimulation. The input features of a cross-validated support vector machine classifier were computed as the average modulus of the wavelet coherence between each channel and the average response among all channels in 512 ms time windows. An above chance performance was obtained when differentiating visual stimulation quadrants (left vs. right or top vs. bottom) with the best classification accuracy of ~63% (information transfer rate of ~6 bits/min) when classifying the superior and inferior stimulation quadrants using DC at 830 nm. The method is the first attempt to provide generalizable retinotopy classification relying on FOS, paving the way for the use of FOS in real-time BCI.
KW - brain–computer interface (BCI)
KW - event-related optical signals (EROS)
KW - fast optical signals (FOS)
KW - machine learning (ML)
KW - retinotopy
UR - http://www.scopus.com/inward/record.url?scp=85160696585&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85160696585&partnerID=8YFLogxK
U2 - 10.3390/bioengineering10050553
DO - 10.3390/bioengineering10050553
M3 - Article
C2 - 37237623
SN - 2306-5354
VL - 10
JO - Bioengineering
JF - Bioengineering
IS - 5
M1 - 553
ER -