SCORE-IT: A Machine Learning Framework for Automatic Standardization of EEG Reports

Machine learning (ML)-based analysis of electroencephalograms (EEGs) is playing an important role in advancing neurological care. However, the difficulties in automatically extracting useful metadata from clinical records hinder the development of large-scale EEG-based ML models. EEG reports, which are the primary sources of metadata for EEG studies, suffer from lack of standardization. Here we propose a machine learning-based system that automatically extracts attributes detailed in the SCORE specification from unstructured, natural-language EEG reports. Specifically, our system, which jointly utilizes deep learning-and rule-based methods, identifies (1) the type of seizure observed in the recording, per physician impression; (2) whether the patient was diagnosed with epilepsy or not; (3) whether the EEG recording was normal or abnormal according to physician impression. We performed an evaluation of our system using the publicly available Temple University EEG corpus and report F1 scores of 0.93, 0.82, and 0.97 for the respective tasks.