Nonlinear reconfiguration of network edges, topology and information content during an artificial learning task

James M. Shine, Mike Li, Oluwasanmi Koyejo, Ben Fulcher, Joseph T. Lizier

Research output: Contribution to journalArticlepeer-review

Abstract

Here, we combine network neuroscience and machine learning to reveal connections between the brain’s network structure and the emerging network structure of an artificial neural network. Specifically, we train a shallow, feedforward neural network to classify hand-written digits and then used a combination of systems neuroscience and information-theoretic tools to perform ‘virtual brain analytics’ on the resultant edge weights and activity patterns of each node. We identify three distinct phases of network reconfiguration across learning, each of which are characterized by unique topological and information-theoretic signatures. Each phase involves aligning the connections of the neural network with patterns of information contained in the input dataset or preceding layers (as relevant). We also observe a process of low-dimensional category separation in the network as a function of learning. Our results offer a systems-level perspective of how artificial neural networks function—in terms of multi-stage reorganization of edge weights and activity patterns to effectively exploit the information content of input data during edge-weight training—while simultaneously enriching our understanding of the methods used by systems neuroscience.

Original languageEnglish (US)
Article number26
JournalBrain Informatics
Volume8
Issue number1
DOIs
StatePublished - Dec 2021

Keywords

  • Information
  • Integration
  • Low-dimensional
  • Network
  • Pixels
  • Reconfiguration
  • Systems

ASJC Scopus subject areas

  • Neurology
  • Computer Science Applications
  • Cognitive Neuroscience

Fingerprint

Dive into the research topics of 'Nonlinear reconfiguration of network edges, topology and information content during an artificial learning task'. Together they form a unique fingerprint.

Cite this