Nonlinear dynamical multi-scale model of associative memory

Alexander M. Duda, Stephen E Levinson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

How can we get such reliable behavior from the mind when the brain is made up of such unreliable elements as neurons? We propose that the answer is related to the emergence of stable brain states and we offer a model that illustrates how such states could arise. We discuss a new ab initio nonlinear dynamical multi-scale model that will serve as the foundation for an associative memory. Scale 0 consists of spiking Hodgkin-Huxley (HH) neurons. Scale 1 consists of components that are made up of large populations of HH neurons whose topological structure evolves according to a Hebbian-plasticity rule based on synchronous firing. The component's state is captured by the variance of phase synchrony for the population. Many such components are sparsely connected to form a large network, whose state can be captured by the n-tuple consisting of the individual states of each member component. Scale 2 takes the state of the overall network and upon examining the particular interrelationships of each component (determining how the state of one component affects the state of others) is able to generate a class of trajectories that is multistationary and stable periodic. Such a class we consider a memory; the encoding of many such memories leads to the creation of a robust associative memory. The details of the different scales are examined.

Original languageEnglish (US)
Title of host publicationProceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010
Pages867-872
Number of pages6
DOIs
StatePublished - Dec 1 2010
Event9th International Conference on Machine Learning and Applications, ICMLA 2010 - Washington, DC, United States
Duration: Dec 12 2010Dec 14 2010

Publication series

NameProceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010

Other

Other9th International Conference on Machine Learning and Applications, ICMLA 2010
CountryUnited States
CityWashington, DC
Period12/12/1012/14/10

Fingerprint

Neurons
Data storage equipment
Brain
Plasticity
Trajectories

Keywords

  • Associative memory
  • Attractors
  • Hodgkin-Huxley neurons
  • Machine learning
  • Multi-scale modeling
  • Nonlinear dynamics

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction

Cite this

Duda, A. M., & Levinson, S. E. (2010). Nonlinear dynamical multi-scale model of associative memory. In Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010 (pp. 867-872). [5708958] (Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010). https://doi.org/10.1109/ICMLA.2010.135

Nonlinear dynamical multi-scale model of associative memory. / Duda, Alexander M.; Levinson, Stephen E.

Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010. 2010. p. 867-872 5708958 (Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Duda, AM & Levinson, SE 2010, Nonlinear dynamical multi-scale model of associative memory. in Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010., 5708958, Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010, pp. 867-872, 9th International Conference on Machine Learning and Applications, ICMLA 2010, Washington, DC, United States, 12/12/10. https://doi.org/10.1109/ICMLA.2010.135
Duda AM, Levinson SE. Nonlinear dynamical multi-scale model of associative memory. In Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010. 2010. p. 867-872. 5708958. (Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010). https://doi.org/10.1109/ICMLA.2010.135
Duda, Alexander M. ; Levinson, Stephen E. / Nonlinear dynamical multi-scale model of associative memory. Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010. 2010. pp. 867-872 (Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010).
@inproceedings{0461a3ba52ef4fb89426d42329f775bd,
title = "Nonlinear dynamical multi-scale model of associative memory",
abstract = "How can we get such reliable behavior from the mind when the brain is made up of such unreliable elements as neurons? We propose that the answer is related to the emergence of stable brain states and we offer a model that illustrates how such states could arise. We discuss a new ab initio nonlinear dynamical multi-scale model that will serve as the foundation for an associative memory. Scale 0 consists of spiking Hodgkin-Huxley (HH) neurons. Scale 1 consists of components that are made up of large populations of HH neurons whose topological structure evolves according to a Hebbian-plasticity rule based on synchronous firing. The component's state is captured by the variance of phase synchrony for the population. Many such components are sparsely connected to form a large network, whose state can be captured by the n-tuple consisting of the individual states of each member component. Scale 2 takes the state of the overall network and upon examining the particular interrelationships of each component (determining how the state of one component affects the state of others) is able to generate a class of trajectories that is multistationary and stable periodic. Such a class we consider a memory; the encoding of many such memories leads to the creation of a robust associative memory. The details of the different scales are examined.",
keywords = "Associative memory, Attractors, Hodgkin-Huxley neurons, Machine learning, Multi-scale modeling, Nonlinear dynamics",
author = "Duda, {Alexander M.} and Levinson, {Stephen E}",
year = "2010",
month = "12",
day = "1",
doi = "10.1109/ICMLA.2010.135",
language = "English (US)",
isbn = "9780769543000",
series = "Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010",
pages = "867--872",
booktitle = "Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010",

}

TY - GEN

T1 - Nonlinear dynamical multi-scale model of associative memory

AU - Duda, Alexander M.

AU - Levinson, Stephen E

PY - 2010/12/1

Y1 - 2010/12/1

N2 - How can we get such reliable behavior from the mind when the brain is made up of such unreliable elements as neurons? We propose that the answer is related to the emergence of stable brain states and we offer a model that illustrates how such states could arise. We discuss a new ab initio nonlinear dynamical multi-scale model that will serve as the foundation for an associative memory. Scale 0 consists of spiking Hodgkin-Huxley (HH) neurons. Scale 1 consists of components that are made up of large populations of HH neurons whose topological structure evolves according to a Hebbian-plasticity rule based on synchronous firing. The component's state is captured by the variance of phase synchrony for the population. Many such components are sparsely connected to form a large network, whose state can be captured by the n-tuple consisting of the individual states of each member component. Scale 2 takes the state of the overall network and upon examining the particular interrelationships of each component (determining how the state of one component affects the state of others) is able to generate a class of trajectories that is multistationary and stable periodic. Such a class we consider a memory; the encoding of many such memories leads to the creation of a robust associative memory. The details of the different scales are examined.

AB - How can we get such reliable behavior from the mind when the brain is made up of such unreliable elements as neurons? We propose that the answer is related to the emergence of stable brain states and we offer a model that illustrates how such states could arise. We discuss a new ab initio nonlinear dynamical multi-scale model that will serve as the foundation for an associative memory. Scale 0 consists of spiking Hodgkin-Huxley (HH) neurons. Scale 1 consists of components that are made up of large populations of HH neurons whose topological structure evolves according to a Hebbian-plasticity rule based on synchronous firing. The component's state is captured by the variance of phase synchrony for the population. Many such components are sparsely connected to form a large network, whose state can be captured by the n-tuple consisting of the individual states of each member component. Scale 2 takes the state of the overall network and upon examining the particular interrelationships of each component (determining how the state of one component affects the state of others) is able to generate a class of trajectories that is multistationary and stable periodic. Such a class we consider a memory; the encoding of many such memories leads to the creation of a robust associative memory. The details of the different scales are examined.

KW - Associative memory

KW - Attractors

KW - Hodgkin-Huxley neurons

KW - Machine learning

KW - Multi-scale modeling

KW - Nonlinear dynamics

UR - http://www.scopus.com/inward/record.url?scp=79952381420&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952381420&partnerID=8YFLogxK

U2 - 10.1109/ICMLA.2010.135

DO - 10.1109/ICMLA.2010.135

M3 - Conference contribution

AN - SCOPUS:79952381420

SN - 9780769543000

T3 - Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010

SP - 867

EP - 872

BT - Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010

ER -