Breeding novel solutions in the brain

A model of Darwinian neurodynamics

András Szilágyi, István Zachar, Anna Fedor, Harold P. de Vladar, E. Szathmáry

Research output: Contribution to journalArticle

Abstract

Background: The fact that surplus connections and neurons are pruned during development is well established. We complement this selectionist picture by a proof-of-principle model of evolutionary search in the brain, that accounts for new variations in theory space. We present a model for Darwinian evolutionary search for candidate solutions in the brain. Methods: We combine known components of the brain - recurrent neural networks (acting as attractors), the action selection loop and implicit working memory - to provide the appropriate Darwinian architecture. We employ a population of attractor networks with palimpsest memory. The action selection loop is employed with winners-share-all dynamics to select for candidate solutions that are transiently stored in implicit working memory. Results: We document two processes: selection of stored solutions and evolutionary search for novel solutions. During the replication of candidate solutions attractor networks occasionally produce recombinant patterns, increasing variation on which selection can act. Combinatorial search acts on multiplying units (activity patterns) with hereditary variation and novel variants appear due to (i) noisy recall of patterns from the attractor networks, (ii) noise during transmission of candidate solutions as messages between networks, and, (iii) spontaneously generated, untrained patterns in spurious attractors. Conclusions: Attractor dynamics of recurrent neural networks can be used to model Darwinian search. The proposed architecture can be used for fast search among stored solutions (by selection) and for evolutionary search when novel candidate solutions are generated in successive iterations. Since all the suggested components are present in advanced nervous systems, we hypothesize that the brain could implement a truly evolutionary combinatorial search system, capable of generating novel variants.

Original languageEnglish
Article number2416
JournalF1000Research
Volume5
DOIs
Publication statusPublished - Jan 1 2017

Fingerprint

Breeding
Brain
Recurrent neural networks
Short-Term Memory
Data storage equipment
Neurology
Nervous System
Neurons
Noise
Population

Keywords

  • Attractor network
  • Autoassociative neural network
  • Darwinian dynamics
  • Evolutionary search
  • Learning
  • Neurodynamics
  • Problem solving

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Immunology and Microbiology(all)
  • Pharmacology, Toxicology and Pharmaceutics(all)

Cite this

Breeding novel solutions in the brain : A model of Darwinian neurodynamics. / Szilágyi, András; Zachar, István; Fedor, Anna; de Vladar, Harold P.; Szathmáry, E.

In: F1000Research, Vol. 5, 2416, 01.01.2017.

Research output: Contribution to journalArticle

Szilágyi, András ; Zachar, István ; Fedor, Anna ; de Vladar, Harold P. ; Szathmáry, E. / Breeding novel solutions in the brain : A model of Darwinian neurodynamics. In: F1000Research. 2017 ; Vol. 5.
@article{6c3f1bdc587e4f918a62cd4aa3f1813e,
title = "Breeding novel solutions in the brain: A model of Darwinian neurodynamics",
abstract = "Background: The fact that surplus connections and neurons are pruned during development is well established. We complement this selectionist picture by a proof-of-principle model of evolutionary search in the brain, that accounts for new variations in theory space. We present a model for Darwinian evolutionary search for candidate solutions in the brain. Methods: We combine known components of the brain - recurrent neural networks (acting as attractors), the action selection loop and implicit working memory - to provide the appropriate Darwinian architecture. We employ a population of attractor networks with palimpsest memory. The action selection loop is employed with winners-share-all dynamics to select for candidate solutions that are transiently stored in implicit working memory. Results: We document two processes: selection of stored solutions and evolutionary search for novel solutions. During the replication of candidate solutions attractor networks occasionally produce recombinant patterns, increasing variation on which selection can act. Combinatorial search acts on multiplying units (activity patterns) with hereditary variation and novel variants appear due to (i) noisy recall of patterns from the attractor networks, (ii) noise during transmission of candidate solutions as messages between networks, and, (iii) spontaneously generated, untrained patterns in spurious attractors. Conclusions: Attractor dynamics of recurrent neural networks can be used to model Darwinian search. The proposed architecture can be used for fast search among stored solutions (by selection) and for evolutionary search when novel candidate solutions are generated in successive iterations. Since all the suggested components are present in advanced nervous systems, we hypothesize that the brain could implement a truly evolutionary combinatorial search system, capable of generating novel variants.",
keywords = "Attractor network, Autoassociative neural network, Darwinian dynamics, Evolutionary search, Learning, Neurodynamics, Problem solving",
author = "Andr{\'a}s Szil{\'a}gyi and Istv{\'a}n Zachar and Anna Fedor and {de Vladar}, {Harold P.} and E. Szathm{\'a}ry",
year = "2017",
month = "1",
day = "1",
doi = "10.12688/f1000research.9630.2",
language = "English",
volume = "5",
journal = "F1000Research",
issn = "2046-1402",
publisher = "F1000 Research Ltd.",

}

TY - JOUR

T1 - Breeding novel solutions in the brain

T2 - A model of Darwinian neurodynamics

AU - Szilágyi, András

AU - Zachar, István

AU - Fedor, Anna

AU - de Vladar, Harold P.

AU - Szathmáry, E.

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Background: The fact that surplus connections and neurons are pruned during development is well established. We complement this selectionist picture by a proof-of-principle model of evolutionary search in the brain, that accounts for new variations in theory space. We present a model for Darwinian evolutionary search for candidate solutions in the brain. Methods: We combine known components of the brain - recurrent neural networks (acting as attractors), the action selection loop and implicit working memory - to provide the appropriate Darwinian architecture. We employ a population of attractor networks with palimpsest memory. The action selection loop is employed with winners-share-all dynamics to select for candidate solutions that are transiently stored in implicit working memory. Results: We document two processes: selection of stored solutions and evolutionary search for novel solutions. During the replication of candidate solutions attractor networks occasionally produce recombinant patterns, increasing variation on which selection can act. Combinatorial search acts on multiplying units (activity patterns) with hereditary variation and novel variants appear due to (i) noisy recall of patterns from the attractor networks, (ii) noise during transmission of candidate solutions as messages between networks, and, (iii) spontaneously generated, untrained patterns in spurious attractors. Conclusions: Attractor dynamics of recurrent neural networks can be used to model Darwinian search. The proposed architecture can be used for fast search among stored solutions (by selection) and for evolutionary search when novel candidate solutions are generated in successive iterations. Since all the suggested components are present in advanced nervous systems, we hypothesize that the brain could implement a truly evolutionary combinatorial search system, capable of generating novel variants.

AB - Background: The fact that surplus connections and neurons are pruned during development is well established. We complement this selectionist picture by a proof-of-principle model of evolutionary search in the brain, that accounts for new variations in theory space. We present a model for Darwinian evolutionary search for candidate solutions in the brain. Methods: We combine known components of the brain - recurrent neural networks (acting as attractors), the action selection loop and implicit working memory - to provide the appropriate Darwinian architecture. We employ a population of attractor networks with palimpsest memory. The action selection loop is employed with winners-share-all dynamics to select for candidate solutions that are transiently stored in implicit working memory. Results: We document two processes: selection of stored solutions and evolutionary search for novel solutions. During the replication of candidate solutions attractor networks occasionally produce recombinant patterns, increasing variation on which selection can act. Combinatorial search acts on multiplying units (activity patterns) with hereditary variation and novel variants appear due to (i) noisy recall of patterns from the attractor networks, (ii) noise during transmission of candidate solutions as messages between networks, and, (iii) spontaneously generated, untrained patterns in spurious attractors. Conclusions: Attractor dynamics of recurrent neural networks can be used to model Darwinian search. The proposed architecture can be used for fast search among stored solutions (by selection) and for evolutionary search when novel candidate solutions are generated in successive iterations. Since all the suggested components are present in advanced nervous systems, we hypothesize that the brain could implement a truly evolutionary combinatorial search system, capable of generating novel variants.

KW - Attractor network

KW - Autoassociative neural network

KW - Darwinian dynamics

KW - Evolutionary search

KW - Learning

KW - Neurodynamics

KW - Problem solving

UR - http://www.scopus.com/inward/record.url?scp=85024496912&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85024496912&partnerID=8YFLogxK

U2 - 10.12688/f1000research.9630.2

DO - 10.12688/f1000research.9630.2

M3 - Article

VL - 5

JO - F1000Research

JF - F1000Research

SN - 2046-1402

M1 - 2416

ER -