Epstein Secrets

0,000 neurons each. Once one has committed oneself to looking at such groups, the next step is to ask how these groups are organized, which leads to Edelman's concept of "maps." A "map," in Edelman's terminology, is a connected set of groups with the property that when one of the inter-group connection

to Hebbian learning between assemblies has been pursued by Nobelist Gerald Edelman in his theory of neuronal group selection, or "Neural Darwinism." Edelman won a Nobel Prize for his work in immunology, which, like most modern immunology, was based on C. MacFarlane Burnet's theory of "clonal selection"

arding the representation of knowledge using attractor neural nets. It is a mix of well-established fact with more speculative material. 13.4.1 The Hopfield neural net model Hopfield networks Iliop821 are attractor neural networks often used as associative memories. A Hopfield network with N neurons can

tation of glocal memory in attractor neural net systems • Chapter 23 presents Glocal Economic Attention Networks (ECANs), rough analogues of glocal Hopfield nets that play a central role in CogPrime. Our hypothesis of the potential general importance of glocality as a property of memory, systems (beyond

moved without significantly impacting the net- work's capacity or dynamics. Our experimental work uses sparse Hopfield networks. 13.4.1.1 Palimpsest Hopfield nets with a modified learning rule In JSV99J a new learning rule is presented, which both increases the Hopfield network capacity and turns it into

50,000 neurons each. Once one has committed oneself to looking at such groups, the next step is to ask how these groups are organized, which leads to Edelman’s concept of “maps.” A “map,” in Edelman’s terminology, is a connected set of groups with the property that when one of the inter-group connections

similar transient assemblies when highly activated. The importance of repeated, slightly varied copies of the same subnetwork has been emphasized by Edelman [Ede93] among other neural theorists. 1 The larger an ensemble is, she suggests, the more vivid it is as a conscious experience; an hypothesis that

garding the representation of knowledge using attractor neural nets. It is a mix of well-established fact with more speculative material. 13.4.1 The Hopfield neural net model Hopfield networks [Hop82] are attractor neural networks often used as associative memories. A Hopfield network with N neurons can b

ntation of glocal memory in attractor neural net systems e Chapter 23 presents Glocal Economic Attention Networks (ECANs), rough analogues of glocal Hopfield nets that play a central role in CogPrime. Our hypothesis of the potential general importance of glocality as a property of memory systems (beyond j

moved without significantly impacting the net- work’s capacity or dynamics. Our experimental work uses sparse Hopfield networks. 13.4.1.1 Palimpsest Hopfield nets with a modified learning rule In [SV99] a new learning rule is presented, which both increases the Hopfield network capacity and turns it into

r-level behaviors like reasoning or subgoaling. • NOMAD (Neurally Organized Mobile Adaptive Device) automata and its successors [K EMI are based on Edelman's "Neural Darwinism" model of the brain, and feature large numbers of simulated neurons evolving by natural selection into configurations that carry

th Values and Attention Values 255 13.4 Knowledge Representation via Attractor Neural Networks 256 EFTA00623773 xviii Contents 13.4.1 The Hopfield neural net model 256 13.4.2 Knowledge Representation via Cell Assemblies 257 13.5 Neural Foundations of Learning 258 13.5.1 Hebbian Learni

ve pattern recognition as well as static pattern recognition. Audition likely utilizes a similar hierarchy. Olfaction may use something more like a Hopfield attractor neural network, as described in Chapter 13. The networks corresponding to different sense modalities have multiple cross-linkages, more a

er-level behaviors like reasoning or subgoaling. e NOMAD (Neurally Organized Mobile Adaptive Device) automata and its successors [KE06] are based on Edelman’s “Neural Darwinism” model of the brain, and feature large numbers of simulated neurons evolving by natural selection into configurations that carry

e eee eee 255 13.4 Knowledge Representation via Attractor Neural Networks ................... 256 HOUSE_OVERSIGHT_012913 xviii Contents 13.4.1 The Hopfield neural net model ..............0..0 022 e eee 256 13.4.2 Knowledge Representation via Cell Assemblies .................2.05- 257 13.5 Neural Foundati

tive pattern recognition as well as static pattern recognition. Audition likely utilizes a similar hierarchy. Olfaction may use something more like a Hopfield attractor neural network, as described in Chapter 13. The networks corresponding to different sense modalities have multiple cross-linkages, more at