Epstein Secrets

arding the representation of knowledge using attractor neural nets. It is a mix of well-established fact with more speculative material. 13.4.1 The Hopfield neural net model Hopfield networks Iliop821 are attractor neural networks often used as associative memories. A Hopfield network with N neurons can

tation of glocal memory in attractor neural net systems • Chapter 23 presents Glocal Economic Attention Networks (ECANs), rough analogues of glocal Hopfield nets that play a central role in CogPrime. Our hypothesis of the potential general importance of glocality as a property of memory, systems (beyond

moved without significantly impacting the net- work's capacity or dynamics. Our experimental work uses sparse Hopfield networks. 13.4.1.1 Palimpsest Hopfield nets with a modified learning rule In JSV99J a new learning rule is presented, which both increases the Hopfield network capacity and turns it into

what this "tuning" should involve - namely, making a system possessing mind-state sequences that correspond meaningfully to world-state sequences. CogPrime's overall design and particular cognitive processes are reasonably well interpreted as an attempt to achieve this for everyday human goals and envir

garding the representation of knowledge using attractor neural nets. It is a mix of well-established fact with more speculative material. 13.4.1 The Hopfield neural net model Hopfield networks [Hop82] are attractor neural networks often used as associative memories. A Hopfield network with N neurons can b

ntation of glocal memory in attractor neural net systems e Chapter 23 presents Glocal Economic Attention Networks (ECANs), rough analogues of glocal Hopfield nets that play a central role in CogPrime. Our hypothesis of the potential general importance of glocality as a property of memory systems (beyond j

moved without significantly impacting the net- work’s capacity or dynamics. Our experimental work uses sparse Hopfield networks. 13.4.1.1 Palimpsest Hopfield nets with a modified learning rule In [SV99] a new learning rule is presented, which both increases the Hopfield network capacity and turns it into

ut what this "tuning" should involve — namely, making a system possessing mind-state sequences that correspond meaningfully to world-state sequences. CogPrime’s overall design and particular cognitive processes are reasonably well interpreted as an attempt to achieve this for everyday human goals and enviro

some of the properties that the above ECAN equations display when we use an ECAN defined by them as an associative memory network in the manner of a Hopfield network. We consider a situation where the ECAN is supplied with memories via a "training" phase in which one imprints it with a series of binary

orks Economic Attention Networks (ECANs) are dynamical systems based on the propagation of STI and LTI values. They are similar in many respects to Hopfield nets, but are based on a different conceptual foundation involving the propagation of amounts of (conserved) currency rather than neural-net activa

22.12 Coals and Time 81 22.12 Goals and Time The CogPrime system maintains an explicit list of "Ubergoals", which as will be explained in Chapter 24, receive attentional currency which they may then allocat

th Values and Attention Values 255 13.4 Knowledge Representation via Attractor Neural Networks 256 EFTA00623773 xviii Contents 13.4.1 The Hopfield neural net model 256 13.4.2 Knowledge Representation via Cell Assemblies 257 13.5 Neural Foundations of Learning 258 13.5.1 Hebbian Learni

ve pattern recognition as well as static pattern recognition. Audition likely utilizes a similar hierarchy. Olfaction may use something more like a Hopfield attractor neural network, as described in Chapter 13. The networks corresponding to different sense modalities have multiple cross-linkages, more a

f intel- ligence and mind. It then sketches the broad outlines of a novel, integrative architecture for Artificial General Intelligence (AGI) called CogPrime ... and describes an approach for giving a young AGI system (CogPrime or otherwise) appropriate experience, so that it can develop its own smarts,

e eee eee 255 13.4 Knowledge Representation via Attractor Neural Networks ................... 256 HOUSE_OVERSIGHT_012913 xviii Contents 13.4.1 The Hopfield neural net model ..............0..0 022 e eee 256 13.4.2 Knowledge Representation via Cell Assemblies .................2.05- 257 13.5 Neural Foundati

tive pattern recognition as well as static pattern recognition. Audition likely utilizes a similar hierarchy. Olfaction may use something more like a Hopfield attractor neural network, as described in Chapter 13. The networks corresponding to different sense modalities have multiple cross-linkages, more at

of intel- ligence and mind. It then sketches the broad outlines of a novel, integrative architecture for Artificial General Intelligence (AGT) called CogPrime ... and describes an approach for giving a young AGI system (CogPrime or otherwise) appropriate experience, so that it can develop its own smarts, cr

FTA00623877 102 5 A Generic Architecture of Human-Like Cognition touch and smell (the latter being better modeled as something like an asymmetric Hopfield net, prone to frequent chaotic dynamics ILIAV*051) - these may also cross-connect with each other and with the more hierarchical perceptual subnetw

e Sam Adams and his colleagues at IBM have created a cognitive architecture called Joshua Blue IAABL02], which has some significant similarities to CogPrime. Similar to our current research direction with CogPrime, Joshua Blue was created with loose emulation of child cognitive development in mind; and,

RSIGHT_013017 102 5 A Generic Architecture of Human-Like Cognition touch and smell (the latter being better modeled as something like an asymmetric Hopfield net, prone to frequent chaotic dynamics [LLW~05]) — these may also cross-connect with each other and with the more hierarchical perceptual subnetwork

ue Sam Adams and his colleagues at IBM have created a cognitive architecture called Joshua Blue [AABLO2], which has some significant similarities to CogPrime. Similar to our current research direction with CogPrime, Joshua Blue was created with loose emulation of child cognitive development in mind; and, a