APS Logo

Associative memory model with arbitrary Hebbian length

POSTER

Abstract

Our brains build connections within events, i.e. associative memory. Specifically, the brain can establish correlation between temporal sequential events by conversion the correlation into the spatial-structured synapses, which is related to the function of learning and the feeling of time passing. However, The correlation conversion can happens in a wide integration window, whose influence on the correlation conversion remains elusive.

Here, we propose a generalized associative memory model with arbitrary width of integration window and other parameters. This model can be analytically solved by replica method and predict how model parameters affect the conversion. A series of previous models can be degenerated from the models. We highlight that a small increment in integration window width can significantly enhance the correlation conversion. Moreover, the anti-Hebbian component is able to reshape the energy landscape of memories, akin to the function of sleep.  Besides, we apply random matrix theory to show how the maximum eigenvalue is related to the transition from paramagnetic to spin glass in the model. 

Altogether, our work gives a full view of a series models and establishes the connection between associative memory, Hebbian length, and correlation conversion in the brain.

Publication: Associative memory model with arbitrary Hebbian length<br>Eigenvalue spectrum of neural networks with arbitrary Hebbian length

Presenters

  • Zijian Jiang

    PMI lab, School of Physics, Sun Yat-sen University

Authors

  • Zijian Jiang

    PMI lab, School of Physics, Sun Yat-sen University

  • Haiping Huang

    PMI lab, School of Physics, Sun Yat-sen University., PMI lab, School of Physics, Sun Yat-sen University

  • jianwen zhou

    PMI lab, School of Physics, Sun Yat-sen University

  • Tianqi Hou

    Department of Physics, the Hong Kong University of Science and Technology

  • Ziming Chen

    PMI lab, School of Physics, Sun Yat-sen University

  • K.Y. Michael Wong

    Department of Physics, the Hong Kong University of Science and Technology