APS Logo

Spectral analysis of synaptic connection matrix of brain utilizing the Random matrix theory for large scale neural network.

POSTER

Abstract

In Random Matrix Theory, we study spectral properties like the eigenvalues and eigenvectors of large random matrices and their influence on overall system dynamics. Many neural networks, both artificial and biological, can model the synaptic weight matrix as a random matrix. Each entry in the matrix signifies the strength of the connection between two neurons, either randomly initialized in artificial neural networks or with the addition of randomness due to neural plasticity. In this study, we analyzed the framework of the neuronal network, considering the synaptic matrices as large eigen matrices with independent and identically distributed entries, which are typically from a Gaussian distribution. Here we observed that the eigenvalue distribution tends to follow a circular shape, with most of the eigenvalues concentrated near zero and a few found near larger magnitudes. In this article, we examine the eigenvalue spectrum of a random synaptic connection matrix, giving insight into the behavior of neural networks in various regimes: ordered, chaotic, and critical. We have studied parameters like memory efficiency, which is crucial for learning and generalizing based on data. The study establishes RMT as an essential tool for the study of large-scale neural networks, guiding their design and analyzing emergent properties.

Publication: Mehta M L Random Matrices (Academic) 1991<br>Ranjan K and Abbott L F Phys. Rev. Lett. 97 188104 2006<br>Ansari M G and Shukla P J. Phys. A: Math. Theor. 57 095005 2024<br>Amir A, Hatano N and Nelson D R Phys. Rev. E 93 042310 2016<br>Jiao, Licheng and Ma, Mengru and He, Pei and Geng, Xueli and Liu, Xu and Liu, Fang and Ma, Wenping and Yang, Shuyuan and Hou, Biao and Tang, Xu IEEE Transactions on Neural Networks and Learning Systems 10540615 2024

Presenters

  • Mohd G Ansari

    Indian Institute of Technology Kharagpur

Authors

  • Mohd G Ansari

    Indian Institute of Technology Kharagpur

  • Pragya Shukla

    Indian Institute of Technology Kharagpur