On physical processes that work like learning algorithms
ORAL · Invited
Abstract
Building on this concept, we propose the Multi-mechanism Learning (MML) framework, in which input and feedback signals are encoded into two distinct, non-interfering physical quantities. Within this framework, we develop a backpropagation-like learning process that uses only local information to perform gradient descent on a global cost function.
Furthermore, we posit that glassy dynamics—characterized by slow, history-dependent behavior—may represent nature’s strategy for implementing weight updates. Leveraging this concept, we demonstrate how a granular system self-organizes in response to external driving and how this mechanism can be used to exhibit allostery-like behavior. This training paradigm eliminates the need for explicit weight update rules, enabling the system to self-organize naturally toward targeted outcomes.
Our findings offer new insights into how physical processes can emulate learning, with potential implications for understanding adaptation and self-organization in complex biological systems.
–
Publication: [1] Anisetti, Vidyesh Rao, Benjamin Scellier, and Jennifer M. Schwarz. "Learning by non-interfering feedback chemical signaling in physical networks." Physical Review Research 5.2 (2023): 023024.<br><br>[2] Anisetti, Vidyesh Rao, et al. "Frequency propagation: Multimechanism learning in nonlinear physical networks." Neural Computation 36.4 (2024): 596-620.<br><br>[3] Anisetti, Vidyesh Rao, Ananth Kandala, and J. M. Schwarz. "Emergent learning in physical systems as feedback-based aging in a glassy landscape." arXiv preprint arXiv:2309.04382 (2023).<br><br>[4] Anisetti, Vidyesh Rao, Ananth Kandala, and J. M. Schwarz. "A slime mold inspired local adaptive mechanism for flow networks." arXiv preprint arXiv:2309.16988 (2023).
Presenters
-
Vidyesh Rao Anisetti
University of Chicago
Authors
-
Vidyesh Rao Anisetti
University of Chicago
-
Ananth Kandala
University of Florida
-
Benjamin Scellier
Rain Neuromorphics
-
Joseph D Paulsen
Syracuse University
-
Nidhi Pashine
Syracuse University
-
Jennifer M Schwarz
Syracuse University, Department of Physics, Syracuse University