Dimensionality and dynamics for next-generation artificial neural networks

Abstract

Summary The recent awarding of the Nobel Prize in Physics to Geoffrey E. Hinton and John J. Hopfield highlights their profound impact on artificial neural networks. In this perspective, we explore how their foundational insights can drive the advancement of next-generation artificial intelligence (AI) models. We propose expanding beyond conventional architectures by introducing dimensionality through intra-layer links and dynamics via feedback loops. Network height and additional dimensions, alongside traditional width and depth, enhance learning capabilities, while entangled loops across scales induce emergent behaviors akin to phase transitions in physics. We discuss how these principles extend beyond transformers, fostering a new paradigm of intelligence inspired by physics-driven models and biological cognition mechanisms.