Mathematical Perspective of Machine Learning

We take a closer look at some theoretical challenges of Machine Learning as a function approximation, gradient descent as the default optimization algorithm, limitations of fixed length and width networks and a different approach to RNNs from a mathematical perspective.

cs.LG stat.ML Neural Networks and Applications Mathematics Computer Science

Paper

References (5)

01Multilayer feedforward networks are universal approximatorsK. Hornik, M. Stinchcombe, H. White1989 · Neural Networks · 24k citations

02Only recently Fourier series were used in the new design of recurrent neural network called "Transformers

03Neural Networks and Lookup Tables for Identification Identification of Dynamic Systems2011

04Neural Networks and Lookup Tables for Identification Identification of Dynamic Systems Springer2011

05Protein Folding J2021 · Jumper et al.

Similar papers

A mathematical perspective of machine learningE Weinan2023 · EMS Press eBooks In Library

Mathematical Structures In Machine Learning And Neural NetworksKhushal P. Rathod*2026 · Zenodo (CERN European Organization for Nuclear Research) In Library

Mathematical Structures In Machine Learning And Neural NetworksKhushal P. Rathod*2026 · Zenodo (CERN European Organization for Nuclear Research) In Library

An Approximation Theory Perspective on Machine LearningH. N. Mhaskar, Efstratios Tsoukanis, Ameya D. Jagtap2025 · arXiv (Cornell University) · 3 citations In Library

Mathematical Foundations of Machine Learning Optimizing Algorithms through Analytical ModellingNavneet Kaur2026 · International Journal for Research in Applied Science and Engineering Technology In Library

Mathematical Aspects of Machine Learning: A Comprehensive ReviewBadri Vishal Padamwar, P. Hema Rao2020 · Türk bilgisayar ve matematik eğitimi dergisi In Library

Towards a Mathematical Understanding of Neural Network-Based Machine Learning: What We Know and What We Don'tWeinan E Weinan E, Chao Ma Chao, Lei Wu et al.2020 · CSIAM Transactions on Applied Mathematics In Library

Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don'tE Weinan, Chao Ma, Stephan Wojtowytsch et al.2020 · arXiv (Cornell University) · 149 citations In Library

Machine Learning and Computational MathematicsWeinan E2020 · Communications in Computational Physics In Library

Machine Learning and Computational MathematicsW. E2020 · Communications in Computational Physics · 75 citations In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal