Library

Norm-Based Capacity Control in Neural Networks

We investigate the capacity, convexity and characterization of a general family of norm-constrained feed-forward networks.

cs.LGcs.AIcs.NEstat.MLComputer ScienceMathematics
View graphSource

Paper

References (22)

01Breaking the Curse of Dimensionality with Convex Neural NetworksF. Bach2014 · Journal of machine learning research · 821 citations In Library
02On the Computational Efficiency of Training Neural NetworksRoi Livni, S. Shalev-Shwartz, Ohad Shamir2014 · Neural Information Processing Systems · 502 citations In Library
03A New Perspective on Learning Linear Separators with Large \(L_qL_p\) MarginsMaria-Florina Balcan, C. Berlind2014 · International Conference on Artificial Intelligence and Statistics · 4 citations
04From average case complexity to improper learning complexityAmit Daniely, N. Linial, S. Shalev-Shwartz2013 · Symposium on the Theory of Computing · 126 citations In Library
05On rectified linear units for speech processingMatthew D. Zeiler, Marc'Aurelio Ranzato, R. Monga et al.2013 · IEEE International Conference on Acoustics, Speech, and Signal Processing · 545 citations
06Sparse regularization in MRI iterative reconstruction using GPUsY. Zhuo, B. Sutton, Xiaolong Wu et al.2010 · International Conference on BioMedical Engineering and Informatics · 113 citations
07Rectified Linear Units Improve Restricted Boltzmann MachinesVinod Nair, Geoffrey E. Hinton2010 · International Conference on Machine Learning · 19k citations
08Kernel Methods for Deep LearningYoungmin Cho, L. Saul2009 · Neural Information Processing Systems · 866 citations
09On the Complexity of Linear Prediction: Risk Bounds, Margin Bounds, and RegularizationS. Kakade, Karthik Sridharan, Ambuj Tewari2008 · Neural Information Processing Systems · 414 citations
10Cryptographic Hardness for Learning Intersections of HalfspacesAdam R. Klivans, Alexander A. Sherstov2006 · IEEE Annual Symposium on Foundations of Computer Science · 198 citations
11Convex Neural NetworksYoshua Bengio, Nicolas Le Roux, P. Vincent et al.2005 · Neural Information Processing Systems · 228 citations
12Rademacher and Gaussian Complexities: Risk Bounds and Structural ResultsP. Bartlett, S. Mendelson2003 · Journal of machine learning research · 3.3k citations

Scroll for more · 10 remaining

Similar papers

Capacity Control of ReLU Neural Networks by Basis-path NormShuxin Zheng, Qi Meng, Huishuai Zhang et al.2018 · AAAI Conference on Artificial Intelligence · 22 citations In Library
Theoretical Investigation of Generalization Bound for Residual NetworksHao Chen, Zhanfeng Mo, Zhouwang Yang et al.2019 · International Joint Conference on Artificial Intelligence · 7 citations In Library
Understanding Weight Normalized Deep Neural Networks with Rectified Linear UnitsYixi Xu, Xiao Wang2018 · Neural Information Processing Systems · 12 citations In Library
The Curious Case of Convex Neural NetworksSarath Sivaprasad, Naresh Manwani, Vineet Gandhi2020 · arXiv (Cornell University) · 33 citations In Library
Capacity allocation through neural network layersJonathan Donier2019 · arXiv.org · 3 citations In Library
The capacity of feedforward neural networksP. Baldi, R. Vershynin2019 · Neural Networks · 77 citations In Library
Optimization-based control using input convex neural networksShu Yang, B. Bequette2021 · Computers and Chemical Engineering · 35 citations In Library
The Hidden Power of Normalization Layers in Neural Networks: Exponential Capacity ControlKhoat Than2025 · 0 citations In Library
Approximation bounds for norm constrained deep neural networksFrancesco Paolo Maiale, Anastasiia Trofimova, Arturo De Marinis2025 · arXiv (Cornell University) · 0 citations In Library
Approximation bounds for norm constrained neural networks with applications to regression and GANsYuling Jiao, Yan Wang, Yunfei Yang2022 · arXiv (Cornell University) · 32 citations In Library
© 2026 NYSGPT2525 LLC