A Primer on PAC-Bayesian Learning

Generalised Bayesian learning algorithms are increasingly popular in machine learning, due to their PAC generalisation properties and flexibility. The present paper aims at providing a self-contained survey on the resulting PAC-Bayes framework and some of its main theoretical and algorithmic developments.

stat.ML cs.LG Computer Science Mathematics

Paper

Similar papers

Learning via Surrogate PAC-BayesAntoine Picard-Weibel, Roman Moscoviz, Benjamin Guedj2024 · arXiv (Cornell University) · 1 citation In Library

PAC-Bayesian Learning of Optimization AlgorithmsMichael Sucker, Peter Ochs2022 · arXiv (Cornell University) · 7 citations In Library

Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian LearningWei Huang, Chunrui Liu, Yilan Chen et al.2022 · arXiv (Cornell University) In Library

More Flexible PAC-Bayesian Meta-Learning by Learning Learning AlgorithmsHossein Zakerinia, Amin Behjati, Christoph H. Lampert2024 · arXiv (Cornell University) · 12 citations In Library

Generalization Bounds: Perspectives from Information Theory and PAC-BayesFredrik Hellström, Giuseppe Durisi, Benjamin Guedj et al.2023 · arXiv (Cornell University) In Library

Generalization Bounds: Perspectives from Information Theory and PAC-BayesFredrik Hellström, Giuseppe Durisi, Benjamin Guedj et al.2025 · Foundations and Trends® in Machine Learning In Library

Learning-to-Optimize with PAC-Bayesian Guarantees: Theoretical Considerations and Practical ImplementationMichael Sucker, Jalal Fadili, Peter Ochs2024 · arXiv (Cornell University) In Library

Wasserstein PAC-Bayes Learning: Exploiting Optimisation Guarantees to Explain GeneralisationMaxime Haddouche, Benjamin Guedj2023 · arXiv (Cornell University) In Library

User-friendly introduction to PAC-Bayes boundsPierre Alquier2021 · arXiv (Cornell University) In Library

Improving Generalization of Complex Models under Unbounded Loss Using PAC-Bayes BoundsXitong Zhang, Avrajit Ghosh, Guangliang Liu et al.2023 · arXiv (Cornell University) · 1 citation In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal