Efficient Methods for Unsupervised Learning of Probabilistic Models

In this thesis I develop a variety of techniques to train, evaluate, and sample from intractable and high dimensional probabilistic models. Abstract exceeds arXiv space limitations -- see PDF.

cs.LG cs.AI cs.IT cs.NE physics.data-an Computer Science Mathematics Physics

View graph Source

Paper

References (100)

01PerceptronsDan A. Simovici2021 · Artificial Neural Networks · 819 citations

02Hamiltonian Monte Carlo with Reduced Momentum FlipsJascha Narain Sohl-Dickstein2012 · arXiv.org · 8 citations In Library

03Hamiltonian Annealed Importance Sampling for partition function estimationJascha Narain Sohl-Dickstein, B. J. Culpepper2012 · arXiv.org · 40 citations In Library

04The Natural Gradient by Analogy to Signal Whitening, and Recipes and Tricks for its UseJascha Narain Sohl-Dickstein2012 · arXiv.org · 13 citations In Library

05Handbook of Markov Chain Monte Carlo: Hardcover: 619 pages Publisher: Chapman and Hall/CRC Press (first edition, May 2011) Language: English ISBN-10: 1420079417Steve P. Brooks, A. Gelman, Galin L. Jones et al.2012 · 1.8k citations

06Unifying Non-Maximum Likelihood Learning Objectives with Minimum KL ContractionSiwei Lyu2011 · Neural Information Processing Systems · 21 citations

07Building a better probabilistic model of images by factorizationB. J. Culpepper, Jascha Narain Sohl-Dickstein, B. Olshausen2011 · Vision · 15 citations

08Lie Group Transformation Models for Predictive Video CodingC. Wang, Jascha Narain Sohl-Dickstein, I. Tosic et al.2011 · Data Compression Conference · 11 citations

09Reconstruction of eolian bed forms and paleocurrents from cross‐bedded strata at Victoria Crater, Meridiani Planum, MarsA. Hayes, J. Grotzinger, L. Edgar et al.2010 · 55 citations

10Information geometry in optimization, machine learning and statistical inferenceS. Amari2010 · 35 citations

11Modeling pixel means and covariances using factorized third-order boltzmann machinesMarc'Aurelio Ranzato, Geoffrey E. Hinton2010 · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · 259 citations

12An Unsupervised Algorithm For Learning Lie Group TransformationsJascha Narain Sohl-Dickstein, Jimmy C. Wang, B. Olshausen2010 · arXiv.org · 52 citations In Library

Scroll for more · 38 remaining

Similar papers

Exploring Probabilistic Models for Semi-supervised LearningJianfeng Wang2024 · arXiv (Cornell University) · 0 citations In Library

Probabilistic Tractable Models in Mixed Discrete-Continuous DomainsAndreas Bueff, Stefanie Speichert, Vaishak Belle2020 · Data Intelligence In Library

Scalable and Efficient Probabilistic Inference for Bayesian Deep Learning and Generative ModelingRuqi Zhang2025 · Proceedings of the AAAI Conference on Artificial Intelligence · 0 citations In Library

Determinantal Variational Inference for Intractable Probabilistic ModelsSÉRGIO DE ANDRADE, PAULO2025 · Zenodo (CERN European Organization for Nuclear Research) In Library

Knowledge Representation Using Probabilistic Model and Reconstruction-Based AlgorithmsShruti Dambhare, Sanjay Kumar, Sandhya Katiyar2022 In Library

Auto-Encoding Variational BayesDiederik P. Kingma, M. Welling2013 · International Conference on Learning Representations · 17k citations In Library

Continuous Mixtures of Tractable Probabilistic ModelsAlvaro H. C. Correia, Gennaro Gala, Erik Quaeghebeur et al.2022 · arXiv (Cornell University) · 26 citations In Library

Continuous Mixtures of Tractable Probabilistic ModelsAlvaro H. C. Correia, Gennaro Gala, Erik Quaeghebeur et al.2023 · Proceedings of the AAAI Conference on Artificial Intelligence In Library

Patents near this paper

Systems and Methods for Modeling Probability DistributionsUS 11,636,309 · UNLEARN.AI, INC. · 2023 UNSUPERVISED, SEMI-SUPERVISED, AND SUPERVISED LEARNING USING DEEP LEARNING BASED PROBABILISTIC GENERATIVE MODELSUS 11,475,313 · INTERNATIONAL BUSINESS MACHINES CORPORATION · 2022 SYSTEMS AND METHODS FOR TRACTABLE VARIATIONAL APPROXIMATION FOR INFERENCE IN DECISION-GRAPH BAYESIAN NETWORKSUS 7,184,993 · MICROSOFT CORPORATION · 2007 VARIATIONAL INFERENCE ENGINE FOR PROBABILISTIC GRAPHICAL MODELSUS 6,556,960 · MICROSOFT CORP. · 2003 PROBABILISTIC MODELING FOR ANONYMIZED DATA INTEGRATION AND BAYESIAN SURVEY MEASUREMENT OF SPARSE AND WEAKLY-LABELED DATASETSUS 11,568,215 · THE NIELSEN COMPANY (US), LLC · 2023

Source of record

arXiv