The Sparse Hausdorff Moment Problem, with Application to Topic Models

We consider the problem of identifying, from its first $m$ noisy moments, a probability distribution on $[0,1]$ of support $k

cs.LG cs.DS stat.ML Machine Learning and Algorithms Algorithms and Data Compression Bayesian Methods and Mixture Models Mathematics Computer Science

View graph Source

Paper

References (32)

01How (Un)stable Are Vandermonde Systems?W. Gautschi2020 · Asymptotic and Computational Analysis · 53 citations

02How Many Subpopulations Is Too Many? Exponential Lower Bounds for Inferring Population HistoriesYounhun Kim, Frederic Koehler, Ankur Moitra et al.2018 · Annual International Conference on Research in Computational Molecular Biology · 18 citations

03Beyond the low-degree algorithm: mixtures of subcubes and their applicationsSitan Chen, Ankur Moitra2018 · Symposium on the Theory of Computing · 38 citations In Library

04Learning Arbitrary Statistical Mixtures of Discrete DistributionsJian Li, Y. Rabani, L. Schulman et al.2015 · Symposium on the Theory of Computing · 21 citations In Library

05Learning mixtures of arbitrary distributions over large discrete domainsY. Rabani, L. Schulman, Chaitanya Swamy2012 · Information Technology Convergence and Services · 39 citations In Library

06A Spectral Algorithm for Latent Dirichlet AllocationAnima Anandkumar, Dean Phillips Foster, Daniel J. Hsu et al.2012 · Algorithmica · 305 citations In Library

07Learning Topic Models -- Going beyond SVDSanjeev Arora, Rong Ge, Ankur Moitra2012 · IEEE Annual Symposium on Foundations of Computer Science · 462 citations In Library

08A Method of Moments for Mixture Models and Hidden Markov ModelsAnima Anandkumar, Daniel J. Hsu, S. Kakade2012 · Annual Conference Computational Learning Theory · 349 citations In Library

09Learning mixtures of product distributions over discrete domainsJ. Feldman, R. O'Donnell, R. Servedio2005 · IEEE Annual Symposium on Foundations of Computer Science · 128 citations

10The Moment ProblemA. Gut2002 · Encyclopedia of Special Functions: The Askey-Bateman Project · 300 citations

11Introduction to Numerical AnalysisA. Neumaier2001 · 6.7k citations

12Probabilistic Latent Semantic AnalysisThomas Hofmann1999 · Conference on Uncertainty in Artificial Intelligence · 2.9k citations In Library

Scroll for more · 20 remaining

Similar papers

Efficient Algorithms for Sparse Moment Problems without SeparationZhiyuan Fan, Jian Li2022 · arXiv (Cornell University) In Library

Optimal estimation of sparse topic modelsXin Bing, Florentina Bunea, Marten Wegkamp2020 · arXiv (Cornell University) · 11 citations In Library

Likelihood estimation of sparse topic distributions in topic models and its applications to Wasserstein document distance calculationsXin Bing, Florentina Bunea, Seth Strimas-Mackey et al.2021 · arXiv (Cornell University) · 6 citations In Library

Sparse topic modeling via spectral decomposition and thresholdingHuy Tran, Yating Liu, Claire Donnat2023 · arXiv (Cornell University) In Library

Likelihood estimation of sparse topic distributions in topic models and its applications to Wasserstein document distance calculationsXin Bing, Florentina Bunea, Seth Strimas-Mackey et al.2022 · The Annals of Statistics In Library

Method of Moments for Topic Models with Mixed Discrete and Continuous FeaturesJoachim Giesen, Paul Kahlmeyer, Sören Laue et al.2021 · International Joint Conference on Artificial Intelligence · 2 citations In Library

Kernel Topic ModelsPhilipp Hennig, David H. Stern, R. Herbrich et al.2011 · International Conference on Artificial Intelligence and Statistics · 67 citations In Library

Support Recovery in Mixture Models With Sparse ParametersArya Mazumdar, Soumyabrata Pal2024 · IEEE Transactions on Information Theory In Library

Estimating Gaussian Mixtures Using Sparse Polynomial Moment SystemsJulia Lindberg, Carlos Améndola, Jose Israel Rodriguez2025 · SIAM Journal on Mathematics of Data Science In Library

Moment-Based Inference for Regression with Latent Dirichlet CovariatesZiyu Jiang2026 · 0 citations In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal