Pushing the technical frontier: From overwhelmingly large data sets to machine learning

Abstract This paper summarizes my thoughts, given in an invited review at the IAU symposium 341 “Challenges in Panchromatical Galaxy Modelling with Next Generation Facilities”, about how machine learning methods can help us solve some of the big data problems associated with current and upcoming large galaxy surveys.

Computer Science Physics

View graph Source

Paper

Similar papers

The DAWES review 10: The impact of deep learning for the analysis of galaxy surveysMarc Huertas-Company, François Lanusse2022 · arXiv (Cornell University) · 54 citations In Library

Big Universe, Big Data: Machine Learning and Image Analysis for AstronomyJan Kremer, Kristoffer Stensbo-Smidt, Fabian Gieseke et al.2017 · IEEE Intelligent Systems · 86 citations In Library

Machine learning for observational cosmologyK. Moriwaki, T. Nishimichi, N. Yoshida2023 · Reports on progress in physics. Physical Society · 27 citations In Library

Discussion on "Techniques for Massive-Data Machine Learning in Astronomy" by A. GrayN. Ball2011 · arXiv.org · 0 citations In Library

Machine Learning and CosmologyC. Dvorkin, S. Mishra-Sharma, B. Nord et al.2022 · arXiv.org · 20 citations In Library

Deep Learning in AstrophysicsYuan-Sen Ting2025 · Annual Review of Astronomy and Astrophysics · 2 citations In Library

From stellar light to astrophysical insight: automating variable star research with machine learningJeroen Audenaert2025 · Astrophysics and Space Science · 3 citations In Library

Luminis Stellarum et Machina: Applications of Machine Learning in Light Curve AnalysisAlmat Akhmetali, A. Zhunuskanov, A. Sakan et al.2025 · 1 citation In Library

Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger SourcesE. Huerta, Zhizhen Zhao2021 · Handbook of Gravitational Wave Astronomy · 22 citations In Library

Effectively using unsupervised machine learning in next generation astronomical surveysI. Reis, Michael Rotman, D. Poznanski et al.2019 · Astronomy and Computing · 17 citations In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal