Datasets for Studying Generalization from Easy to Hard Examples

We describe new datasets for studying generalization from easy to hard examples.

cs.LG cs.AI Machine Learning and Data Classification Computational Physics and Python Applications

Paper

Similar papers

Easy2Hard-Bench: Standardized Difficulty Labels for Profiling LLM Performance and GeneralizationMucong Ding, Chenghao Deng, Choo, Jocelyn et al.2024 · arXiv (Cornell University) · 29 citations In Library

The Unreasonable Effectiveness of Easy Training Data for Hard TasksPeter Hase, Mohit Bansal, Peter Clark et al.2024 · Annual Meeting of the Association for Computational Linguistics · 48 citations In Library

Experimental Identification of Hard Data Sets for Classification and Feature Selection Methods with Insights on Method SelectionCuiju Luan, Guozhu Dong2017 · Data & Knowledge Engineering · 18 citations In Library

The Harder The Better: Maintaining Supervised Fine-tuning Generalization with Less but Harder DataZhaoyang Shang, Sibo Wei, Jianbin Guo et al.2025 · arXiv.org · 1 citation In Library

A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and SemanticsQing Li, Siyuan Huang, Yining Hong et al.2021 · arXiv (Cornell University) · 6 citations In Library

How Deep is your Learning: the DL-HARD Annotated Deep Learning DatasetIain Mackie, Jeff Dalton, Andrew Yates2021 In Library

How Deep is your Learning: the DL-HARD Annotated Deep Learning DatasetIain Mackie, Jeffery Dalton, Andrew Yates2021 · arXiv (Cornell University) · 58 citations In Library

Exploring the Learning Difficulty of Data: Theory and MeasureWeiyao Zhu, Ou Wu, Fengguang Su et al.2023 · ACM Transactions on Knowledge Discovery from Data In Library

Hard Examples Are All You Need: Maximizing GRPO Post-Training Under Annotation BudgetsBenjamin Pikus, Tiwari, Pratyush Ranjan, Bin Ye2025 · arXiv (Cornell University) In Library

DatasetsAndrew Johnson, Mike Page, Andrew Paice et al.2024 · OSF Preprints (OSF Preprints) In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal