[Spotlight] Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Recommended citation: F. Kunstner, A. Milligan, R. Yadav, M. Schmidt, A. Bietti, Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models, NeurIPS, 2024.