Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

17 papers of 6,984Sort Recent · Most cited
  1. 2025
    Barriers for Learning in an Evolving World: Mathematical Understanding of Loss of PlasticityAmir Joudaki, Giulia Lanzillotta, Mohammad Samragh Razlighi … Fartash FaghriarXiv
    PDF ↗
  2. 2025PDF ↗
  3. 2025
    TiC-LM: A Web-Scale Benchmark for Time-Continual LLM PretrainingJeffrey Li, Mohammadreza Armandpour, Iman Mirzadeh … Fartash FaghriACL
    PDF ↗
  4. 2024
    SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial UnderstandingHaoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri … Hadi PouransariCVPR · University of Illinois Urbana-Champaign · Apple (United Kingdom)
    PDF ↗
  5. 2024
    TiC-CLIP: Continual Training of CLIP ModelsSaurabh Garg, Mehrdad Farajtabar, Hadi Pouransari … Fartash FaghriICLR
    PDF ↗
  6. 2023
    Continual Learning Beyond a Single ModelThang Doan, Seyed Iman Mirzadeh, Mehrdad FarajtabarCoLLAs
    PDF ↗
  7. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  8. 2022
    Efficient Continual Learning Ensembles in Neural Network SubspacesT. Doan, Seyed Iman Mirzadeh, Joelle Pineau, Mehrdad FarajtabararXiv
  9. 2022
    Wide Neural Networks Forget Less CatastrophicallySeyed Iman Mirzadeh, Arslan Chaudhry, Yin, Dong … Mehrdad FarajtabarICML · Google (United States)
    PDF ↗
  10. 2021
    Task-agnostic Continual Learning with Hybrid Probabilistic ModelsPolina Kirichenko, Mehrdad Farajtabar, Dushyant Rao … Razvan PascanuarXiv
    PDF ↗
  11. 2020
  12. 2021
    Linear Mode Connectivity in Multitask and Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Görür … Hassan GhasemzadehICLR · Washington State University · Google (United States)
    PDF ↗
  13. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  14. 2020
    SOLA: Continual Learning with Second-Order Loss ApproximationDong Yin, Mehrdad Farajtabar, Ang Li … A. MottarXiv
    PDF ↗
  15. 2020
    Understanding the Role of Training Regimes in Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, Hassan GhasemzadehNeurIPS
    PDF ↗
  16. 2020
    Dropout as an Implicit Gating Mechanism For Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Hassan GhasemzadehCVPR · Washington State University · Google (United States)
    PDF ↗
  17. 2020
    Orthogonal Gradient Descent for Continual LearningMehrdad Farajtabar, Navid Azizan, A. Mott, Ang LiAISTATS · Google (United States)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.