Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

23 papers of 6,984Sort Recent · Most cited
  1. 2022
    Self-Activating Neural Ensembles for Continual Reinforcement LearningSam Powers, Xing, Eliot, Gupta, AbhinavCoLLAs · Carnegie Mellon University · Meta (Israel)
    PDF ↗
  2. 2022PDF ↗
  3. 2022
    A Theory for Knowledge Transfer in Continual LearningDiana Benavides‐Prado, Patricia RiddleCoLLAs
    PDF ↗
  4. 2022
    Model-Free Generative Replay for Lifelong Reinforcement Learning: Application to Starcraft-2Zachary Daniels, Aswin Raghavan, Jesse Hostetler … Ajay DivakaranCoLLAs
    PDF ↗
  5. 2022PDF ↗
  6. 2022PDF ↗
  7. 2022
    Reactive Exploration to Cope with Non-Stationarity in Lifelong Reinforcement LearningChristian Steinparz, Thomas Schmied, Fabian Paischer … Sepp HochreiterCoLLAs
    PDF ↗
  8. 2022PDF ↗
  9. 2022PDF ↗
  10. 2022PDF ↗
  11. 2022PDF ↗
  12. 2022PDF ↗
  13. 2022
    Continual Learning with Foundation Models: An Empirical Study of Latent ReplayОleksiy Ostapenko, Timothée Lesort, Pau Rodríguez … Laurent CharlinCoLLAs
    PDF ↗
  14. 2022
    Forgetting and Imbalance in Robot Lifelong Learning with Off-policy DataWenxuan Zhou, Steven Bohez, Jan Humplik … Nicolas HeessCoLLAs
    PDF ↗
  15. 2022
    Continual Learning and Private UnlearningBo Liu, Qiang Liu, Peter StoneCoLLAs
    PDF ↗
  16. 2022
    Online Continual Learning for Embedded DevicesTyler L. Hayes, Christopher KananCoLLAs
    PDF ↗
  17. 2022
    Sparsity and Heterogeneous Dropout for Continual Learning in the Null Space of Neural ActivationsAli Abbasi, Parsa Nooralinejad, Vladimir Braverman … Soheil KolouriCoLLAs
    PDF ↗
  18. 2022
    Continual Learning through Hamilton EquationsAlessandro Betti, Lapo Faggi, M. Gori … S. MelacciCoLLAs
  19. 2022PDF ↗
  20. 2022
    Continual Novelty DetectionRahaf Aljundi, Daniel Olmeda Reino, Nikolay Chumerin, Richard E. TurnerCoLLAs
    PDF ↗
  21. 2022
    TAG: Task-based Accumulated Gradients for Lifelong learningPranshu Malviya, Balaraman Ravindran, Sarath ChandarCoLLAs
    PDF ↗
  22. 2022
    How do Quadratic Regularizers Prevent Catastrophic Forgetting: The Role of InterpolationEkdeep Singh Lubana, Puja Trivedi, Danai Koutra, Robert P. DickCoLLAs · University of Michigan
    PDF ↗
  23. 2022
    Energy-Based Models for Continual LearningShuang Li, Yilun Du, Gido M. van de Ven, Igor MordatchCoLLAs · Massachusetts Institute of Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.