Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

105 papers of 6,984 · showing 51–100Sort Recent · Most cited
  1. 2022PDF ↗
  2. 2022PDF ↗
  3. 2022
    The Effect of Task Ordering in Continual LearningSamuel J. Bell, Neil D. LawrencearXiv
    PDF ↗
  4. 2022PDF ↗
  5. 2022PDF ↗
  6. 2022PDF ↗
  7. 2022
    Interpolating Compressed Parameter SubspacesSiddhartha Datta, Nigel ShadboltarXiv
    PDF ↗
  8. 2022PDF ↗
  9. 2022
    Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node ActivationSebastian Lee, Stefano Sarao Mannelli, Claudia Clopath … Andrew SaxearXiv
    PDF ↗
  10. 2022PDF ↗
  11. 2022PDF ↗
  12. 2022
    Experimentally realized memristive memory augmented neural networkRuibin Mao, Bo Wen, Yahui Zhao … Can LiarXiv · University of Hong Kong · University of Notre Dame · +2
    PDF ↗
  13. 2022PDF ↗
  14. 2022
    Incremental Prototype Tuning for Class Incremental LearningJie‐Ren Deng, Jianhua Hu, Haojian Zhang, Yunkuan WangarXiv
    PDF ↗
  15. 2022
    Gradient-Matching Coresets for Rehearsal-Based Continual LearningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  16. 2022
    Addressing Client Drift in Federated Continual Learning with Adaptive OptimizationYeshwanth Venkatesha, Youngeun Kim, Hyoungseob Park … Priyadarshini PandaarXiv
    PDF ↗
  17. 2022
    Tackling Online One-Class Incremental Learning by Removing Negative ContrastsNader Asadi, Sudhir P. Mudur, Eugene BelilovskyarXiv
    PDF ↗
  18. 2022
    A Closer Look at Knowledge Distillation with Features, Logits, and GradientsYen-Chang Hsu, James Smith, Yilin Shen … Hongxia JinarXiv
    PDF ↗
  19. 2022
    L2Explorer: A Lifelong Reinforcement Learning Assessment EnvironmentErik C. Johnson, Eric Q. Nguyen, Blake A. Schreurs … Gautam K. VallabhaarXiv
    PDF ↗
  20. 2022
    Provable and Efficient Continual Representation LearningYingcong Li, Mingchen Li, M. Salman Asif, Samet OymakarXiv
    PDF ↗
  21. 2022PDF ↗
  22. 2022
    A Versatile Agent for Fast Learning from Human InstructorsYiwen Chen, Zedong Zhang, Haofeng Liu … Marcelo H. AngarXiv
    PDF ↗
  23. 2022
    BERT WEAVER: Using WEight AVERaging to Enable Lifelong Learning for Transformer-based ModelsKühnel, Lisa, Alexander Schulz, Barbara Hammer, Juliane FluckarXiv
    PDF ↗
  24. 2022
    Diagnosing Batch Normalization in Class Incremental LearningMinghao Zhou, Quanziang Wang, Jun Shu … Deyu MengarXiv
    PDF ↗
  25. 2022PDF ↗
  26. 2022PDF ↗
  27. 2022PDF ↗
  28. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  29. 2022
    PaRT: Parallel Learning Towards Robust and Transparent AIM Paknezhad, Hamsawardhini Rengarajan, Chenghao Yuan … Lee, Hwee KuanarXiv
    PDF ↗
  30. 2022
    Lifelong Generative Learning via Knowledge ReconstructionLibo Huang, Zhulin An, Xiang Zhi, Yongjun XuarXiv
    PDF ↗
  31. 2022PDF ↗
  32. 2022PDF ↗
  33. 2022PDF ↗
  34. 2022
    Foundational Models for Continual Learning: An Empirical Study of Latent ReplayOleksiy Ostapenko, Timothée Lesort, P. Rodríguez … Laurent CharlinarXiv
  35. 2022
    Task-Agnostic Continual Reinforcement Learning: In Praise of a Simple BaselineMassimo Caccia, Jonas W. Mueller, Taesup Kim … Rasool FakoorarXiv
  36. 2022
    Scaling the Number of Tasks in Continual LearningTimothée Lesort, Oleksiy Ostapenko, Diganta Misra … I. RisharXiv
  37. 2022
    AI Autonomy: Self-Initiation, Adaptation and Continual LearningBing Liu, Sahisnu Mazumder, Eric Robertson, Scott GrigsbyarXiv
  38. 2022
    Efficient Continual Learning Ensembles in Neural Network SubspacesT. Doan, Seyed Iman Mirzadeh, Joelle Pineau, Mehrdad FarajtabararXiv
  39. 2022
    Is Continual Learning Truly Learning Representations Continually?Sungmin Cha, Dongsub Shim, Hyunwoo J. Kim … Taesup MoonarXiv
  40. 2022
    Memory Efficient Continual Learning for Neural Text ClassificationB. Ermi̇ş, Giovanni Zappella, Martin Wistuba, C. ArchambeauarXiv
  41. 2022
  42. 2022
  43. 2022
    Task-Balanced Batch Normalization for Exemplar-based Class-Incremental LearningSungmin Cha, Soonwon Hong, Moontae Lee, Taesup MoonarXiv
  44. 2022
  45. 2022
    Dynamic Dialogue Policy Transformer for Continual Reinforcement LearningChristian Geishauser, Carel van Niekerk, Nurul Lubis … Milica Gavsi'carXiv
  46. 2022
  47. 2022
    PlaStIL: Plastic and Stable Memory-Free Class-Incremental LearningGrégoire Petit, Adrian-Ştefan Popescu, Eden Belouadah … Bertrand DelezoidearXiv
  48. 2022
  49. 2022
    SimCS: Simulation for Online Domain-Incremental Continual SegmentationM. Alfarra, Zhipeng Cai, Adel Bibi … Matthias MüllerarXiv
  50. 2022
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.