Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

32 papers of 6,984Sort Recent · Most cited
  1. 2023PDF ↗
  2. 2023PDF ↗
  3. 2023
    Towards Open Temporal Graph Neural NetworksKaituo Feng, Changsheng Li, Xiaolu Zhang, Jun ZhouICLR
    PDF ↗
  4. 2023
    Sparse Distributed Memory is a Continual LearnerTrenton Bricken, Xander Davies, Deepak Singh … Gabriel KreimanICLR
    PDF ↗
  5. 2023
    Is forgetting less a good inductive bias for forward transfer?Jiefeng Chen, Timothy Nguyen, Dilan Görür, Arslan ChaudhryICLR
    PDF ↗
  6. 2023PDF ↗
  7. 2023
    Better Generative Replay for Continual Federated LearningDaiqing Qi, Handong Zhao, Sheng LiICLR
    PDF ↗
  8. 2023
    New Insights for the Stability-Plasticity Dilemma in Online Continual LearningDahuin Jung, Dongjin Lee, Sunwon Hong … Sungroh YoonICLR
    PDF ↗
  9. 2023PDF ↗
  10. 2023PDF ↗
  11. 2023
    Continual Pre-training of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bing LiuICLR
    PDF ↗
  12. 2023PDF ↗
  13. 2023
    Progressive Prompts: Continual Learning for Language ModelsAnastasia Razdaibiedina, Yuning Mao, Rui Hou … Amjad AlmahairiICLR
    PDF ↗
  14. 2023
    DEJA VU: Continual Model Generalization For Unseen DomainsChenxi Liu, Lixu Wang, Lingjuan Lyu … Qi ZhuICLR
    PDF ↗
  15. 2023
    Artificial Neuronal Ensembles with Learned Context Dependent GatingM. J. Tilley, Michelle Miller, David A. FreedmanICLR
    PDF ↗
  16. 2023
  17. 2023
  18. 2023
    Online Bias Correction for Task-Free Continual LearningA. Chrysakis, Marie-Francine MoensICLR
  19. 2023
    Online Boundary-Free Continual Learning by Scheduled Data PriorHyun-woo Koh, M. Seo, Jihwan Bang … Jonghyun ChoiICLR
  20. 2023
  21. 2023
    Continual Learning of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bin LiuICLR
  22. 2023
  23. 2023
    Optimizing Spca-based Continual Learning: A Theoretical ApproachChunchun Yang, Malik Tiomoko, Zengfu WangICLR
  24. 2023
    Self-Supervised Continual LearningK. Thakral, S. Mittal, Utkarsh Uppal … Richa SinghICLR
  25. 2023
  26. 2023
    Building a Subspace of Policies for Scalable Continual LearningJean-Baptiste Gaya, Thang Doan, Lucas Caccia … Roberta RăileanuICLR · Sorbonne Université · Institut Systèmes Intelligents et de Robotique · +2
    PDF ↗
  27. 2023
    On the Soft-Subnetwork for Few-shot Class Incremental LearningHaeyong Kang, Jaehong Yoon, Sultan Rizky Hikmawan Madjid … Chang D. YooICLR
    PDF ↗
  28. 2023
    A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental LearningDa-Wei Zhou, Qiwei Wang, Han-Jia Ye, De‐Chuan ZhanICLR
    PDF ↗
  29. 2023
    Continual evaluation for lifelong learning: Identifying the stability gapMatthias De Lange, Gido M. van de Ven, Tinne TuytelaarsICLR
    PDF ↗
  30. 2023PDF ↗
  31. 2023
    Learning Fast and Slow for Online Time Series ForecastingQuang Pham, Chenghao Liu, Doyen Sahoo, Steven C. H. HoiICLR
    PDF ↗
  32. 2023
    Incremental Learning of Structured Memory via Closed-Loop TranscriptionShengbang Tong, Xili Dai, Ziyang Wu … Yi MaICLR
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.