Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

35 papers of 6,984Sort Recent · Most cited
  1. 2022
    Exact learning dynamics of deep linear networks with prior knowledgeClémentine Dominé, Lukas Braun, James E. Fitzgerald, Andrew SaxeNeurIPS · Gatsby Computational Neuroscience Unit · University College London · +4
  2. 2022
    Wild-Time: A Benchmark of in-the-Wild Distribution Shift over TimeHuaxiu Yao, Caroline Choi, Bochuan Cao … Chelsea FinnNeurIPS
    PDF ↗
  3. 2022
    Mining Unseen Classes via Regional Objectness: A Simple Baseline for Incremental SegmentationZekang Zhang, Guangyu Gao, Zhiyuan Fang … Yunchao WeiNeurIPS
    PDF ↗
  4. 2022
    A Theoretical Study on Solving Continual LearningGyuhak Kim, Changnan Xiao, Tatsuya Konishi … Bing LiuNeurIPS
    PDF ↗
  5. 2022
    Learning a Condensed Frame for Memory-Efficient Video Class-Incremental LearningYixuan Pei, Zhiwu Qing, Jun Cen … Xueming QianNeurIPS
    PDF ↗
  6. 2022
    Beyond Not-Forgetting: Continual Learning with Backward Knowledge TransferSen Lin, Li Yang, Deliang Fan, Junshan ZhangNeurIPS
    PDF ↗
  7. 2022
    An analytical theory of curriculum learning in teacher–student networksLuca Saglietti, Stefano Sarao Mannelli, Andrew SaxeNeurIPS · Bocconi University · Gatsby Computational Neuroscience Unit · +1
    PDF ↗
  8. 2022PDF ↗
  9. 2022PDF ↗
  10. 2022
    On the Effectiveness of Lipschitz-Driven Rehearsal in Continual LearningLorenzo Bonicelli, M. Boschini, Angelo Porrello … Simone CalderaraNeurIPS
    PDF ↗
  11. 2022
    Decomposed Knowledge Distillation for Class-Incremental Semantic SegmentationDonghyeon Baek, Youngmin Oh, Sanghoon Lee … Bumsub HamNeurIPS
    PDF ↗
  12. 2022PDF ↗
  13. 2022PDF ↗
  14. 2022
    Few-Shot Continual Active Learning by a RobotAli Ayub, Carter FendleyNeurIPS
    PDF ↗
  15. 2022
    Disentangling Transfer in Continual Reinforcement LearningMaciej Wołczyk, Michał Zając, Razvan Pascanu … Piotr MiłośNeurIPS
    PDF ↗
  16. 2022
    Exploring Example Influence in Continual LearningQing Sun, Fan Lyu, Fanhua Shang … Liang WanNeurIPS
    PDF ↗
  17. 2022
    SparCL: Sparse Continual Learning on the EdgeZifeng Wang, Zheng Zhan, Yifan Gong … Jennifer DyNeurIPS
    PDF ↗
  18. 2022PDF ↗
  19. 2022
    Repairing Neural Networks by Leaving the Right Past BehindRyutaro Tanno, Melanie F. Pradier, Aditya Nori, Yingzhen LiNeurIPS
    PDF ↗
  20. 2022
    Lifelong Inverse Reinforcement LearningJorge A. Mendez, Shashank Shivkumar, Eric EatonNeurIPS · University of Pennsylvania · Philadelphia University
    PDF ↗
  21. 2022
    CLiMB: A Continual Learning Benchmark for Vision-and-Language TasksTejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva … Jesse ThomasonNeurIPS
    PDF ↗
  22. 2022PDF ↗
  23. 2022
    ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy ProtectionHuiping Zhuang, Zhenyu Weng, Wei, Hongxin … Zhiping LinNeurIPS
    PDF ↗
  24. 2022PDF ↗
  25. 2022
    The CLEAR Benchmark: Continual LEArning on Real-World ImageryZhiqiu Lin, Jia Shi, Deepak Pathak, Deva RamananNeurIPS
    PDF ↗
  26. 2022
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  27. 2022
    CGLB: Benchmark Tasks for Continual Graph LearningXikun Zhang, Dongjin Song, Dacheng TaoNeurIPS
  28. 2022
    Memory Efficient Continual Learning with TransformersBeyza Ermis, Giovanni Zappella, Martin Wistuba … Cédric ArchambeauNeurIPS
    PDF ↗
  29. 2022
    Repeated Augmented Rehearsal: A Simple but Strong Baseline for Online Continual LearningYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
  30. 2022
    Retrospective Adversarial Replay for Continual LearningLilly Kumari, Shengjie Wang, Tianyi Zhou, Jeff BilmesNeurIPS
  31. 2022
  32. 2022
    Continual Learning In Environments With Polynomial Mixing TimesMatthew Riemer, Sharath Chandra Raparthy, Ignacio Cases … Irina RishNeurIPS
    PDF ↗
  33. 2022
    Continual Learning with Evolving Class OntologiesZhiqiu Lin, Deepak Pathak, Yu-Xiong Wang … Shu KongNeurIPS
    PDF ↗
  34. 2022
  35. 2022
    A simple but strong baseline for online continual learning: Repeated Augmented RehearsalYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.