Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

505 papers of 4,574 · showing 451–500Sort Recent · Most cited
  1. 2022
    Foundational Models for Continual Learning: An Empirical Study of Latent ReplayOleksiy Ostapenko, Timothée Lesort, P. Rodríguez … Laurent CharlinarXiv
    PDF ↗
  2. 2022
    Task-Agnostic Continual Reinforcement Learning: In Praise of a Simple BaselineMassimo Caccia, Jonas W. Mueller, Taesup Kim … Rasool FakoorarXiv
    PDF ↗
  3. 2022PDF ↗
  4. 2022
    A simple but strong baseline for online continual learning: Repeated Augmented RehearsalYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
  5. 2022
    Scaling the Number of Tasks in Continual LearningTimothée Lesort, Oleksiy Ostapenko, Diganta Misra … I. RisharXiv
    PDF ↗
  6. 2022
    AI Autonomy: Self-Initiation, Adaptation and Continual LearningBing Liu, Sahisnu Mazumder, Eric Robertson, Scott GrigsbyarXiv
    PDF ↗
  7. 2022
    Is Continual Learning Truly Learning Representations Continually?Sungmin Cha, Dongsub Shim, Hyunwoo J. Kim … Taesup MoonarXiv
    PDF ↗
  8. 2022
    Memory Efficient Continual Learning for Neural Text ClassificationB. Ermi̇ş, Giovanni Zappella, Martin Wistuba, C. ArchambeauarXiv
    PDF ↗
  9. 2022PDF ↗
  10. 2022PDF ↗
  11. 2022PDF ↗
  12. 2022PDF ↗
  13. 2022
    Dynamic Dialogue Policy Transformer for Continual Reinforcement LearningChristian Geishauser, Carel van Niekerk, Nurul Lubis … Milica Gavsi'carXiv
    PDF ↗
  14. 2022PDF ↗
  15. 2022
    PlaStIL: Plastic and Stable Memory-Free Class-Incremental LearningGrégoire Petit, Adrian-Ştefan Popescu, Eden Belouadah … Bertrand DelezoidearXiv
    PDF ↗
  16. 2022PDF ↗
  17. 2022
    SimCS: Simulation for Online Domain-Incremental Continual SegmentationM. Alfarra, Zhipeng Cai, Adel Bibi … Matthias MüllerarXiv
    PDF ↗
  18. 2022PDF ↗
  19. 2022
    Continual learning of quantum state classification with gradient episodic memoryHaozhen Situ, Tianxiang Lu, Minghua Pan, Lvzhou LiarXiv
    PDF ↗
  20. 2022PDF ↗
  21. 2022PDF ↗
  22. 2022PDF ↗
  23. 2022
    Robust Saliency Guidance for Data-free Class Incremental LearningXialei Liu, Jiang-Tian Zhai, Andrew D. Bagdanov … Ming-Ming ChengarXiv
    PDF ↗
  24. 2022PDF ↗
  25. 2022
    Modeling the Background for Incremental and Weakly-Supervised Semantic SegmentationFabio Cermelli, Massimiliano Mancini, Samuel Rota Bulo … Barbara CaputoTPAMI · Politecnico di Torino · TH Bingen University of Applied Sciences · +3
    PDF ↗
  26. 2022
    CoMPS: Continual Meta Policy SearchGlen Berseth, Zhiwei Zhang, Grace Zhang … Sergey LevineICLR
    PDF ↗
  27. 2022PDF ↗
  28. 2022
    Controlling Conditional Language Models without Catastrophic ForgettingTomasz Korbak, Hady Elsahar, Germán Kruszewski, Marc DymetmanICML
    PDF ↗
  29. 2022
    Incremental Object Detection via Meta-LearningK J Joseph, Jathushan Rajasegaran, Salman Khan … Vineeth N BalasubramanianTPAMI · Indian Institute of Technology Hyderabad · Mohamed bin Zayed University of Artificial Intelligence
    PDF ↗
  30. 2022
    Provable Lifelong Learning of RepresentationsXinyuan Cao, Weiyang Liu, Santosh VempalaAISTATS · Georgia Institute of Technology · University of Cambridge
    PDF ↗
  31. 2022
    Wide Neural Networks Forget Less CatastrophicallySeyed Iman Mirzadeh, Arslan Chaudhry, Yin, Dong … Mehrdad FarajtabarICML · Google (United States)
    PDF ↗
  32. 2022
    Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime InferenceHyunseo Koh, Dahyun Kim, Jung-Woo Ha, Jonghyun ChoiICLR · Gwangju Institute of Science and Technology
    PDF ↗
  33. 2022PDF ↗
  34. 2022
    Representational Continuity for Unsupervised Continual LearningDivyam Madaan, Jaehong Yoon, Yuanchun Li … Sung Ju HwangICLR
    PDF ↗
  35. 2022
    Subspace Regularizers for Few-Shot Class Incremental LearningAfra Feyza Aky\"urek, Afra Feyza Akyürek, Derry Wijaya, Jacob AndreasICLR
    PDF ↗
  36. 2022
    Towards Continual Knowledge Learning of Language ModelsJoel Jang, Seonghyeon Ye, Sohee Yang … Minjoon SeoICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  37. 2022
    CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and ComparabilityMartin Mundt, Steven Lang, Quentin Delfosse, Kristian KerstingICLR · Technische Universität Darmstadt
    PDF ↗
  38. 2022
    Objects in Semantic TopologyShuo Yang, Peize Sun, Yi Jiang … Min XuICLR
    PDF ↗
  39. 2022
    Sequential Reptile: Inter-Task Gradient Alignment for Multilingual LearningSeanie Lee, Haebeom Lee, Juho Lee, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  40. 2022
    Triple-Memory Networks: A Brain-Inspired Method for Continual LearningLiyuan Wang, Bo Lei, Qian Li … Yi ZhongTNNLS · Chinese Institute for Brain Research · Center for Life Sciences · +1
    PDF ↗
  41. 2022
    Lifelong Teacher-Student Network LearningFei Ye, Adrian G. BorşTPAMI · University of York
    PDF ↗
  42. 2022
    Continual Novelty DetectionRahaf Aljundi, Daniel Olmeda Reino, Nikolay Chumerin, Richard E. TurnerCoLLAs
    PDF ↗
  43. 2022
    Incremental Deep Neural Network Learning Using Classification Confidence ThresholdingJustin Leo, Jugal KalitaTNNLS · University of Colorado Colorado Springs
    PDF ↗
  44. 2022
    Learngene: From Open-World to Your Learning TaskQiufeng Wang, Xin Geng, Shuxia Lin … Ning XuAAAI
    PDF ↗
  45. 2022PDF ↗
  46. 2022
    Online Coreset Selection for Rehearsal-based Continual LearningJaehong Yoon, Divyam Madaan, Eunho Yang, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  47. 2022
    Using top-down modulation to optimally balance shared versus separated task representationsPieter Verbeke, Tom VergutsNeural Networks · Ghent University Hospital
    PDF ↗
  48. 2022
    TAG: Task-based Accumulated Gradients for Lifelong learningPranshu Malviya, Balaraman Ravindran, Sarath ChandarCoLLAs
    PDF ↗
  49. 2022
    Memory-Efficient Class-Incremental Learning for Image ClassificationHanbin Zhao, Hui Wang, Yongjian Fu … Xi LiTNNLS · Zhejiang University of Science and Technology · Shanghai Advanced Research Institute
    PDF ↗
  50. 2022
    How Well Does Self-Supervised Pre-Training Perform with Streaming Data?Dapeng Hu, Shipeng Yan, Qizhengqiu Lu … Jiashi FengICLR
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.