Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3451–3500Sort Recent · Most cited
  1. 2023
    Task-Agnostic Continual Reinforcement Learning: Gaining Insights and Overcoming ChallengesM. Caccia, Jonas Mueller, Taesup Kim … Rasool FakoorCoLLAs
    PDF ↗
  2. 2023
    A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental LearningDa-Wei Zhou, Qiwei Wang, Han-Jia Ye, De‐Chuan ZhanICLR
    PDF ↗
  3. 2023
    Continual evaluation for lifelong learning: Identifying the stability gapMatthias De Lange, Gido M. van de Ven, Tinne TuytelaarsICLR
    PDF ↗
  4. 2022
    The Effect of Task Ordering in Continual LearningSamuel J. Bell, Neil D. LawrencearXiv
    PDF ↗
  5. 2022PDF ↗
  6. 2022
    Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual GenerationTu Vu, Aditya Barua, Brian Lester … Noah ConstantEMNLP
    PDF ↗
  7. 2022PDF ↗
  8. 2023PDF ↗
  9. 2022
    StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering ModelsAdam Liška, Tomáš Kočiský, Elena Gribovskaya … Angeliki LazaridouICML
    PDF ↗
  10. 2022
    Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic ManipulationJacky Liang, Mohit Sharma, Alex LaGrassa … Oliver KroemerICRA · Carnegie Mellon University
    PDF ↗
  11. 2022
    AirLoop: Lifelong Loop Closure DetectionDasong Gao, Chen Wang, Sebastian SchererICRA · Carnegie Mellon University
    PDF ↗
  12. 2022
    Incremental Few-Shot Object Detection for RoboticsYiting Li, Haiyue Zhu, Sichao Tian … Tong Heng LeeICRA · National University of Singapore · Agency for Science, Technology and Research · +2
    PDF ↗
  13. 2022PDF ↗
  14. 2023
    Memory-efficient Reinforcement Learning with Value-based Knowledge ConsolidationQingfeng Lan, Yangchen Pan, Jun Luo, A. Rupam MahmoodTMLR
    PDF ↗
  15. 2024
    Continual Pre-Training Mitigates Forgetting in Language and VisionAndrea Cossu, Tinne Tuytelaars, Antonio Carta … Davide BacciuNeural Networks
    PDF ↗
  16. 2022
    How catastrophic can catastrophic forgetting be in linear regression?Itay Evron, Edward Moroshko, Rachel Ward … Daniel SoudryCOLT
    PDF ↗
  17. 2022
    Interpolating Compressed Parameter SubspacesSiddhartha Datta, Nigel ShadboltarXiv
    PDF ↗
  18. 2022PDF ↗
  19. 2022
    Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node ActivationSebastian Lee, Stefano Sarao Mannelli, Claudia Clopath … Andrew SaxearXiv
    PDF ↗
  20. 2022
    A Dirichlet Process Mixture of Robust Task Models for Scalable Lifelong Reinforcement LearningZhi Wang, Chunlin Chen, Daoyi DongIEEE Trans. Cybernetics · Nanjing University · University of Canberra · +1
    PDF ↗
  21. 2022
    Continual learning on 3D point clouds with random compressed rehearsalMaciej Zamorski, Michał Stypułkowski, Konrad Karanowski … Maciej ZiębaComputer Vision and Image Understanding
    PDF ↗
  22. 2022
    On Continual Model Refinement in Out-of-Distribution Data StreamsBill Lin, Sida Wang, Xi Victoria Lin … Wen-tau YihACL
    PDF ↗
  23. 2022
    Explain to Not Forget: Defending Against Catastrophic Forgetting with XAISami Ede, Serop Baghdadlian, Leander Weber … Lapuschkin, SebastianInternational Cross-Domain Conference on Machine Learning…
    PDF ↗
  24. 2022PDF ↗
  25. 2022
    Class-incremental Learning using a Sequence of Partial Implicitly Regularized ClassifiersSobirdzhon Bobiev, Albina Khusainova, Adil Khan, S. M. Ahsan Kazmi... International Florida Artificial Intelligence Researc… · Innopolis University · University of the West of England
    PDF ↗
  26. 2022
    Quantum Continual Learning Overcoming Catastrophic ForgettingWenjie Jiang, Zhide Lu, Dong-Ling DengChinese Physics Letters · Tsinghua University · ShangHai JiAi Genetics & IVF Institute
    PDF ↗
  27. 2022PDF ↗
  28. 2022
    Continual Learning with Foundation Models: An Empirical Study of Latent ReplayОleksiy Ostapenko, Timothée Lesort, Pau Rodríguez … Laurent CharlinCoLLAs
    PDF ↗
  29. 2022PDF ↗
  30. 2022
    Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic EnvironmentsAbhiram Iyer, Karan Grewal, Akash Velu … Subutai AhmadFrontiers · Carnegie Mellon University · Stanford University · +1
    PDF ↗
  31. 2022
    An Adapter Based Pre-Training for Efficient and Scalable Self-Supervised Speech Representation LearningSamuel Kessler, Bethan Thomas, Salah KaroutICASSP · University of Oxford · Huawei Technologies (United Kingdom)
    PDF ↗
  32. 2022
    Progressive Continual Learning for Spoken Keyword SpottingYizheng Huang, Nana Hou, Nancy F. ChenICASSP · Agency for Science, Technology and Research · Institute for Infocomm Research · +1
    PDF ↗
  33. 2022
    From eye-blinks to state construction: Diagnostic benchmarks for online representation learningBanafsheh Rafiee, Zaheer Abbas, Sina Ghiassian … Adam WhiteAdaptive Behavior · University of Alberta · University of Warwick
    PDF ↗
  34. 2022
    Instance exploitation for learning temporary concepts from sparsely labeled drifting data streamsŁukasz Korycki, Bartosz KrawczykPattern Recognition · Virginia Commonwealth University
    PDF ↗
  35. 2022
    Towards Lifelong Learning of Multilingual Text-to-Speech SynthesisMu Yang, Shaojin Ding, Tianlong Chen … Zhangyang WangICASSP · The University of Texas at Dallas · Texas A&M University · +2
    PDF ↗
  36. 2022PDF ↗
  37. 2022PDF ↗
  38. 2022
    Stochastic Coherence Over Attention Trajectory For Continuous Learning In Video StreamsMatteo Tiezzi, Simone Marullo, Lapo Faggi … Stefano MelacciIJCAI
    PDF ↗
  39. 2022PDF ↗
  40. 2022
    Unified Question Generation with Continual Lifelong LearningWei Yuan, Hongzhi Yin, Tieke He … Lizhen CuiACM Web Conference 2022 · The University of Queensland · Nanjing University · +2
    PDF ↗
  41. 2022
    Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and FrameworksKhadija Shaheen, Muhammad Abdullah Hanif, Osman Hasan, Muhammad ShafiqueJournal of Intelligent & Robotic Systems · National University of Sciences and Technology · New York University Abu Dhabi
    PDF ↗
  42. 2023
    Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge DistillationTiantian Zhang, Xueqian Wang, Bin Liang, Bo YuanTNNLS · University Town of Shenzhen · Tsinghua University
    PDF ↗
  43. 2022
    What Is Adult Hippocampal Neurogenesis Good for?Gerd KempermannFrontiers · German Center for Neurodegenerative Diseases · Center for Regenerative Therapies Dresden · +1
    PDF ↗
  44. 2022PDF ↗
  45. 2022
    Experimentally realized memristive memory augmented neural networkRuibin Mao, Bo Wen, Yahui Zhao … Can LiarXiv · University of Hong Kong · University of Notre Dame · +2
    PDF ↗
  46. 2022
    Continual Attentive Fusion for Incremental Learning in Semantic SegmentationGuanglei Yang, Enrico Fini, Dan Xu … Elisa RicciIEEE Trans. Multimedia · University of Trento · Harbin Institute of Technology · +5
    PDF ↗
  47. 2022PDF ↗
  48. 2023
    Generative Negative Replay for Continual LearningGabriele Graffieti, Davide Maltoni, Lorenzo Pellegrini, Vincenzo LomonacoNeural Networks
    PDF ↗
  49. 2022
    Dynamic Dialogue Policy for Continual Reinforcement LearningChristian Geishauser, Carel van Niekerk, Nurul Lubis … Milica GašićCOLING
    PDF ↗
  50. 2022
    Forgetting and Imbalance in Robot Lifelong Learning with Off-policy DataWenxuan Zhou, Steven Bohez, Jan Humplik … Nicolas HeessCoLLAs
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.