Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

505 papers of 4,574 · showing 351–400Sort Recent · Most cited
  1. 2022
    Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with MomentumKirby Banman, Liam Peet-Pare, Nidhi Hegde … Martha WhiteICLR
    PDF ↗
  2. 2022
    Online Continual Learning for Embedded DevicesTyler L. Hayes, Christopher KananCoLLAs
    PDF ↗
  3. 2022
    Federated Learning and catastrophic forgetting in pervasive computing: demonstration in HAR domainAnastasiia Usmanova, François Portet, Philippe Lalanda, Germán VegaIEEE International Conference on Pervasive Computing and… · Université Grenoble Alpes · Laboratoire d'Informatique de Grenoble · +2
    PDF ↗
  4. 2022PDF ↗
  5. 2022
    A Closer Look at Knowledge Distillation with Features, Logits, and GradientsYen-Chang Hsu, James Smith, Yilin Shen … Hongxia JinarXiv
    PDF ↗
  6. 2022
    ConTinTin: Continual Learning from Task InstructionsWenpeng Yin, Jia Li, Caiming XiongACL
    PDF ↗
  7. 2022PDF ↗
  8. 2022
    L2Explorer: A Lifelong Reinforcement Learning Assessment EnvironmentErik C. Johnson, Eric Q. Nguyen, Blake A. Schreurs … Gautam K. VallabhaarXiv
    PDF ↗
  9. 2022
    Continual Prompt Tuning for Dialog State TrackingQi Zhu, Bing Li, Fei Mi … Minlie HuangACL
    PDF ↗
  10. 2022
    Sequential changepoint detection in neural networks with checkpointsMichalis K. Titsias, Jakub Sygnowski, Yutian ChenStatistics and Computing · Google DeepMind (United Kingdom)
    PDF ↗
  11. 2022
    ELLE: Efficient Lifelong Pre-training for Emerging DataYujia Qin, Jiajie Zhang, Yankai Lin … Jie ZhouACL
    PDF ↗
  12. 2022
    Sparsity and Heterogeneous Dropout for Continual Learning in the Null Space of Neural ActivationsAli Abbasi, Parsa Nooralinejad, Vladimir Braverman … Soheil KolouriCoLLAs
    PDF ↗
  13. 2022
    Mind Your Manners! A Dataset and a Continual Learning Approach for Assessing Social Appropriateness of Robot ActionsJonas Tjomsland, Sinan Kalkan, Hatice GüneşFrontiers · University of Cambridge · Middle East Technical University
    PDF ↗
  14. 2022
    Controlling Soft Robotic Arms Using Continual LearningFrancesco Piqué, Hari Teja Kalidindi, Lorenzo Fruzzetti … Egidio FaloticoRA-L · Scuola Superiore Sant'Anna · National University of Singapore
    PDF ↗
  15. 2022PDF ↗
  16. 2022
    Lifelong 3D Object Recognition and Grasp Synthesis Using Dual Memory Recurrent Self-Organization NetworksKrishnakumar Santhakumar, Hamidreza KasaeiNeural Networks · University of Groningen
    PDF ↗
  17. 2022PDF ↗
  18. 2022
    Acceleration of Federated Learning with Alleviated Forgetting in Local TrainingChencheng Xu, Zhiwei Hong, Minlie Huang, Tao JiangICLR
    PDF ↗
  19. 2022PDF ↗
  20. 2022
    Provable and Efficient Continual Representation LearningYingcong Li, Mingchen Li, M. Salman Asif, Samet OymakarXiv
    PDF ↗
  21. 2022PDF ↗
  22. 2022
    Continual Learning of Multi-modal Dynamics with External MemoryAbdullah Akgül, Gözde Ünal, Melih KandemirConference on Learning for Dynamics & Control · University of Southern Denmark · Istanbul Technical University
    PDF ↗
  23. 2022
    A Versatile Agent for Fast Learning from Human InstructorsYiwen Chen, Zedong Zhang, Haofeng Liu … Marcelo H. AngarXiv
    PDF ↗
  24. 2022
    BERT WEAVER: Using WEight AVERaging to Enable Lifelong Learning for Transformer-based ModelsKühnel, Lisa, Alexander Schulz, Barbara Hammer, Juliane FluckarXiv
    PDF ↗
  25. 2022
    Diagnosing Batch Normalization in Class Incremental LearningMinghao Zhou, Quanziang Wang, Jun Shu … Deyu MengarXiv
    PDF ↗
  26. 2022
    Memory Replay with Data Compression for Continual LearningLiyuan Wang, Xingxing Zhang, Kuo Yang … Jun ZhuICLR
    PDF ↗
  27. 2022PDF ↗
  28. 2022PDF ↗
  29. 2022
    Graph Few-shot Class-incremental LearningZhen Tan, Kaize Ding, Ruocheng Guo, Huan LiuWSDM · Arizona State University · City University of Hong Kong
    PDF ↗
  30. 2022
    Deep Bayesian Unsupervised Lifelong LearningTingting Zhao, Zifeng Wang, Aria Masoomi, Jennifer DyNeural Networks · Bryant University · Bryan College · +1
    PDF ↗
  31. 2022
    A Neural Network Model of Continual Learning with Cognitive ControlJacob Russin, Maryam Zolfaghar, Seongmin A. Park … Randall C. O’ReillyCognitive Science
    PDF ↗
  32. 2022PDF ↗
  33. 2022
    TRGP: Trust Region Gradient Projection for Continual LearningSen Lin, Li Yang, Deliang Fan, Junshan ZhangICLR
    PDF ↗
  34. 2022
    Improving Pedestrian Prediction Models With Self-Supervised Continual LearningLuzia Knoedler, Chadi Salmi, Hai Zhu … Javier Alonso–MoraRA-L · Delft University of Technology
    PDF ↗
  35. 2022
    Catastrophic Forgetting in Deep Graph Networks: A Graph Classification BenchmarkAntonio Carta, Andrea Cossu, Federico Errica, Davide BacciuFrontiers · University of Pisa · Scuola Normale Superiore
    PDF ↗
  36. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  37. 2022PDF ↗
  38. 2022PDF ↗
  39. 2022PDF ↗
  40. 2022
    PaRT: Parallel Learning Towards Robust and Transparent AIM Paknezhad, Hamsawardhini Rengarajan, Chenghao Yuan … Lee, Hwee KuanarXiv
    PDF ↗
  41. 2022
    The CLEAR Benchmark: Continual LEArning on Real-World ImageryZhiqiu Lin, Jia Shi, Deepak Pathak, Deva RamananNeurIPS
    PDF ↗
  42. 2022
    Lifelong Generative Learning via Knowledge ReconstructionLibo Huang, Zhulin An, Xiang Zhi, Yongjun XuarXiv
    PDF ↗
  43. 2022PDF ↗
  44. 2022
    Brain-inspired global-local learning incorporated with neuromorphic computingYujie Wu, Rong Zhao, Jun Zhu … Luping ShiNature Communications · Tsinghua University · Chinese Institute for Brain Research · +1
    PDF ↗
  45. 2022PDF ↗
  46. 2022PDF ↗
  47. 2022
    Towards Unsupervised Open World Semantic SegmentationSvenja Uhlemeyer, Matthias Rottmann, Hanno GottschalkUAI
    PDF ↗
  48. 2022
    TimeLMs: Diachronic Language Models from TwitterDaniel Loureiro, Francesco Barbieri, Leonardo Neves … Jose Camacho-colladosACL · Universidade do Porto · Snap (United States) · +2
    PDF ↗
  49. 2022
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  50. 2022
    Fine-tuned Language Models are Continual LearnersThomas Scialom, Tuhin Chakrabarty, Smaranda MuresanEMNLP · University of Missouri · Columbia University
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.