Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

352 papers of 4,574 · showing 301–350Sort Recent · Most cited
  1. 2021
    Continual Learning for Grounded Instruction Generation by Observing Human Following BehaviorNoriyuki Kojima, Alane Suhr, Yoav ArtziTACL · Cornell University · Cornell Tech
    PDF ↗
  2. 2021
    Lifelong Learning of Hate Speech Classification on Social MediaJing Qian, Hong Wang, Mai ElSherief, Xifeng YanNAACL · Georgia Institute of Technology · University of California, Santa Barbara
    PDF ↗
  3. 2021
    Do not Forget to Attend to Uncertainty while Mitigating Catastrophic ForgettingVinod K Kurmi, Badri N. Patro, Venkatesh K. Subramanian, Vinay P. NamboodiriWACV · Indian Institute of Technology Kanpur · University of Bath
    PDF ↗
  4. 2021
    SPACE: Structured Compression and Sharing of Representational Space for Continual LearningGobinda Saha, Isha Garg, Aayush Ankit, Kaushik RoyIEEE Access · Purdue University West Lafayette
    PDF ↗
  5. 2021
    Preserving Cross-Linguality of Pre-trained Models via Continual LearningZihan Liu, Genta Indra Winata, Andrea Madotto, Pascale FungWorkshop on Representation Learning for NLP (RepL4NLP-2021) · Hong Kong University of Science and Technology
    PDF ↗
  6. 2021
    Overcoming Catastrophic Forgetting Using Sparse Coding and Meta LearningJulio Hurtado, Hans Löbel, Álvaro SotoIEEE Access · Pontificia Universidad Católica de Chile
    PDF ↗
  7. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  8. 2021
    Continual Learning with Echo State NetworksAndrea Cossu, Davide Bacciu, Antonio Carta … Vincenzo LomonacoESANN 2021 proceedings · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  9. 2021
    Total Recall: a Customized Continual Learning Method for Neural Semantic ParsersZhuang Li, Lizhen Qu, Gholamreza HaffariEMNLP · Monash University
    PDF ↗
  10. 2021
    Elastic weight consolidation for better bias inoculationJames Thorne, Andreas VlachosEACL · University of Cambridge
    PDF ↗
  11. 2021
    Mitigating Mode Collapse by Sidestepping Catastrophic ForgettingKarttikeya Mangalam, Rohin GargBMVC · University of California, Berkeley · Indian Institute of Technology Kanpur
    PDF ↗
  12. 2021
    Continual Learning with Differential PrivacyPradnya Desai, Phung Lai, NhatHai Phan, My T. ThaiSpringer CCIS · New Jersey Institute of Technology · University of Florida
    PDF ↗
  13. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
  14. 2021
    Explaining How Deep Neural Networks Forget by Deep VisualizationGiang V. Nguyen, Chen Shuan, Tae Joon Jun, Daeyoung KimSpringer LNCS · Korea Advanced Institute of Science and Technology · Ansan University
    PDF ↗
  15. 2021
    Sustainable Artificial Intelligence through Continual LearningAndrea Cossu, Marta Ziosi, Vincenzo LomonacoInternational Conference on AI for People: Towards Sustai… · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  16. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  17. 2021PDF ↗
  18. 2021
    Lifelong Knowledge-Enriched Social Event Representation LearningPrashanth Vijayaraghavan, Deb RoyEACL · IIT@MIT · Human Media
    PDF ↗
  19. 2021
    Class-incremental Learning with Rectified Feature-Graph PreservationCheng-Hsun Lei, Yi-Hsin Chen, Wen-Hsiao Peng, Wei-Chen ChiuSpringer LNCS · National Yang Ming Chiao Tung University
    PDF ↗
  20. 2021
    HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined ClassificationKai Wang, Xialei Liu, Luis Herranz, Joost van de WeijerBMVC · Universitat Autònoma de Barcelona · Nankai University
    PDF ↗
  21. 2021
    Hyperparameter-free Continuous Learning for Domain Classification in Natural Language UnderstandingTing Hua, Yilin Shen, Changsheng Zhao … Hongxia JinNAACL · Samsung (United States) · Research!America (United States)
    PDF ↗
  22. 2021
    On robustness of generative representations against catastrophic forgettingWojciech Masarczyk, Kamil Rafał Deja, T. P. TrzcinskiSpringer CCIS · Warsaw University of Technology · Jagiellonian University
    PDF ↗
  23. 2021
    Homeostasis-Inspired Continual Learning: Learning to Control Structural RegularizationJoonyoung Kim, Hyowoon Seo, Wan Choi, Kyomin JungIEEE Access · Seoul National University · University of Oulu · +1
    PDF ↗
  24. 2021
    Incremental Learning for Animal Pose Estimation using RBF k-DPPGaurav Kumar Nayak, Het Shah, Anirban ChakrabortyBMVC · Indian Institute of Science Bangalore
    PDF ↗
  25. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  26. 2021
    Lifelong Learning from Event-based DataVadym Gryshchuk, Cornelius Weber, Chu Kiong Loo, Stefan WermterESANN 2021 proceedings · Universität Hamburg · University of Malaya
    PDF ↗
  27. 2021
    Lifelong Explainer for Lifelong LearnersXuelin Situ, Sameen Maruf, Ingrid Zukerman … Gholamreza HaffariEMNLP · Monash University · Commonwealth Scientific and Industrial Research Organisation · +2
    PDF ↗
  28. 2021PDF ↗
  29. 2021
    Efficient Continual Learning with Modular Networks and Task-Driven PriorsTom Véniat, Ludovic Denoyer, Marc’Aurelio RanzatoICLR · Meta (United States)
    PDF ↗
  30. 2021
    River: machine learning for streaming data in PythonJacob Montiel, Max Halford, Saulo Martiello Mastelini … Albert BifetJMLR · University of Waikato · Universidade de São Paulo · +14
    PDF ↗
  31. 2021
    A Comprehensive Study of Class Incremental Learning Algorithms for Visual TasksEden Belouadah, Adrian Popescu, Ioannis KanellosNeural Networks · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +2
    PDF ↗
  32. 2021
    Reset-Free Lifelong Learning with Skill-Space PlanningKevin Lü, Aditya Grover, Pieter Abbeel, Igor MordatchICLR · University of California, Berkeley · Stanford University · +1
    PDF ↗
  33. 2021
    Generalized Variational Continual LearningNoel Loo, Siddharth Swaroop, Richard E. TurnerICLR · University of Cambridge
    PDF ↗
  34. 2021
    Linear Mode Connectivity in Multitask and Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Görür … Hassan GhasemzadehICLR · Washington State University · Google (United States)
    PDF ↗
  35. 2021
    A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap MatrixThang Doan, Mehdi Bennani, Bogdan Mazoure … Pierre AlquierAISTATS
    PDF ↗
  36. 2021
    Remembering for the Right Reasons: Explanations Reduce Catastrophic ForgettingSayna Ebrahimi, S. Petryk, Akash Gokul … Trevor DarrellICLR
    PDF ↗
  37. 2021
    Continual Learning Using Bayesian Neural NetworksHonglin Li, Payam Barnaghi, Shirin Enshaeifar, Frieder GanzTNNLS · University of Surrey · UK Dementia Research Institute · +1
    PDF ↗
  38. 2021
    Incremental Concept Learning via Online Generative Memory RecallHuaiyu Li, Weiming Dong, Bao-Gang HuTNNLS · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +2
    PDF ↗
  39. 2021
    Lifelong Learning of Compositional StructuresJorge A. Mendez, Eric EatonICLR · California University of Pennsylvania · University of Pennsylvania
    PDF ↗
  40. 2021
    Anatomy of Catastrophic Forgetting: Hidden Representations and Task SemanticsVinay Ramasesh, Ethan Dyer, Maithra RaghuICLR · Google (United States) · Cornell University
    PDF ↗
  41. 2021
    Graph-Based Continual LearningBinh Tang, David S. MattesonICLR · Cornell University
    PDF ↗
  42. 2021
    Wandering within a World: Online Contextualized Few-Shot LearningMengye Ren, Michael L. Iuzzolino, Michael C. Mozer, Richard S. ZemelICLR · University of Toronto · University of Colorado Boulder · +1
    PDF ↗
  43. 2021
    IncDet: In Defense of Elastic Weight Consolidation for Incremental Object DetectionLiyang Liu, Zhanghui Kuang, Yimin Chen … Wayne ZhangTNNLS · University Town of Shenzhen · Tsinghua University · +2
    PDF ↗
  44. 2021PDF ↗
  45. 2021
    CPR: Classifier-Projection Regularization for Continual LearningSungmin Cha, Hsiang Hsu, Taebaek Hwang … Taesup MoonICLR
    PDF ↗
  46. 2021
    Variational Auto-Regressive Gaussian Processes for Continual LearningSanyam Kapoor, Theofanis Karaletsos, Thang D. BuiICML · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +3
    PDF ↗
  47. 2021
    Addressing Catastrophic Forgetting in Few-Shot ProblemsPauching Yap, Hippolyt Ritter, David BarberICML · University College London
    PDF ↗
  48. 2021
    Federated Continual Learning with Weighted Inter-client TransferJaehong Yoon, Wonyong Jeong, Giwoong Lee … Sung Ju HwangICML · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  49. 2021
    Direction Concentration Learning: Enhancing Congruency in Machine LearningYan Luo, Yongkang Wong, Mohan Kankanhalli, Qi ZhaoTPAMI · University of Minnesota · National University of Singapore
    PDF ↗
  50. 2021
    Hierarchical Indian buffet neural networks for Bayesian continual learningSamuel Kessler, Vu Nguyen, Stefan Zohren, Stephen RobertsUAI · University of Oxford · Science Oxford
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.