Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

83 papers of 6,984 · showing 51–83Sort Recent · Most cited
  1. 2020
    Learning Causal Models OnlineKhurram Javed, Martha White, Yoshua BengioarXiv
    PDF ↗
  2. 2020
    BI-MAML: Balanced Incremental Approach for Meta LearningYang Zheng, Jinlin Xiang, Kun Su, Eli ShlizermanarXiv
    PDF ↗
  3. 2020
    Collaborative and continual learning for classification tasks in a society of devicesFernando E. Casado, Dylan Lema, Roberto Iglesias … Senén BarroarXiv
    PDF ↗
  4. 2020
    Move-to-Data: A new Continual Learning approach with Deep CNNs, Application for image-class recognitionMiltiadis Poursanidis, Jenny Benois‐Pineau, Akka Zemmari … Aymar de RugyarXiv · Laboratoire Bordelais de Recherche en Informatique · Institut de Neurosciences Cognitives et Intégratives d’Aquitaine
    PDF ↗
  5. 2020
    Understanding Regularisation Methods for Continual LearningFrederik BenzingarXiv · École Polytechnique Fédérale de Lausanne
    PDF ↗
  6. 2020
    Self-Supervised Learning Aided Class-Incremental Lifelong LearningSong Zhang, Gehui Shen, Huang, Jinsong, Deng, Zhi-HongarXiv · Peking University
    PDF ↗
  7. 2020
    Progressive growing of self-organized hierarchical representations for explorationMayalen Etcheverry, Pierre‐Yves Oudeyer, Chris ReinkearXiv
    PDF ↗
  8. 2020
    Continual Learning Using Task Conditional Neural NetworksHaoyu Li, Payam Barnaghi, Shirin Enshaeifar, Frieder GanzarXiv
    PDF ↗
  9. 2020
  10. 2020
    Visually Grounded Continual Learning of Compositional SemanticsXisen Jin, Junyi Du, Arka Sadhu … Xiang RenarXiv · University of Southern California · California Southern University
    PDF ↗
  11. 2020
    Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual LearningZihan Liu, Genta Indra Winata, Andrea Madotto, Pascale FungarXiv · Hong Kong University of Science and Technology
    PDF ↗
  12. 2020PDF ↗
  13. 2020
    Neural Network Retraining for Model ServingDiego Klabjan, Xiaofeng ZhuarXiv
    PDF ↗
  14. 2020
    Lifelong Learning Process: Self-Memory Supervising and Dynamically Growing NetworksYoucheng Huang, Tangchen Wei, Jundong Zhou, Chunxin YangarXiv
    PDF ↗
  15. 2020PDF ↗
  16. 2020
    Bayesian Nonparametric Weight Factorization for Continual LearningNikhil Mehta, Kevin J Liang, Vinay Kumar Verma, Lawrence CarinarXiv
    PDF ↗
  17. 2020
    Continual Reinforcement Learning with Multi-Timescale ReplayChristos Kaplanis, Claudia Clopath, Murray ShanahanarXiv · Imperial College London
    PDF ↗
  18. 2020
    Defining Benchmarks for Continual Few-Shot LearningAntreas Antoniou, Massimiliano Patacchiola, Mateusz Ochal, Amos StorkeyarXiv · University of Edinburgh
    PDF ↗
  19. 2020
    CALM: Continuous Adaptive Learning for Language ModelingKristjan Arumae, Parminder BhatiaarXiv · Amazon (Germany)
    PDF ↗
  20. 2020
    Class-Agnostic Continual Learning of Alternating Languages and DomainsGermán Kruszewski, Ionut Sorodoc, Tomáš MikolovarXiv · Naver (South Korea) · Universitat Pompeu Fabra
    PDF ↗
  21. 2020
    Improved Pretraining for Domain-specific Contextual Embedding ModelsSubendhu Rongali, Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong YuarXiv · University of Massachusetts Amherst
    PDF ↗
  22. 2020
    Towards Lifelong Self-Supervision For Unpaired Image-to-Image TranslationVictor Schmidt, Makesh Narsimhan Sreedhar, Mostafa ElAraby, Irina RisharXiv
    PDF ↗
  23. 2020
    Adaptive Group Sparse Regularization for Continual LearningSangwon Jung, Hongjoon Ahn, Sungmin Cha, Taesup MoonarXiv
  24. 2020
    Continual Graph LearningFan Zhou, Chengtai CaoarXiv
    PDF ↗
  25. 2020
    Lifelong Learning with Searchable Extension UnitsWenjin Wang, Yunqing Hu, Yin Zhang⋆arXiv · Zhejiang University
    PDF ↗
  26. 2020
    Evaluating Logical Generalization in Graph Neural NetworksKoustuv Sinha, Shagun Sodhani, Joëlle Pineau, William L. HamiltonarXiv · McGill University
    PDF ↗
  27. 2020
    Federated Continual Learning with Adaptive Parameter CommunicationJaehong Yoon, Wonyong Jeong, Giwoong Lee … Sung Ju HwangarXiv
  28. 2020
    On Catastrophic Interference in Atari 2600 GamesWilliam Fedus, Dibya Ghosh, John D. Martin … Hugo LarochellearXiv
    PDF ↗
  29. 2020PDF ↗
  30. 2020
    Continual Universal Object DetectionXialei Liu, Hao Yang, Avinash Ravichandran … Stefano SoattoarXiv · Universitat Autònoma de Barcelona · Amazon (Germany)
    PDF ↗
  31. 2020
    A Novel Incremental Cross-Modal Hashing ApproachDevraj Mandal, Soma BiswasarXiv · Indian Institute of Science Bangalore
    PDF ↗
  32. 2020
    Ternary Feature Masks: continual learning without any forgettingMarc Masana, T. Tuytelaars, Joost van de WeijerarXiv
    PDF ↗
  33. 2020
    Dissecting Catastrophic Forgetting in Continual Learning by Deep VisualizationGiang Nguyen, Chen Shuan, Thao Do … Daeyoung KimarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.