Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

240 papers of 4,574 · showing 151–200Sort Recent · Most cited
  1. 2020PDF ↗
  2. 2020
    Neural Network Retraining for Model ServingDiego Klabjan, Xiaofeng ZhuarXiv
    PDF ↗
  3. 2020
    Small-Task Incremental LearningArthur Douillard, M. Cord, Charles Ollion … E. ValleECCV
    PDF ↗
  4. 2020
    Lifelong Learning Process: Self-Memory Supervising and Dynamically Growing NetworksYoucheng Huang, Tangchen Wei, Jundong Zhou, Chunxin YangarXiv
    PDF ↗
  5. 2020PDF ↗
  6. 2020
    Efficient Adaptation for End-to-End Vision-Based Robotic ManipulationRyan Julian, Benjamin Swanson, Gaurav S. Sukhatme … Karol HausmanRSS
    PDF ↗
  7. 2020
    Bayesian Nonparametric Weight Factorization for Continual LearningNikhil Mehta, Kevin J Liang, Vinay Kumar Verma, Lawrence CarinarXiv
    PDF ↗
  8. 2020
    Continual Reinforcement Learning with Multi-Timescale ReplayChristos Kaplanis, Claudia Clopath, Murray ShanahanarXiv · Imperial College London
    PDF ↗
  9. 2020
    Dark Experience for General Continual Learning: a Strong, Simple BaselinePietro Buzzega, Matteo Boschini, Angelo Porrello … Simone CalderaraNeurIPS · University of Modena and Reggio Emilia
    PDF ↗
  10. 2020
    Defining Benchmarks for Continual Few-Shot LearningAntreas Antoniou, Massimiliano Patacchiola, Mateusz Ochal, Amos StorkeyarXiv · University of Edinburgh
    PDF ↗
  11. 2020
    Self-Net: Lifelong Learning via Continual Self-ModelingJaya Krishna Mandivarapu, Blake Camp, Rolando EstradaFrontiers · Georgia State University
    PDF ↗
  12. 2020
    CALM: Continuous Adaptive Learning for Language ModelingKristjan Arumae, Parminder BhatiaarXiv · Amazon (Germany)
    PDF ↗
  13. 2020
    Class-Agnostic Continual Learning of Alternating Languages and DomainsGermán Kruszewski, Ionut Sorodoc, Tomáš MikolovarXiv · Naver (South Korea) · Universitat Pompeu Fabra
    PDF ↗
  14. 2020
    Improved Pretraining for Domain-specific Contextual Embedding ModelsSubendhu Rongali, Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong YuarXiv · University of Massachusetts Amherst
    PDF ↗
  15. 2020
    Towards Making the Most of BERT in Neural Machine TranslationJiacheng Yang, Mingxuan Wang, Hao Zhou … Lei LiAAAI · Shanghai Jiao Tong University
    PDF ↗
  16. 2020
    Overcoming Catastrophic Forgetting by Neuron-level Plasticity ControlInyoung Paik, Sangjun Oh, Tae-Yeong Kwak, Injung KimAAAI · Handong Global University
    PDF ↗
  17. 2020
    Generative Continual Concept LearningMohammad Rostami, Soheil Kolouri, Praveen K. Pilly, James L. McClellandAAAI · California University of Pennsylvania · HRL Laboratories (United States) · +1
    PDF ↗
  18. 2020
    DeGAN : Data-Enriching GAN for Retrieving Representative Samples from a Trained ClassifierSravanti Addepalli, Gaurav Kumar Nayak, Anirban Chakraborty, Venkatesh Babu RadhakrishnanAAAI · Indian Institute of Science Bangalore
    PDF ↗
  19. 2020
    Lifelong Learning with a Changing Action SetYash Chandak, Georgios Theocharous, Chris Nota, Philip S. ThomasAAAI · University of Massachusetts Amherst · Adobe Systems (United States)
    PDF ↗
  20. 2020
    Incremental multi-domain learning with network latent tensor factorizationAdrian Bulat, Jean Kossaifi, Georgios Tzimiropoulos, Maja PantićAAAI · Samsung (United States)
    PDF ↗
  21. 2020
    Learning from the Past: Continual Meta-Learning with Bayesian Graph Neural NetworksYadan Luo, Zi Huang, Zheng Zhang … Yang YangAAAI · The University of Queensland · Harbin Institute of Technology · +1
    PDF ↗
  22. 2020
    Residual Continual LearningJanghyeon Lee, Donggyu Joo, Hyeong Gwon Hong, Junmo KimAAAI · Korea Advanced Institute of Science and Technology · Kootenay Association for Science & Technology
    PDF ↗
  23. 2020
    Towards Lifelong Self-Supervision For Unpaired Image-to-Image TranslationVictor Schmidt, Makesh Narsimhan Sreedhar, Mostafa ElAraby, Irina RisharXiv
    PDF ↗
  24. 2020
    Continual Learning with Node-Importance based Adaptive Group Sparse RegularizationSangwon Jung, Hongjoon Ahn, Sungmin Cha, Taesup MoonNeurIPS · Sungkyunkwan University
    PDF ↗
  25. 2020
    Continual Graph LearningFan Zhou, Chengtai CaoarXiv
    PDF ↗
  26. 2020
    Lifelong Learning with Searchable Extension UnitsWenjin Wang, Yunqing Hu, Yin Zhang⋆arXiv · Zhejiang University
    PDF ↗
  27. 2020
    Rapid online learning and robust recall in a neuromorphic olfactory circuitNabil Imam, Thomas A. ClelandNature Machine Intelligence · Intel (United States) · Cornell University
    PDF ↗
  28. 2020
    Evaluating Logical Generalization in Graph Neural NetworksKoustuv Sinha, Shagun Sodhani, Joëlle Pineau, William L. HamiltonarXiv · McGill University
    PDF ↗
  29. 2020
    Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual LearningM. Caccia, Pau Rodríguez, Оleksiy Ostapenko … Laurent CharlinNeurIPS
    PDF ↗
  30. 2020
    Class-incremental Learning via Deep Model ConsolidationJunting Zhang, Jie Zhang, Shalini Ghosh … C.‐C. Jay KuoWACV · University of Southern California · California Southern University · +3
    PDF ↗
  31. 2020
    ScaIL: Classifier Weights Scaling for Class Incremental LearningEden Belouadah, Adrian PopescuWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +1
    PDF ↗
  32. 2020
    On Catastrophic Interference in Atari 2600 GamesWilliam Fedus, Dibya Ghosh, John D. Martin … Hugo LarochellearXiv
    PDF ↗
  33. 2020PDF ↗
  34. 2020
    Efficient Continual Learning in Neural Networks with Embedding RegularizationJary Pomponi, Simone Scardapane, Vincenzo Lomonaco, Aurelio UnciniNeurocomputing · Sapienza University of Rome · University of Bologna
    PDF ↗
  35. 2020
    BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong LearningYeming Wen, Dustin Tran, Jimmy BaICLR · University of Toronto · Google (United States)
    PDF ↗
  36. 2020
    Continual Universal Object DetectionXialei Liu, Hao Yang, Avinash Ravichandran … Stefano SoattoarXiv · Universitat Autònoma de Barcelona · Amazon (Germany)
    PDF ↗
  37. 2020
    Incremental Meta-Learning via Indirect Discriminant AlignmentQing Liu, Orchid Majumder, Alessandro Achille … Stefano SoattoECCV · Johns Hopkins University · Amazon (Germany)
    PDF ↗
  38. 2020
    A Novel Incremental Cross-Modal Hashing ApproachDevraj Mandal, Soma BiswasarXiv · Indian Institute of Science Bangalore
    PDF ↗
  39. 2020PDF ↗
  40. 2020
    Ternary Feature Masks: continual learning without any forgettingMarc Masana, T. Tuytelaars, Joost van de WeijerarXiv
    PDF ↗
  41. 2020
    Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed RepresentationsAlexander G. Ororbia, Ankur Mali, C. Lee Giles, Daniel KiferTNNLS · Rochester Institute of Technology · Pennsylvania State University
    PDF ↗
  42. 2020
    Active and Incremental Learning with Weak SupervisionClemens-Alexander Brust, Christoph Käding, Joachim DenzlerKünstliche Intell. · Friedrich Schiller University Jena
    PDF ↗
  43. 2020
    Dissecting Catastrophic Forgetting in Continual Learning by Deep VisualizationGiang Nguyen, Chen Shuan, Thao Do … Daeyoung KimarXiv
    PDF ↗
  44. 2020
    A Neural Dirichlet Process Mixture Model for Task-Free Continual LearningSoochan Lee, Junsoo Ha, Dongsu Zhang, Gunhee KimICLR
    PDF ↗
  45. 2020
    REMIND Your Neural Network to Prevent Catastrophic ForgettingTyler L. Hayes, Kushal Kafle, Robik Shrestha … Christopher KananECCV · Rochester Institute of Technology · Adobe Systems (United States) · +2
    PDF ↗
  46. 2020
    Continual Lifelong Learning in Natural Language Processing: A SurveyMagdalena Biesialska, Katarzyna Biesialska, Marta R. Costa-jussàCOLING · Universitat Politècnica de Catalunya
    PDF ↗
  47. 2020
    Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less ForgettingSanyuan Chen, Yutai Hou, Yiming Cui … Xiangzhan YuEMNLP · Harbin Institute of Technology · Joint Research Centre · +1
    PDF ↗
  48. 2020
    Adversarial Continual LearningSayna Ebrahimi, Franziska Meier, Roberto Calandra … Marcus RohrbachECCV · Berkeley College · Meta (United States) · +2
    PDF ↗
  49. 2020
    What Happens To BERT Embeddings During Fine-tuning?Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, Ian TenneyBlackboxNLP Workshop on Analyzing and Interpreting Neural… · Google (United States) · University of California, Santa Cruz · +1
    PDF ↗
  50. 2020
    Memory-Efficient Incremental Learning Through Feature AdaptationAhmet İşcen, Jeffrey Zhang, Svetlana Lazebnik, Cordelia SchmidECCV · University of Illinois Urbana-Champaign
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.