Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

240 papers of 4,574 · showing 201–240Sort Recent · Most cited
  1. 2020
    Learning to Continually LearnBeaulieu Shawn, Frati Lapo, Miconi Thomas … Cheney NickFrontiers
    PDF ↗
  2. 2020
    Imbalanced Continual Learning with Partitioning Reservoir SamplingChris Dongjoo Kim, Jinseo Jeong, Gunhee KimECCV · Seoul National University
    PDF ↗
  3. 2020
    Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao … Jie ZhouACL · Intelligent Systems Research (United States) · Intelligent Health (United Kingdom) · +3
    PDF ↗
  4. 2020
    More Classifiers, Less Forgetting: A Generic Multi-classifier Paradigm for Incremental LearningYu Liu, Sarah Parisot, Greg Slabaugh … Tinne TuytelaarsECCV · KU Leuven · Huawei Technologies (China) · +1
    PDF ↗
  5. 2020
    Continual Learning for Natural Language Generation in Task-oriented Dialog SystemsFei Mi, Liangwei Chen, Mengjie Zhao … Boi FaltingsEMNLP · École Polytechnique Fédérale de Lausanne · LMU Klinikum · +2
    PDF ↗
  6. 2020
    Efficient Meta Lifelong-Learning with Limited MemoryZirui Wang, Sanket Vaibhav Mehta, Barnabás Póczos, Jaime CarbonellEMNLP · Carnegie Mellon University
    PDF ↗
  7. 2020
    Reparameterizing Convolutions for Incremental Multi-Task Learning without Task InterferenceMenelaos Kanakis, David Brüggemann, Suman Saha … Luc Van GoolECCV · ETH Zurich · KU Leuven
    PDF ↗
  8. 2020PDF ↗
  9. 2020
    Online Continual Learning under Extreme Memory ConstraintsEnrico Fini, Stéphane Lathuilière, Enver Sangineto … Elisa RicciECCV · University of Trento · Télécom Paris · +2
    PDF ↗
  10. 2020
    Class-Incremental Domain AdaptationJogendra Nath Kundu, Rahul Venkatesh, Naveen Venkat … R. Venkatesh BabuECCV · Indian Institute of Science Bangalore
    PDF ↗
  11. 2020
    Disentangle-based Continual Graph Representation LearningXiaoyu Kou, Yankai Lin, Shaobo Liu … Yan ZhangEMNLP · Peking University · Tencent (China)
    PDF ↗
  12. 2020
    RODEO: Replay for Online Object DetectionManoj Acharya, Tyler L. Hayes, Christopher KananBMVC · Rochester Institute of Technology
    PDF ↗
  13. 2020
    A Two-phase Prototypical Network Model for Incremental Few-shot Relation ClassificationHaopeng Ren, Yi Cai, Xiaofeng Chen … Qing LiCOLING · Ministry of Natural Resources · South China University of Technology · +1
    PDF ↗
  14. 2020
    Continual Adaptation for Efficient Machine CommunicationRobert D. Hawkins, Minae Kwon, Dorsa Sadigh, Noah D. GoodmanCoNLL · Princeton University · Department of Physics, Mathematics and Informatics · +1
    PDF ↗
  15. 2020
    Online Continual Learning on SequencesGerman I. Parisi, Vincenzo LomonacoStudies in computational intelligence · Universität Hamburg · University of Bologna
    PDF ↗
  16. 2020
    Piggyback GAN: Efficient Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Jiawei He … Greg MoriECCV · Simon Fraser University · Collège Boréal
    PDF ↗
  17. 2020PDF ↗
  18. 2020PDF ↗
  19. 2020
    Initial Classifier Weights Replay for Memoryless Class Incremental LearningEden Belouadah, Adrian Popescu, Ioannis KanellosBMVC · Commissariat à l'Énergie Atomique et aux Énergies Alternatives
    PDF ↗
  20. 2020
    On the Exploration of Incremental Learning for Fine-grained Image RetrievalWei Chen, Yu Liu, Weiping Wang … Michael S. LewBMVC · Leiden University · KU Leuven · +1
    PDF ↗
  21. 2020
    Visually Grounded Continual Learning of Compositional PhrasesXisen Jin, Junyi Du, Arka Sadhu … Xiang RenEMNLP · University of Southern California · California Southern University · +1
    PDF ↗
  22. 2020
    An Empirical Investigation towards Efficient Multi-Domain Language Model Pre-trainingKristjan Arumae, Qing Sun, Parminder BhatiaEMNLP · Amazon (United States) · Seattle University · +1
    PDF ↗
  23. 2020
    Active Class Incremental Learning for Imbalanced DatasetsEden Belouadah, Adrian Popescu, Umang Aggarwal, Léo SaciSpringer LNCS · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +1
    PDF ↗
  24. 2020
    Human Action Recognition and Assessment via Deep Neural Network Self-OrganizationGerman I. ParisiModelling Human Motion · Universität Hamburg
    PDF ↗
  25. 2020
    Using the Past Knowledge to Improve Sentiment ClassificationQi Qin, Wenpeng Hu, Bing LiuEMNLP · Peking University · King University
    PDF ↗
  26. 2020
    Continual Learning Long Short Term MemoryXin Guo, Yu Tian, Qinghan Xue … Xiaolong WangEMNLP · University of Delaware
    PDF ↗
  27. 2020
    Moving Towards Open Set Incremental Learning: Readily Discovering New AuthorsJustin Leo, Jugal KalitaAdvances in intelligent systems and computing · University of Colorado Colorado Springs
    PDF ↗
  28. 2020
    Findings of the First Shared Task on Lifelong Learning Machine TranslationLoïc Barrault, Magdalena Biesialska, Marta R. Costa‐jussà … Olivier GalibertEMNLP · University of Sheffield · Universitat Politècnica de Catalunya · +2
    PDF ↗
  29. 2020
    Morphology dictates learnability in neural controllersJoshua Powers, Ryan Grindle, Sam Kriegman … Josh BongardThe 2020 Conference on Artificial Life · University of Vermont
    PDF ↗
  30. 2020
    Confidence Calibration for Incremental LearningDongmin Kang, Yeonsik Jo, Yeongwoo Nam, Jonghyun ChoiIEEE Access · Gwangju Institute of Science and Technology
    PDF ↗
  31. 2020
    Memory Protection Generative Adversarial Network (MPGAN): A Framework to Overcome the Forgetting of GANs Using Parameter Regularization MethodsYifan Chang, Wenbo Li, Jian Peng … Yingliang HuangIEEE Access · University of Science and Technology of China · Hefei Institute of Technology Innovation · +3
    PDF ↗
  32. 2020
    Continuous Meta-Learning without TasksJ. Michael Harrison, Apoorva Sharma, Chelsea Finn, Marco PavoneNeurIPS · Stanford University · University of California, Berkeley
    PDF ↗
  33. 2020
    Continual Learning with Adaptive Weights (CLAW)Tameem Adel, Han Zhao, Richard E. TurnerICLR
    PDF ↗
  34. 2020
    Orthogonal Gradient Descent for Continual LearningMehrdad Farajtabar, Navid Azizan, A. Mott, Ang LiAISTATS · Google (United States)
    PDF ↗
  35. 2020
    Tree-CNN: A hierarchical Deep Convolutional Neural Network for incremental learningDeboleena Roy, Priyadarshini Panda, Kaushik RoyNeural Networks · Purdue University West Lafayette
    PDF ↗
  36. 2020
    LAMOL: LAnguage MOdeling for Lifelong Language LearningFan-Keng Sun, Cheng-Hao Ho, Hung-yi LeeICLR · Massachusetts Institute of Technology · National Taiwan University
    PDF ↗
  37. 2020PDF ↗
  38. 2020
    Uncertainty-guided Continual Learning with Bayesian Neural NetworksSayna Ebrahimi, Mohamed Elhoseiny, Trevor Darrell, Marcus RohrbachICLR · University of California, Berkeley · King Abdullah University of Science and Technology · +1
    PDF ↗
  39. 2020
    Continual learning with hypernetworksJohannes von Oswald, Christian Henning, J. Sacramento, B. GreweICLR
    PDF ↗
  40. 2020
    Scalable and Order-robust Continual Learning with Additive Parameter DecompositionJaehong Yoon, Saehoon Kim, Eunho Yang, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.