Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

111 papers of 6,984 · showing 51–100Sort Recent · Most cited
  1. 2021
    A Fixed Version of Quadratic Program in Gradient Episodic MemoryWei Zhou, Yiying LiarXiv · National University of Defense Technology
    PDF ↗
  2. 2021
    Tackling Catastrophic Forgetting and Background Shift in Continual Semantic SegmentationArthur Douillard, Yifu Chen, Arnaud Dapogny, Matthieu CordarXiv · Valeo (France)
    PDF ↗
  3. 2021
    Task-agnostic Continual Learning with Hybrid Probabilistic ModelsPolina Kirichenko, Mehrdad Farajtabar, Dushyant Rao … Razvan PascanuarXiv
    PDF ↗
  4. 2021
    On the importance of cross-task features for class-incremental learningAlbin Soutif--Cormerais, Marc Masana, Joost van de Weijer, Bartłomiej TwardowskiarXiv
    PDF ↗
  5. 2021
    A Novel Approach to Lifelong Learning: The Plastic Support StructureGeorges Kanaan, Kai Wen Zheng, Lucas FenauxarXiv · University of Toronto
    PDF ↗
  6. 2021
    Energy Aligning for Biased ModelsBowen Zhao, Chen Chen, Qi Ju, Shu‐Tao XiaarXiv
    PDF ↗
  7. 2021
    Knowing when we do not know: Bayesian continual learning for sensing-based analysis tasksSandra Servia-Rodríguez, Cecilia Mascolo, Young D. KwonarXiv
    PDF ↗
  8. 2021
    ModelCI-e: Enabling Continual Learning in Deep Learning Serving SystemsYizheng Huang, Huaizheng Zhang, Yonggang Wen … Ta Nguyen Binh DuongarXiv
    PDF ↗
  9. 2021
    Solving hybrid machine learning tasks by traversing weight space geodesicsGuruprasad Raghavan, Matt ThomsonarXiv · California Institute of Technology
    PDF ↗
  10. 2021
    Continual Learning in Deep Networks: an Analysis of the Last LayerTimothée Lesort, Thomas George, Irina RisharXiv
    PDF ↗
  11. 2021
    Personalizing Pre-trained ModelsMina Khan, P. Srivatsa, Advait Rane … Pattie MaesarXiv
    PDF ↗
  12. 2021
    A study on the plasticity of neural networksTudor Berariu, Wojciech Marian Czarnecki, Soham De … Claudia ClopatharXiv · Imperial College London
    PDF ↗
  13. 2021
    Encoders and Ensembles for Task-Free Continual LearningMurray Shanahan, Christos Kaplanis, Jovana MitrovicarXiv
    PDF ↗
  14. 2021
    Class-Incremental Few-Shot Object DetectionPengyang Li, Yanan Li, Cui, Han, Wang, DonghuiarXiv
    PDF ↗
  15. 2021
    Shared and Private VAEs with Generative Replay for Continual LearningSubhankar GhosharXiv · Indian Institute of Science Bangalore
    PDF ↗
  16. 2021
    Elastic Weight Consolidation (EWC): Nuts and BoltsAbhishek AicharXiv · University of California, Riverside
    PDF ↗
  17. 2021
    Continual Learning on the Edge with TensorFlow LiteGiorgos Demosthenous, Vassilis VassiliadesarXiv
    PDF ↗
  18. 2021
    A Deep Learning Framework for Lifelong Machine LearningCharles X. Ling, Tanner BohnarXiv · Western University
    PDF ↗
  19. 2021PDF ↗
  20. 2021
    Dynamic VAEs with Generative Replay for Continual Zero-shot LearningSubhankar GhosharXiv · Indian Institute of Science Bangalore
    PDF ↗
  21. 2021
    Learning in Deep Neural Networks Using a Biologically Inspired OptimizerGiorgia Dellaferrera, Stanisław Woźniak, Giacomo Indiveri … Evangelos EleftheriouarXiv
    PDF ↗
  22. 2021
    Continual Learning with Fully Probabilistic ModelsBenedikt Pfülb, Alexander Gepperth, Benedikt BagusarXiv · Fulda University of Applied Sciences
    PDF ↗
  23. 2021
    Few-shot Continual Learning: a Brain-inspired ApproachLiyuan Wang, Qian Li, Yi Zhong, Jun ZhuarXiv
    PDF ↗
  24. 2021
    Unsupervised Class-Incremental Learning Through ConfusionShivam Khare, Kun Cao, James M. RehgarXiv · Georgia Institute of Technology
    PDF ↗
  25. 2021PDF ↗
  26. 2021PDF ↗
  27. 2021
    Half-Real Half-Fake Distillation for Class-Incremental Semantic SegmentationZilong Huang, Wentian Hao, Xinggang Wang … Xian‐Sheng HuaarXiv
    PDF ↗
  28. 2021PDF ↗
  29. 2021PDF ↗
  30. 2021
    Continual Speaker Adaptation for Text-to-Speech SynthesisHamed Hemati, Damian BortharXiv · University of St.Gallen
    PDF ↗
  31. 2021PDF ↗
  32. 2021PDF ↗
  33. 2021
    Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit RecognitionÖzgür Kara, Nikhil Churamani, Hatice GüneşarXiv · Boğaziçi University · University of Cambridge
    PDF ↗
  34. 2021
    Learning Novel Objects Continually Through CuriosityAli Ayub, Alan R. WagnerarXiv · Pennsylvania State University
    PDF ↗
  35. 2021
    Continual Density Ratio Estimation in an Online SettingYu Chen, Song Liu, Tom Diethe, Peter FlacharXiv
    PDF ↗
  36. 2021PDF ↗
  37. 2021
    Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot LearningVinay Kumar Verma, Kevin J Liang, Nikhil Mehta, Lawrence CarinarXiv · Duke University
    PDF ↗
  38. 2021PDF ↗
  39. 2021
    Continual Learning from Synthetic Data for a Humanoid Exercise RobotNicolas Duczek, Matthias Kerzel, Stefan WermterarXiv
    PDF ↗
  40. 2021
    Self-Supervised Features Improve Open-World LearningAkshay Raj Dhamija, Touqeer Ahmad, Jonathan Schwan … Terrance E. BoultarXiv · University of Colorado Colorado Springs
    PDF ↗
  41. 2021
    Does the Adam Optimizer Exacerbate Catastrophic Forgetting?Dylan R. Ashley, Sina Ghiassian, Richard S. SuttonarXiv
    PDF ↗
  42. 2021
    Reproducibility Report: La-MAML: Look-ahead Meta Learning for Continual LearningJoel Joseph, Alex GuarXiv · Indian Institute of Technology BHU · Banaras Hindu University · +1
    PDF ↗
  43. 2021
    Continuum: Simple Management of Complex Continual Learning ScenariosArthur Douillard, Timothée LesortarXiv · Mila - Quebec Artificial Intelligence Institute
    PDF ↗
  44. 2021
    Generative Replay-based Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv
    PDF ↗
  45. 2021
    Incremental Knowledge Based Question AnsweringYongqi Li, Wenjie Li, Liqiang NiearXiv
    PDF ↗
  46. 2021
  47. 2021
    Reducing Representation Drift in Online Continual LearningLucas Caccia, Rahaf Aljundi, T. Tuytelaars … Eugene BelilovskyarXiv
  48. 2021
    Does Continual Learning = Catastrophic Forgetting?Anh Thai, S. Stojanov, Isaac Rehg, James M. RehgarXiv
  49. 2021
    Continual Learning of Semantic Segmentation using Complementary 2D-3D Data RepresentationsJonas Frey, H. Blum, Francesco Milano … César CadenaarXiv
  50. 2021
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.