Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

352 papers of 4,574 · showing 101–150Sort Recent · Most cited
  1. 2021
    Replay in Deep Learning: Current Approaches and Missing Biological ElementsTyler L. Hayes, Giri P. Krishnan, Maxim Bazhenov … Christopher KananNeural Computation · Rochester Institute of Technology · University of California San Diego · +5
    PDF ↗
  2. 2021
    Task-Agnostic Continual Learning Using Online Variational Bayes With Fixed-Point UpdatesChen Zeno, Itay Golan, Elad Hoffer, Daniel SoudryNeural Computation · Technion – Israel Institute of Technology · Itamar Medical (Israel)
    PDF ↗
  3. 2021
    FILDNE: A Framework for Incremental Learning of Dynamic Networks EmbeddingsPiotr Bielak, Kamil Tagowski, Maciej Falkiewicz … Nitesh V. ChawlaKnowledge-Based Systems · Wrocław University of Science and Technology · AGH University of Krakow · +1
    PDF ↗
  4. 2021PDF ↗
  5. 2021
    SynthASR: Unlocking Synthetic Data for Speech RecognitionAmin Fazel, Wei Yang, Yulan Liu … Jasha DroppoInterspeech · Samsung (South Korea) · Amazon (United States) · +1
    PDF ↗
  6. 2021
    Continual Learning for Fake Audio DetectionHaoxin Ma, Jiangyan Yi, Jianhua Tao … Chenglong WangInterspeech · Chinese Academy of Sciences · Center for Excellence in Education · +1
    PDF ↗
  7. 2021
    Towards Lifelong Learning of End-to-end ASRHeng-Jui Chang, Hung-yi Lee, Lin-shan LeeInterspeech · National Taiwan University
    PDF ↗
  8. 2021
    FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing ApplicationsYoung D. Kwon, Jagmohan Chauhan, Cecilia MascoloInterspeech · University of Cambridge · University of Southampton
    PDF ↗
  9. 2021
    Continual learning under domain transfer with sparse synaptic burstingShawn Beaulieu, Jeff Clune, Nick CheneyarXiv · University of Vermont
    PDF ↗
  10. 2021
    A Brain-Inspired Homeostatic Neuron Based on Phase-Change Memories for Efficient Neuromorphic ComputingIrene Muñoz-Martín, S. Bianchi, Shahin Hashemkhani … Daniele IelminiFrontiers · Politecnico di Milano
    PDF ↗
  11. 2021
    A good body is all you need: avoiding catastrophic interference via agent architecture searchJoshua Powers, Ryan Grindle, L. Frati, Josh BongardarXiv · University of Vermont
    PDF ↗
  12. 2021
    Continual semi-supervised learning through contrastive interpolation consistencyMatteo Boschini, Pietro Buzzega, Lorenzo Bonicelli … Simone CalderaraPattern Recognition Letters · University of Modena and Reggio Emilia
    PDF ↗
  13. 2021
    Continual Backprop: Stochastic Gradient Descent with Persistent RandomnessShibhansh Dohare, Richard S. Sutton, A. Rupam MahmoodarXiv · University of Alberta
    PDF ↗
  14. 2021
    Schematic Memory Persistence and Transience for Efficient and Robust Continual LearningYuyang Gao, Giorgio A. Ascoli, Liang ZhaoNeural Networks · Emory University · George Mason University · +2
    PDF ↗
  15. 2021
    Lifelong Intent Detection via Multi-Strategy RebalancingQingbin Liu, Xiaoyan Yu, Shizhu He … Jun ZhaoarXiv
    PDF ↗
  16. 2021
    The State of Lifelong Learning in Service Robots:Hamidreza Kasaei, Jorik Melsen, Floris van Beers … Klemen VoncinaJournal of Intelligent & Robotic Systems · University of Groningen
    PDF ↗
  17. 2021
    Sequoia: A Software Framework to Unify Continual Learning ResearchFabrice Normandin, Florian Golemo, Oleksiy Ostapenko … M. CacciaarXiv
    PDF ↗
  18. 2021
    Learning with Selective ForgettingTakashi Shibata, Go Irie, Daiki Ikami, Yu MitsuzumiIJCAI · NTT (Japan)
    PDF ↗
  19. 2021
    Unsupervised Progressive Learning and the STAM ArchitectureJames Smith, Cameron Taylor, Seth Baer, Constantine DovrolisIJCAI · Georgia Institute of Technology
    PDF ↗
  20. 2021
    FedSpeech: Federated Text-to-Speech with Continual LearningZiyue Jiang, Yi Ren, Ming Lei, Zhou ZhaoIJCAI · Zhejiang University · Alibaba Group (United States)
    PDF ↗
  21. 2021
    Knowledge Consolidation based Class Incremental Online Learning with Limited DataMohammed Asad Karim, Vinay Kumar Verma, Pravendra Singh … Piyush RaiIJCAI · Indian Institute of Technology Kanpur · Duke University · +2
    PDF ↗
  22. 2021
    Bridge Networks: Relating Inputs through Vector-Symbolic ManipulationsWilkie Olin-Ammentorp, Maxim BazhenovInternational Conference on Neuromorphic Systems 2021 · University of California San Diego
    PDF ↗
  23. 2021
    Revisiting Catastrophic Forgetting in Class Incremental LearningZixuan Ni, Haizhou Shi, Siliang Tang … Zhuang, YuetingarXiv · Zhejiang University
    PDF ↗
  24. 2021
    Continual Learning for Recurrent Neural Networks: an Empirical EvaluationAndrea Cossu, Antonio Carta, Vincenzo Lomonaco, Davide BacciuNeural Networks · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  25. 2021
    An Investigation of Replay-based Approaches for Continual LearningBenedikt Bagus, Alexander GepperthIEEE International Joint Conference on Neural Network · Fulda University of Applied Sciences
    PDF ↗
  26. 2021
    Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay BufferJames Smith, Jonathan Balloch, Yen-Chang Hsu, Zsolt KiraIJCNN · Georgia Institute of Technology · Samsung (United States)
    PDF ↗
  27. 2021
    Lifelong Learning of Graph Neural Networks for Open-World Node ClassificationLukas Galke, Benedikt Franke, Tobias Zielke, Ansgar ScherpIEEE International Joint Conference on Neural Network · Christian-Albrechts-Universität zu Kiel
    PDF ↗
  28. 2021
    Condensed Composite Memory Continual LearningFelix Wiewel, Bin YangIJCNN · University of Stuttgart
    PDF ↗
  29. 2021
    Generative Feature Replay with Orthogonal Weight Modification for Continual LearningGehui Shen, Song Zhang, Xiang Chen, Zhihong DengIJCNN · Peking University
    PDF ↗
  30. 2021
    S-TRIGGER: Continual State Representation Learning via Self-Triggered Generative ReplayHugo Caselles-Dupré, Michael Garcia-Ortiz, David FilliatIEEE International Joint Conference on Neural Network · Institut national de recherche en sciences et technologies du numérique · École Nationale Supérieure de Techniques Avancées · +1
    PDF ↗
  31. 2021
    Overcoming Catastrophic Forgetting with Gaussian Mixture ReplayBenedikt Pfülb, Alexander GepperthIEEE International Joint Conference on Neural Network · Fulda University of Applied Sciences
    PDF ↗
  32. 2021
    Bilevel Continual LearningAmmar Shaker, Francesco Alesiani, Shujian Yu, Wenzhe YinIJCNN · Heidelberg University
    PDF ↗
  33. 2021
    BinPlay: A Binary Latent Autoencoder for Generative Replay Continual LearningKamil Rafał Deja, Paweł Wawrzyński, Daniel Marczak … T. P. TrzcinskiIEEE International Joint Conference on Neural Network · Warsaw University of Technology
    PDF ↗
  34. 2021
    One-shot learning for the long term: consolidation with an artificial hippocampal algorithmGideon Kowadlo, Abdelrahman Ahmed, David RawlinsonIEEE International Joint Conference on Neural Network
    PDF ↗
  35. 2021
    Concept drift detection and adaptation for federated and continual learningFernando E. Casado, Dylan Lema, Marcos F. Criado … Senén BarroMultimedia Tools and Applications · Universidade de Santiago de Compostela · Universidade da Coruña
    PDF ↗
  36. 2021
    CLeaR: An adaptive continual learning framework for regression tasksYujiang He, Bernhard SickAI Perspectives · University of Kassel
    PDF ↗
  37. 2021
    ACAE-REMIND for Online Continual Learning with Compressed Feature ReplayKai Wang, Joost van de Weijer, Luis HerranzPattern Recognition Letters · Universitat Autònoma de Barcelona · Computer Vision Center
    PDF ↗
  38. 2021
    Algorithmic insights on continual learning from fruit fliesYang Shen, Sanjoy Dasgupta, Saket NavlakhaarXiv
    PDF ↗
  39. 2021
    AlterSGD: Finding Flat Minima for Continual Learning by Alternative TrainingZhongzhan Huang, Mingfu Liang, Senwei Liang, Wei HearXiv · Purdue University West Lafayette · Nanyang Technological University
    PDF ↗
  40. 2021
    Kernel Continual LearningMahammad Mahdi Derakhshani, Xiantong Zhen, Ling Shao, Cees G. M. SnoekICML · University of Amsterdam · Inception Institute of Artificial Intelligence
    PDF ↗
  41. 2021
    One Person, One Model, One World: Learning Continual User Representation without ForgettingFajie Yuan, Guoxiao Zhang, Alexandros Karatzoglou … Yudong LiENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · Tencent (China) · Westlake University · +2
    PDF ↗
  42. 2021
    TIE: A Framework for Embedding-based Incremental Temporal Knowledge Graph CompletionJiapeng Wu, Yishi Xu, Yingxue Zhang … Jackie Chi Kit CheungSIGIR · McGill University · Université de Montréal · +1
    PDF ↗
  43. 2021
    Continual Learning for Class- and Domain-Incremental Semantic SegmentationTobias Kalb, Masoud Roschani, Miriam Ruf, Jürgen BeyererIEEE Intelligent Vehicles Symposium (IV) · Fraunhofer Institute of Optronics, System Technologies and Image Exploitation · Karlsruhe Institute of Technology
    PDF ↗
  44. 2021
    Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment ClassificationBinzong Geng, Min Yang, Fajie Yuan … Ruifeng XuSIGIR · University of Science and Technology of China · Chinese Academy of Sciences · +5
    PDF ↗
  45. 2021PDF ↗
  46. 2021
    Continual Learning in the Teacher-Student Setup: Impact of Task SimilaritySebastian Lee, Sebastian Goldt, Andrew SaxeICML · Microsoft Research (United Kingdom) · Scuola Internazionale Superiore di Studi Avanzati · +1
    PDF ↗
  47. 2021
    A Fixed Version of Quadratic Program in Gradient Episodic MemoryWei Zhou, Yiying LiarXiv · National University of Defense Technology
    PDF ↗
  48. 2021
    FoCL: Feature-Oriented Continual Learning for Generative ModelsQicheng Lao, Mehrzad Mortazavi, Marzieh S. Tahaei … Mohammad HavaeiPattern Recognition · Sichuan University · West China Medical Center of Sichuan University · +3
    PDF ↗
  49. 2021
    Learning Then, Learning Now, and Every Second in Between: Lifelong Learning With a Simulated Humanoid RobotAleksej Logacjov, Matthias Kerzel, Stefan WermterFrontiers · Universität Hamburg
    PDF ↗
  50. 2021
    Tackling Catastrophic Forgetting and Background Shift in Continual Semantic SegmentationArthur Douillard, Yifu Chen, Arnaud Dapogny, Matthieu CordarXiv · Valeo (France)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.