Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

240 papers of 4,574 · showing 1–50Sort Recent · Most cited
  1. 2020
    Simple Lifelong Learning MachinesJoshua T. Vogelstein, Jayanta Dey, Hayden S. Helm … Carey E. PriebeTPAMI · Johns Hopkins University · Baylor College of Medicine · +1
    PDF ↗
  2. 2020
    Hidden Markov Neural NetworksLorenzo Rimella, Nick WhiteleyEntropy · Collegio Carlo Alberto · University of Turin · +1
    PDF ↗
  3. 2020
    A Layered Learning Approach to Scaling in Learning Classifier Systems for Boolean ProblemsIsidro M. Alvarez, Trung B. Nguyen, Will N. Browne, Mengjie ZhangEvolutionary Computation · Victoria University of Wellington · Statistics New Zealand · +1
    PDF ↗
  4. 2020
    A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World LearningMartin Mundt, Yongwon Hong, Iuliia Pliushch, Visvanathan RameshNeural Networks · Goethe University Frankfurt · Technische Universität Darmstadt · +1
    PDF ↗
  5. 2020
    Overcoming Catastrophic Forgetting via Direction-Constrained OptimizationYunfei Teng, Anna Choromanska, Murray Campbell … Lior HoreshSpringer LNCS · New York University
    PDF ↗
  6. 2020
    Class-Incremental Learning: Survey and Performance Evaluation on Image ClassificationMarc Masana, Xialei Liu, Bartłomiej Twardowski … Joost van de WeijerTPAMI · Computer Vision Center
    PDF ↗
  7. 2020
    Instance Weighted Incremental Evolution Strategies for Reinforcement Learning in Dynamic EnvironmentsZhi Wang, Chunlin Chen, Daoyi DongTNNLS · University of Canberra · UNSW Sydney · +1
    PDF ↗
  8. 2020
    Self-Training for Class-Incremental Semantic SegmentationLu Yu, Xialei Liu, Joost van de WeijerTNNLS · Tianjin University of Technology · Nankai University · +1
    PDF ↗
  9. 2020
    Efficient Architecture Search for Continual LearningQiang Gao, Zhipeng Luo, Diego Klabjan, Fengli ZhangTNNLS · Southwestern University of Finance and Economics · Northwestern University · +1
    PDF ↗
  10. 2020
    Drinking From a Firehose: Continual Learning With Web-Scale Natural LanguageHexiang Hu, Ozan Şener, Fei Sha, Vladlen KoltunTPAMI · University of Southern California · Intel (United States)
    PDF ↗
  11. 2020PDF ↗
  12. 2020
    MgSvF: Multi-Grained Slow versus Fast Framework for Few-Shot Class-Incremental LearningHanbin Zhao, Yongjian Fu, Mintong Kang … Xi LiTPAMI · Zhejiang University of Science and Technology · Huawei Technologies (China)
    PDF ↗
  13. 2020
    Firefly Neural Architecture Descent: a General Approach for Growing Neural NetworksLemeng Wu, Bo Liu, Peter Stone, Qiang LiuNeurIPS · The University of Texas at Austin
    PDF ↗
  14. 2020
    Learning Invariant Representation for Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyarXiv · Eindhoven University of Technology · University of Twente
    PDF ↗
  15. 2020
    Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation ExtractionLi Cui, Deqing Yang, Jiaxin Yu … Yanghua XiaoACL · Fudan University
    PDF ↗
  16. 2020
    Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and MaskingBinzong Geng, Fajie Yuan, Qiancheng Xu … Min YangACL · University of Science and Technology of China · Chinese Academy of Sciences · +7
    PDF ↗
  17. 2020
    Learning to Solve NLP Tasks in an Incremental Number of LanguagesGiuseppe Castellucci, Simone Filice, Danilo Croce, Roberto BasiliACL · Amazon (United States) · Seattle University · +3
    PDF ↗
  18. 2020
    Rational LAMOL: A Rationale-based Lifelong Learning FrameworkKasidis Kanwatchara, Thanapapas Horsuwan, Piyawat Lertvittayakumjorn … Peerapon VateekulACL · Chulalongkorn University · Imperial College London
    PDF ↗
  19. 2020
    Detecting Changes and Avoiding Catastrophic Forgetting in Dynamic Partially Observable EnvironmentsJeffery Dick, Paweł Ładosz, Eseoghene Ben-Iwhiwhu … Andrea SoltoggioFrontiers · Loughborough University · Teikyo University · +1
    PDF ↗
  20. 2020
    Selective Forgetting of Deep Networks at a Finer Level than SamplesTomohiro Hayase, Suguru Yasutomi, Takashi KatoharXiv
    PDF ↗
  21. 2020
    Consequences of Slow Neural Dynamics for Incremental LearningShima Rahimi Moghaddam, Fanjun Bu, Christopher J. HoneyarXiv
    PDF ↗
  22. 2020
    Pseudo-Rehearsal: Achieving Deep Reinforcement Learning without Catastrophic ForgettingCraig Atkinson, Brendan McCane, Lech Szymanski, Anthony RobinsNeurocomputing · University of Otago
    PDF ↗
  23. 2020
    Association: Remind Your GAN not to ForgetYi Gu, Jie Li, Yuting Gao … Zhang, ZiruiarXiv
    PDF ↗
  24. 2020
    Consolidation via Policy Information Regularization in Deep RL for Multi-Agent GamesTyler Malloy, Tim Klinger, Miao Liu … Chris R. SimsarXiv
    PDF ↗
  25. 2020
    Generalized Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv · Indian Institute of Science Bangalore · Indian Institute of Technology Madras
    PDF ↗
  26. 2020PDF ↗
  27. 2020
    Continual Learning with Deep Artificial NeuronsBlake Camp, Jaya Krishna Mandivarapu, Rolando EstradaarXiv · Georgia State University
    PDF ↗
  28. 2020
    Incremental Learning Using a Grow-and-Prune Paradigm With Efficient Neural NetworksXiaoliang Dai, Hongxu Yin, Niraj K. JhaIEEE Transactions · Princeton University
    PDF ↗
  29. 2020
    Lifelong learning of interpretable image representationsFei Ye, Adrian G. BorşICIP · University of York
    PDF ↗
  30. 2020
    Meta-Learning for Natural Language Understanding under Continual Learning FrameworkJiacheng Wang, Yong Fan, Duo Jiang, Shiqing LiarXiv · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +1
    PDF ↗
  31. 2020
    Learn-Prune-Share for Lifelong LearningZifeng Wang, Tong Jian, Kaushik Chowdhury … Stratis IoannidisICDM · Northeastern University
    PDF ↗
  32. 2020
    CLIFER: Continual Learning with Imagination for Facial Expression RecognitionNikhil Churamani, Hatice GüneşIEEE International Conference on Automatic Face and Gestu… · University of Cambridge
    PDF ↗
  33. 2020
    Lifelong Learning Without a Task OracleAmanda Rios, Laurent IttiIEEE 32nd International Conference on Tools with Artifici… · University of Southern California
    PDF ↗
  34. 2020
    A Study on Efficiency in Continual Learning Inspired by Human LearningPhilip Ball, Yingzhen Li, Angus Lamb, Cheng ZhangarXiv
    PDF ↗
  35. 2020
    SERIL: Noise Adaptive Speech Enhancement using Regularization-based Incremental LearningChi-Chang Lee, Yu-Chen Lin, Hsuan-Tien Lin … Yu TsaoInterspeech
    PDF ↗
  36. 2020
    Latent Replay for Real-Time Continual LearningLorenzo Pellegrini, Gabriele Graffieti, Vincenzo Lomonaco, Davide MaltoniIROS · University of Bologna
    PDF ↗
  37. 2020
    Tell me what this is: Few-Shot Incremental Object Learning by a RobotAli Ayub, Alan R. WagnerIROS · Pennsylvania State University
    PDF ↗
  38. 2020
    A Combinatorial Perspective on Transfer LearningJianan Wang, Eren Sezener, David Budden … Joel VenessNeurIPS · Google (United States)
    PDF ↗
  39. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  40. 2020
    Streaming Graph Neural Networks via Continual LearningJunshan Wang, Guojie Song, Yi Wu, Liang WangCIKM · Peking University · Alibaba Group (China)
    PDF ↗
  41. 2020
    GraphSAIL: Graph Structure Aware Incremental Learning for Recommender SystemsYishi Xu, Yingxue Zhang, Wei Guo … Mark CoatesCIKM · Université de Montréal · Huawei Technologies (Canada) · +2
    PDF ↗
  42. 2020
    Continual Domain Adaptation for Machine Reading ComprehensionLixin Su, Jiafeng Guo, Ruqing Zhang … Xueqi ChengCIKM · Computer Network Information Center · University of Chinese Academy of Sciences
    PDF ↗
  43. 2020
    Continual Unsupervised Domain Adaptation for Semantic SegmentationJoonhyuk Kim, Sahng-Min Yoo, Gyeong-Moon Park, Jong-Hwan KimarXiv
    PDF ↗
  44. 2020
    Continual Learning for Neural Semantic ParsingVladislav Lialin, Rahul Goel, Andrey Simanovsky … Rushin ShaharXiv · University of Massachusetts Lowell · Google (United States)
    PDF ↗
  45. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  46. 2020
    Meta-Consolidation for Continual LearningK J Joseph, Vineeth N BalasubramanianNeurIPS · Indian Institute of Technology Hyderabad
    PDF ↗
  47. 2020
    Continual Learning Of Predictive Models In Video Sequences Via Variational AutoencodersDamian Campo, Giulia Slavic, Mohamad Baydoun … Carlo S. RegazzoniInternational Conference on Information Photonics · University of Genoa
    PDF ↗
  48. 2020
    Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNNCan Peng, Kun Zhao, Brian C. LovellPattern Recognition Letters · The University of Queensland
    PDF ↗
  49. 2020
    Metaplasticity in Multistate Memristor Synaptic NetworksFatima Tuz Zohora, Abdullah M. Zyarah, Nicholas Soures, Dhireesha KudithipudiInternational Symposium on Circuits and Systems · The University of Texas at San Antonio · Rochester Institute of Technology
    PDF ↗
  50. 2020
    Neurocoder: Learning General-Purpose Computation Using Stored Neural ProgramsHung Lê, Svetha VenkatesharXiv · Deakin University
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.