Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

352 papers of 4,574 · showing 251–300Sort Recent · Most cited
  1. 2021
    CAM-GAN: Continual Adaptation Modules for Generative Adversarial NetworksSakshi Varshney, Vinay Kumar Verma, P K Srijith … Piyush RaiNeurIPS
    PDF ↗
  2. 2021
    Learning to Continually Learn Rapidly from Few and Noisy DataNicholas I-Hsien Kuo, Mehrtash Harandi, Nicolas Fourrier … Hanna SuominenAAAI · Australian National University
    PDF ↗
  3. 2021
    Continuous Coordination As a Realistic Scenario for Lifelong LearningHadi Nekoei, Akilesh Badrinaaraayanan, Aaron Courville, Sarath ChandarICML · Centre Universitaire de Mila · Université de Montréal · +1
    PDF ↗
  4. 2021PDF ↗
  5. 2021
    Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot LearningVinay Kumar Verma, Kevin J Liang, Nikhil Mehta, Lawrence CarinarXiv · Duke University
    PDF ↗
  6. 2021PDF ↗
  7. 2021
    Continual Learning from Synthetic Data for a Humanoid Exercise RobotNicolas Duczek, Matthias Kerzel, Stefan WermterarXiv
    PDF ↗
  8. 2021
    A comparative study of calibration methods for imbalanced class incremental learningUmang Aggarwal, Adrian Popescu, Eden Belouadah, Céline HudelotMultimedia Tools and Applications · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +5
    PDF ↗
  9. 2021
    GP-Tree: A Gaussian Process Classifier for Few-Shot Incremental LearningIdan Achituve, Aviv Navon, Yochai Yemini … Ethan FetayaICML · Bar-Ilan University
    PDF ↗
  10. 2021
    Self-Supervised Features Improve Open-World LearningAkshay Raj Dhamija, Touqeer Ahmad, Jonathan Schwan … Terrance E. BoultarXiv · University of Colorado Colorado Springs
    PDF ↗
  11. 2021
    Does the Adam Optimizer Exacerbate Catastrophic Forgetting?Dylan R. Ashley, Sina Ghiassian, Richard S. SuttonarXiv
    PDF ↗
  12. 2021
    Reproducibility Report: La-MAML: Look-ahead Meta Learning for Continual LearningJoel Joseph, Alex GuarXiv · Indian Institute of Technology BHU · Banaras Hindu University · +1
    PDF ↗
  13. 2021
    Continuum: Simple Management of Complex Continual Learning ScenariosArthur Douillard, Timothée LesortarXiv · Mila - Quebec Artificial Intelligence Institute
    PDF ↗
  14. 2021
    Online Limited Memory Neural-Linear Bandits with Likelihood MatchingOfir Nabati, Tom Zahavy, Shie MannorICML · Technion – Israel Institute of Technology · Google DeepMind (United Kingdom)
    PDF ↗
  15. 2021
    Continual Learning of Knowledge Graph EmbeddingsAngel Daruna, Mehul Gupta, Mohan Sridharan, Sonia ChernovaRA-L · Georgia Institute of Technology · University of Birmingham
    PDF ↗
  16. 2021
    Self-Attention Meta-Learner for Continual LearningGhada Sokar, D. Mocanu, Mykola PechenizkiyAdaptive Agents and Multi-Agent Systems
    PDF ↗
  17. 2021
    Prediction Error-Driven Memory Consolidation for Continual Learning: On the Case of Adaptive Greenhouse ModelsGuido Schillaci, Uwe Schmidt, Luis MirandaKünstliche Intell. · Scuola Superiore Sant'Anna · Humboldt-Universität zu Berlin · +1
    PDF ↗
  18. 2021
    SpaceNet: Make Free Space For Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyNeurocomputing · Eindhoven University of Technology · University of Twente
    PDF ↗
  19. 2021
    Knowledge Distillation for Incremental Learning in Semantic SegmentationUmberto Michieli, Pietro ZanuttighComputer Vision and Image Understanding · University of Padua
    PDF ↗
  20. 2021
    Generative Replay-based Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv
    PDF ↗
  21. 2021
    Incremental Knowledge Based Question AnsweringYongqi Li, Wenjie Li, Liqiang NiearXiv
    PDF ↗
  22. 2021
    EEC: Learning to Encode and Regenerate Images for Continual LearningAli Ayub, Alan R. WagnerICLR · Pennsylvania State University
    PDF ↗
  23. 2021
    Rethinking Experience Replay: a Bag of Tricks for Continual LearningPietro Buzzega, Matteo Boschini, Angelo Porrello, Simone CalderaraICPR · University of Modena and Reggio Emilia
    PDF ↗
  24. 2021
    Class-incremental Learning with Pre-allocated Fixed ClassifiersFederico Pernici, Matteo Bruni, Claudio Baecchi … Alberto Del BimboICPR · Florence (Netherlands) · University of Florence
    PDF ↗
  25. 2021
    Sequential Domain Adaptation through Elastic Weight Consolidation for Sentiment AnalysisAvinash Madasu, Anvesh Rao VijjiniICPR · Samsung (United States) · Samsung (India)
    PDF ↗
  26. 2021
    ARCADe: A Rapid Continual Anomaly DetectorAhmed Frikha, Denis Krompaß, Volker TrespICPR · Siemens (Germany)
    PDF ↗
  27. 2021
    Incrementally Zero-Shot Detection by an Extreme Value AnalyzerSixiao Zheng, Yanwei Fu, Yanxi HouICPR · Fudan University
    PDF ↗
  28. 2021
    Pseudo Rehearsal using non photo-realistic imagesBhasker Sri Harsha Suri, Kalidas YeturuICPR · Indian Institute of Technology Tirupati
    PDF ↗
  29. 2021
    AdapterFusion: Non-Destructive Task Composition for Transfer LearningJonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé … Iryna GurevychEACL · Technische Universität Darmstadt · Supélec · +5
    PDF ↗
  30. 2021
    K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan … Ming ZhouACL · Fudan University · Microsoft (United States) · +1
    PDF ↗
  31. 2021
    Continual Learning in Task-Oriented Dialogue SystemsAndrea Madotto, Zhaojiang Lin, Zhenpeng Zhou … Zhiguang WangEMNLP · Hong Kong University of Science and Technology · Meta (Israel) · +1
    PDF ↗
  32. 2021
    Continual Learning for Text Classification with Information Disentanglement Based RegularizationYufan Huang, Yanzhe Zhang, Jiaao Chen … Diyi YangNAACL · Georgia Institute of Technology · Google (United States) · +1
    PDF ↗
  33. 2021
    Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification TasksZixuan Ke, Hu Xu, Bing LiuNAACL · University of Illinois Chicago · Meta (Israel)
    PDF ↗
  34. 2021
    InfoMax-GAN: Improved Adversarial Image Generation via Information Maximization and Contrastive LearningKwot Sin Lee, Ngoc-Trung Tran, Ngai‐Man CheungWACV · University of Cambridge · Snap (United States) · +1
    PDF ↗
  35. 2021
    AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive SummarizationTiezheng Yu, Zihan Liu, Pascale FungNAACL · Hong Kong University of Science and Technology
    PDF ↗
  36. 2021
    Posterior Meta-Replay for Continual LearningChristian Henning, Maria R. Cervera, Francesco D'Angelo … João SacramentoNeurIPS
    PDF ↗
  37. 2021
    Self-Supervised Training Enhances Online Continual LearningGianmarco J Gallardo, Tyler L. Hayes, Christopher KananBMVC
    PDF ↗
  38. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  39. 2021
    Multilingual Machine Translation: Closing the Gap between Shared and Language-specific Encoder-DecodersCarlos Escolano, Marta R. Costa‐jussà, José A. R. Fonollosa, Mikel ArtetxeEACL · Universitat Politècnica de Catalunya · University of the Basque Country · +1
    PDF ↗
  40. 2021
    Learning Adaptive Embedding Considering Incremental ClassYang Yang, Zhen-Qiang Sun, Hengshu Zhu … Jian YangTKDE · Nanjing University of Science and Technology · Nanjing Normal University · +4
    PDF ↗
  41. 2021
    Towards Continual Learning for Multilingual Machine Translation via Vocabulary SubstitutionXavier García, Noah Constant, Ankur P. Parikh, Orhan FıratNAACL · Google (United States)
    PDF ↗
  42. 2021
    Continual Representation Learning for Biometric IdentificationBo Zhao, Shixiang Tang, Dapeng Chen … Rui ZhaoWACV · Group Sense (China) · University of Edinburgh · +1
    PDF ↗
  43. 2021
    L3DOC: Lifelong 3D Object ClassificationYuyang Liu, Yang Cong, Gan Sun … Hongsen LiuTIP · Shenyang Institute of Automation · Chinese Academy of Sciences · +1
    PDF ↗
  44. 2021
    Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot LearningXisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang RenEMNLP · University of Southern California · Biomedical Research Institute of Southern California · +1
    PDF ↗
  45. 2021
    Prototype-based Incremental Few-Shot SegmentationFabio Cermelli, Massimiliano Mancini, Yongqin Xian … Barbara CaputoBMVC
    PDF ↗
  46. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  47. 2021
    Lifelong Event Detection with Knowledge TransferPengfei Yu, Heng Ji, Prem NatarajanEMNLP · University of Illinois Urbana-Champaign · Amazon (United States)
    PDF ↗
  48. 2021
    Continual Learning for Neural Machine TranslationYue Cao, Haoran Wei, Boxing Chen, Xiaojun WanNAACL · Peking University · Alibaba Group (United States)
    PDF ↗
  49. 2021
    Continual Learning at the Edge: Real-Time Training on Smartphone DevicesLorenzo Pellegrini, Vincenzo Lomonaco, Gabriele Graffieti, Davide MaltoniESANN 2021 proceedings · Azienda-Unita' Sanitaria Locale Di Cesena · University of Pisa · +1
    PDF ↗
  50. 2021
    Pruning-then-Expanding Model for Domain Adaptation of Neural Machine TranslationShuhao Gu, Yang Feng, Wanying XieNAACL · Chinese Academy of Sciences · Institute of Computing Technology · +2
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.