Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

505 papers of 4,574 · showing 401–450Sort Recent · Most cited
  1. 2022
    Lifelong Pretraining: Continually Adapting Language Models to Emerging CorporaXisen Jin, Dejiao Zhang, Henghui Zhu … Xiang RenNAACL · University of Southern California · California Southern University
    PDF ↗
  2. 2022
    Memory Efficient Continual Learning with TransformersBeyza Ermis, Giovanni Zappella, Martin Wistuba … Cédric ArchambeauNeurIPS
    PDF ↗
  3. 2022
    Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language GenerationDingcheng Li, Zheng Chen, Eunah Cho … Yang LiuNAACL · Amazon (United States)
    PDF ↗
  4. 2022
    S3C: Self-Supervised Stochastic Classifiers for Few-Shot Class-Incremental LearningJayateja Kalla, Soma BiswasECCV · Indian Institute of Science Bangalore
    PDF ↗
  5. 2022
    Repeated Augmented Rehearsal: A Simple but Strong Baseline for Online Continual LearningYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
  6. 2022
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  7. 2022
    Multi-Domain Incremental Learning for Semantic SegmentationPrachi Garg, Rohit Saluja, Vineeth N Balasubramanian … C. V. JawaharWACV · Indian Institute of Technology Hyderabad · Indian Institute of Technology Delhi
    PDF ↗
  8. 2022
    Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic DataKuluhan Binici, Nam Trung Pham, Tulika Mitra, Karianto LemanWACV · Agency for Science, Technology and Research · National University of Singapore · +1
    PDF ↗
  9. 2022
    Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic SamplesYu Xia, Quan Wang, Yajuan Lyu … Dai DaiACL · Peking University · Baidu (China)
    PDF ↗
  10. 2022
    Practical Recommendations for Replay-based Continual Learning MethodsGabriele Merlin, Vincenzo Lomonaco, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  11. 2022
    Multi-Granularity Regularized Re-Balancing for Class Incremental LearningHuitong Chen, Yu Wang, Qinghua HuTKDE · Tianjin University · Tianjin haihe hospital
    PDF ↗
  12. 2022
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  13. 2022
    Differential Privacy Preservation in Robust Continual LearningAhmad Hassanpour, Majid Moradikia, Bian Yang … Julián FiérrezIEEE Access · Norwegian University of Science and Technology · University of Houston · +1
    PDF ↗
  14. 2022
    Online Continual Learning Via Candidates VotingJiangpeng He, Fengqing ZhuWACV · Purdue University West Lafayette
    PDF ↗
  15. 2022
    Learning Representations for New Sound Classes With Continual Self-Supervised LearningZhepei Wang, Cem Subakan, Xilin Jiang … Paris SmaragdisIEEE Signal Processing Letters · University of Illinois Urbana-Champaign · Concordia University · +2
    PDF ↗
  16. 2022
    Unsupervised Continual Learning via Self-Adaptive Deep Clustering ApproachMahardhika Pratama, Andri Ashfahani, Edwin LughoferSpringer LNCS · University of South Australia · Nanyang Technological University
    PDF ↗
  17. 2022
    Knowledge Capture and Replay for Continual LearningSaisubramaniam Gopalakrishnan, Pranshu Ranjan Singh, Haytham M. Fayek … ArulMurugan AmbikapathiWACV · Agency for Science, Technology and Research · Institute for Infocomm Research · +1
    PDF ↗
  18. 2022
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  19. 2022
    Continual Learning In Environments With Polynomial Mixing TimesMatthew Riemer, Sharath Chandra Raparthy, Ignacio Cases … Irina RishNeurIPS
    PDF ↗
  20. 2022
    Coarse-To-Fine Incremental Few-Shot LearningXiang Xiang, Yuwen Tan, Qian Wan … Gregory D. HagerECCV · Huazhong University of Science and Technology · Johns Hopkins University
    PDF ↗
  21. 2022
    Adaptive Resonance Theory-based Topological Clustering with a Divisive Hierarchical Structure Capable of Continual LearningNaoki Masuyama, Narito Amako, Yuna Yamada … Hisao IshibuchiIEEE Access · Osaka Metropolitan University · Osaka Prefecture University · +1
    PDF ↗
  22. 2022
    Continual Learning with Evolving Class OntologiesZhiqiu Lin, Deepak Pathak, Yu-Xiong Wang … Shu KongNeurIPS
    PDF ↗
  23. 2022
    Dataset Knowledge Transfer for Class-Incremental Learning without MemoryHabib Slim, Eden Belouadah, Adrian Popescu, Darian M. OnchişWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +5
    PDF ↗
  24. 2022
    Visual Tracking by Adaptive Continual Meta-LearningJanghoon Choi, Sungyong Baik, Myungsub Choi … Kyoung Mu LeeIEEE Access · Kookmin University · Seoul National University · +1
    PDF ↗
  25. 2022
    Adaptive Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  26. 2022
    LPC: A Logits and Parameter Calibration Framework for Continual LearningXiaodi Li, Zhuoyi Wang, Dingcheng Li … Bhavani ThuraisinghamEMNLP · The University of Texas at Dallas · Baidu (China)
    PDF ↗
  27. 2022
    CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine TranslationHan Zhang, Sheng Zhang, Yang Xiang … Ruifeng XuEMNLP · Harbin Institute of Technology · Peng Cheng Laboratory · +3
    PDF ↗
  28. 2022
    Continual Learning for Natural Language Generations with Transformer CalibrationPeng Yang, Dingcheng Li, Ping LiCoNLL · Bellevue Hospital Center · Cognitive Research (United States)
    PDF ↗
  29. 2022
    Contrastive Supervised Distillation for Continual Representation LearningTommaso Barletti, Niccolò Biondi, Federico Pernici … Alberto Del BimboSpringer LNCS · University of Florence
    PDF ↗
  30. 2022
    Avalanche RL: a Continual Reinforcement Learning LibraryNicoló Lucchesi, Antonio Carta, Vincenzo Lomonaco, Davide BacciuSpringer LNCS · University of Pisa
    PDF ↗
  31. 2022
    Class Incremental Learning for Intent Classification with Limited or No Old DataDebjit Paul, Daniil Sorokin, Judith GaspersFirst Workshop on Ever Evolving NLP (EvoNLP) · École Polytechnique Fédérale de Lausanne
    PDF ↗
  32. 2022
    Continual Learning of Long Topic Sequences in Neural Information Retrieval - abstractThomas Gerald, Laure SoulierSpringer LNCS · Centre National de la Recherche Scientifique · Sorbonne Université · +1
    PDF ↗
  33. 2022
    Continual Referring Expression Comprehension via Dual Modular MemorizationHeng Tao Shen, Cheng Chen, Peng Wang … Jingkuan SongTIP · University of Electronic Science and Technology of China · Peng Cheng Laboratory · +2
    PDF ↗
  34. 2022
    Entropy-Based Vocabulary Substitution for Incremental Learning in Multilingual Neural Machine TranslationKaiyu Huang, Peng Li, Jin Ma, Yang LiuEMNLP · Tsinghua University · Peng Cheng Laboratory · +5
    PDF ↗
  35. 2022
    Adaptive Neural Networks for Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  36. 2022
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  37. 2022
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  38. 2022
    Gating Mechanism in Deep Neural Networks for Resource-Efficient Continual LearningHyundong Jin, Kimin Yun, Eunwoo KimIEEE Access · Chung-Ang University · Electronics and Telecommunications Research Institute
    PDF ↗
  39. 2022
    Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in TransformersPhilip Kenneweg, Alexander Schulz, Sarah Schröder, Barbara HammerSpringer LNCS · Bielefeld University
    PDF ↗
  40. 2022
    Transfer Learning via Test-time Neural Networks AggregationBruno Casella, Alessio Barbaro Chisari, Sebastiano Battiato, Mario Valerio GiuffridaInternational Joint Conference on Computer Vision, Imagin… · University of Catania · University of Turin · +1
    PDF ↗
  41. 2022
    Improving Scheduled Sampling with Elastic Weight Consolidation for Neural Machine TranslationMichalis Korakakis, Andreas VlachosEMNLP · University of Cambridge
    PDF ↗
  42. 2022
    Logarithmic Continual LearningWojciech Masarczyk, Paweł Wawrzyński, Daniel Marczak … T. P. TrzcinskiIEEE Access · Warsaw University of Technology · Jagiellonian University
    PDF ↗
  43. 2022
    An empirical comparison of generators in replay-based continual learningNADZEYA DZEMIDOVICH, Alexander GepperthESANN 2022 proceedings · Fulda University of Applied Sciences
    PDF ↗
  44. 2022
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  45. 2022
    Modular-Relatedness for Continual LearningAmmar Shaker, Francesco Alesiani, Shujian YuSpringer LNCS · UiT The Arctic University of Norway
    PDF ↗
  46. 2022
    Diverse Memory for Experience Replay in Continual LearningAndrii Krutsylo, Paweł MorawieckiESANN 2022 proceedings · Institute of Computer Science · Polish Academy of Sciences
    PDF ↗
  47. 2022
    Continual Incremental Language Learning for Neural Machine TranslationMichele Resta, Davide BacciuESANN 2022 proceedings · University of Pisa · Istituto Nazionale di Fisica Nucleare, Sezione di Pisa
    PDF ↗
  48. 2022
    Incremental Learning With Adaptive Model Search and a Nominal Loss ModelChanho Ahn, Eunwoo Kim, Songhwai OhIEEE Access · Seoul National University · Chung-Ang University
    PDF ↗
  49. 2022
    On Regret Bounds for Continual Single-Index LearningThe Tien MaiSpringer LNCS · Norwegian University of Science and Technology
    PDF ↗
  50. 2022
    Tutorial - Continual Learning beyond classificationAlexander Gepperth, Timothée LesortESANN 2022 proceedings · Fulda University of Applied Sciences · Université de Montréal
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.