Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3551–3600Sort Recent · Most cited
  1. 2022
    Diagnosing Batch Normalization in Class Incremental LearningMinghao Zhou, Quanziang Wang, Jun Shu … Deyu MengarXiv
    PDF ↗
  2. 2022
    Memory Replay with Data Compression for Continual LearningLiyuan Wang, Xingxing Zhang, Kuo Yang … Jun ZhuICLR
    PDF ↗
  3. 2022PDF ↗
  4. 2022PDF ↗
  5. 2022
    Graph Few-shot Class-incremental LearningZhen Tan, Kaize Ding, Ruocheng Guo, Huan LiuWSDM · Arizona State University · City University of Hong Kong
    PDF ↗
  6. 2023
    Incremental Learning of Structured Memory via Closed-Loop TranscriptionShengbang Tong, Xili Dai, Ziyang Wu … Yi MaICLR
    PDF ↗
  7. 2022
    Deep Bayesian Unsupervised Lifelong LearningTingting Zhao, Zifeng Wang, Aria Masoomi, Jennifer DyNeural Networks · Bryant University · Bryan College · +1
    PDF ↗
  8. 2022
    A Neural Network Model of Continual Learning with Cognitive ControlJacob Russin, Maryam Zolfaghar, Seongmin A. Park … Randall C. O’ReillyCognitive Science
    PDF ↗
  9. 2022PDF ↗
  10. 2022
    TRGP: Trust Region Gradient Projection for Continual LearningSen Lin, Li Yang, Deliang Fan, Junshan ZhangICLR
    PDF ↗
  11. 2022
    Improving Pedestrian Prediction Models With Self-Supervised Continual LearningLuzia Knoedler, Chadi Salmi, Hai Zhu … Javier Alonso–MoraRA-L · Delft University of Technology
    PDF ↗
  12. 2022
    Catastrophic Forgetting in Deep Graph Networks: A Graph Classification BenchmarkAntonio Carta, Andrea Cossu, Federico Errica, Davide BacciuFrontiers · University of Pisa · Scuola Normale Superiore
    PDF ↗
  13. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  14. 2022PDF ↗
  15. 2022PDF ↗
  16. 2022PDF ↗
  17. 2022
    PaRT: Parallel Learning Towards Robust and Transparent AIM Paknezhad, Hamsawardhini Rengarajan, Chenghao Yuan … Lee, Hwee KuanarXiv
    PDF ↗
  18. 2022
    The CLEAR Benchmark: Continual LEArning on Real-World ImageryZhiqiu Lin, Jia Shi, Deepak Pathak, Deva RamananNeurIPS
    PDF ↗
  19. 2022
    Lifelong Generative Learning via Knowledge ReconstructionLibo Huang, Zhulin An, Xiang Zhi, Yongjun XuarXiv
    PDF ↗
  20. 2022PDF ↗
  21. 2022
    Brain-inspired global-local learning incorporated with neuromorphic computingYujie Wu, Rong Zhao, Jun Zhu … Luping ShiNature Communications · Tsinghua University · Chinese Institute for Brain Research · +1
    PDF ↗
  22. 2022PDF ↗
  23. 2022PDF ↗
  24. 2022
    Towards Unsupervised Open World Semantic SegmentationSvenja Uhlemeyer, Matthias Rottmann, Hanno GottschalkUAI
    PDF ↗
  25. 2022
    TimeLMs: Diachronic Language Models from TwitterDaniel Loureiro, Francesco Barbieri, Leonardo Neves … Jose Camacho-colladosACL · Universidade do Porto · Snap (United States) · +2
    PDF ↗
  26. 2022
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  27. 2022
    Fine-tuned Language Models are Continual LearnersThomas Scialom, Tuhin Chakrabarty, Smaranda MuresanEMNLP · University of Missouri · Columbia University
    PDF ↗
  28. 2022
    Lifelong Pretraining: Continually Adapting Language Models to Emerging CorporaXisen Jin, Dejiao Zhang, Henghui Zhu … Xiang RenNAACL · University of Southern California · California Southern University
    PDF ↗
  29. 2023
    Continual Learning for Blind Image Quality AssessmentWeixia Zhang, Dingquan Li, Chao Ma … Kede MaTPAMI · Shanghai Jiao Tong University · Peng Cheng Laboratory · +1
    PDF ↗
  30. 2022
    Memory Efficient Continual Learning with TransformersBeyza Ermis, Giovanni Zappella, Martin Wistuba … Cédric ArchambeauNeurIPS
    PDF ↗
  31. 2022
    Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language GenerationDingcheng Li, Zheng Chen, Eunah Cho … Yang LiuNAACL · Amazon (United States)
    PDF ↗
  32. 2022
    S3C: Self-Supervised Stochastic Classifiers for Few-Shot Class-Incremental LearningJayateja Kalla, Soma BiswasECCV · Indian Institute of Science Bangalore
    PDF ↗
  33. 2022
    Repeated Augmented Rehearsal: A Simple but Strong Baseline for Online Continual LearningYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
  34. 2022
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  35. 2022
    Multi-Domain Incremental Learning for Semantic SegmentationPrachi Garg, Rohit Saluja, Vineeth N Balasubramanian … C. V. JawaharWACV · Indian Institute of Technology Hyderabad · Indian Institute of Technology Delhi
    PDF ↗
  36. 2022
    Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic DataKuluhan Binici, Nam Trung Pham, Tulika Mitra, Karianto LemanWACV · Agency for Science, Technology and Research · National University of Singapore · +1
    PDF ↗
  37. 2022
    Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic SamplesYu Xia, Quan Wang, Yajuan Lyu … Dai DaiACL · Peking University · Baidu (China)
    PDF ↗
  38. 2022
    Practical Recommendations for Replay-based Continual Learning MethodsGabriele Merlin, Vincenzo Lomonaco, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  39. 2022
    Multi-Granularity Regularized Re-Balancing for Class Incremental LearningHuitong Chen, Yu Wang, Qinghua HuTKDE · Tianjin University · Tianjin haihe hospital
    PDF ↗
  40. 2022
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  41. 2020
    Drinking From a Firehose: Continual Learning With Web-Scale Natural LanguageHexiang Hu, Ozan Şener, Fei Sha, Vladlen KoltunTPAMI · University of Southern California · Intel (United States)
    PDF ↗
  42. 2023
    Dynamic Self-Supervised Teacher-Student Network LearningFei Ye, Adrian G. BorşTPAMI · University of York
    PDF ↗
  43. 2019
    Lifelong Neural Predictive Coding: Learning Cumulatively Online without ForgettingAlex Ororbia, Ankur Mali, C Lee Giles, Daniel KiferNeurIPS
    PDF ↗
  44. 2022
    Differential Privacy Preservation in Robust Continual LearningAhmad Hassanpour, Majid Moradikia, Bian Yang … Julián FiérrezIEEE Access · Norwegian University of Science and Technology · University of Houston · +1
    PDF ↗
  45. 2022
    Online Continual Learning Via Candidates VotingJiangpeng He, Fengqing ZhuWACV · Purdue University West Lafayette
    PDF ↗
  46. 2022
    Learning Representations for New Sound Classes With Continual Self-Supervised LearningZhepei Wang, Cem Subakan, Xilin Jiang … Paris SmaragdisIEEE Signal Processing Letters · University of Illinois Urbana-Champaign · Concordia University · +2
    PDF ↗
  47. 2022
    Unsupervised Continual Learning via Self-Adaptive Deep Clustering ApproachMahardhika Pratama, Andri Ashfahani, Edwin LughoferSpringer LNCS · University of South Australia · Nanyang Technological University
    PDF ↗
  48. 2022
    Knowledge Capture and Replay for Continual LearningSaisubramaniam Gopalakrishnan, Pranshu Ranjan Singh, Haytham M. Fayek … ArulMurugan AmbikapathiWACV · Agency for Science, Technology and Research · Institute for Infocomm Research · +1
    PDF ↗
  49. 2022
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  50. 2022
    Continual Learning In Environments With Polynomial Mixing TimesMatthew Riemer, Sharath Chandra Raparthy, Ignacio Cases … Irina RishNeurIPS
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.