Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3701–3750Sort Recent · Most cited
  1. 2022
    Wide Neural Networks Forget Less CatastrophicallySeyed Iman Mirzadeh, Arslan Chaudhry, Yin, Dong … Mehrdad FarajtabarICML · Google (United States)
    PDF ↗
  2. 2021
    Center Loss Regularization for Continual LearningKaustubh Olpadkar, Ekta GavasarXiv
    PDF ↗
  3. 2021
    A TinyML Platform for On-Device Continual Learning With Quantized Latent ReplaysLeonardo Ravaglia, Manuele Rusci, Davide Nadalini … Luca BeniniIEEE Journal on Emerging and Selected Topics in Circuits… · University of Bologna · University of Modena and Reggio Emilia · +1
    PDF ↗
  4. 2021
    Continual Learning in Multilingual NMT via Language-Specific EmbeddingsAlexandre BérardConference on Machine Translation
    PDF ↗
  5. 2021
    Behavioral Experiments for Understanding Catastrophic ForgettingSamuel J. Bell, Neil D. LawrencearXiv · University of Cambridge
    PDF ↗
  6. 2021
    Class Incremental Online Streaming LearningSoumya Banerjee, Vinay Kumar Verma, Toufiq Parag … Vinay P. NamboodiriarXiv · Indian Institute of Technology Kanpur · Duke University · +1
    PDF ↗
  7. 2022
    Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime InferenceHyunseo Koh, Dahyun Kim, Jung-Woo Ha, Jonghyun ChoiICLR · Gwangju Institute of Science and Technology
    PDF ↗
  8. 2022PDF ↗
  9. 2021
    A Simple Approach to Continual Learning by Transferring Skill ParametersK.R. Zentner, Ryan Julian, Ujjwal Puri … Gaurav S. SukhatmearXiv
    PDF ↗
  10. 2021PDF ↗
  11. 2021
    Dendritic Self-Organizing Maps for Continual LearningKosmas Pinitas, Spyridon Chavlis, Panayiota PoiraziarXiv · Technical University of Crete · Foundation for Research and Technology Hellas
    PDF ↗
  12. 2021
    Co-Transport for Class-Incremental LearningDa-Wei Zhou, Han-Jia Ye, De‐Chuan ZhanACM International Conference on Multimedia · Nanjing University
    PDF ↗
  13. 2021
    CoReD: Generalizing Fake Media Detection with Continual Representation using DistillationMinha Kim, Shahroz Tariq, Simon S. WooACM MM · Sungkyunkwan University
    PDF ↗
  14. 2021
    An EM Framework for Online Incremental Learning of Semantic SegmentationShipeng Yan, Jiale Zhou, Jiangwei Xie … Xuming HeACM International Conference on Multimedia · ShanghaiTech University · Shanghai Institute of Microsystem and Information Technology · +1
    PDF ↗
  15. 2021
    When Video Classification Meets Incremental ClassesHanbin Zhao, Xin Qin, Shihao Su … Xi LiACM International Conference on Multimedia · Zhejiang University
    PDF ↗
  16. 2021
    Growing Representation LearningRyan King, Bobak J. MortazaviarXiv
    PDF ↗
  17. 2021
    Carousel Memory: Rethinking the Design of Episodic Memory for Continual LearningSoobee Lee, Minindu Weerakoon, Jonghyun Choi … Myeongjae JeonarXiv · Ulsan National Institute of Science and Technology · Gwangju Institute of Science and Technology · +1
    PDF ↗
  18. 2021
    Online Continual Learning in Image Classification: An Empirical SurveyZheda Mai, Ruiwen Li, Jihwan Jeong … Scott SannerNeurocomputing · University of New Brunswick · University of Toronto · +1
    PDF ↗
  19. 2022
    Representational Continuity for Unsupervised Continual LearningDivyam Madaan, Jaehong Yoon, Yuanchun Li … Sung Ju HwangICLR
    PDF ↗
  20. 2022
    Subspace Regularizers for Few-Shot Class Incremental LearningAfra Feyza Aky\"urek, Afra Feyza Akyürek, Derry Wijaya, Jacob AndreasICLR
    PDF ↗
  21. 2021
    Block Contextual MDPs for Continual LearningShagun Sodhani, Franziska Meier, Joëlle Pineau, Amy ZhangConference on Learning for Dynamics & Control · Meta (Israel)
    PDF ↗
  22. 2021
    Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual LearningDanruo Deng, Guangyong Chen, Jianye Hao … Pheng‐Ann HengNeurIPS · Chinese University of Hong Kong · Shenzhen Institutes of Advanced Technology · +1
    PDF ↗
  23. 2022
    Towards Continual Knowledge Learning of Language ModelsJoel Jang, Seonghyeon Ye, Sohee Yang … Minjoon SeoICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  24. 2022
    CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and ComparabilityMartin Mundt, Steven Lang, Quentin Delfosse, Kristian KerstingICLR · Technische Universität Darmstadt
    PDF ↗
  25. 2022
    Objects in Semantic TopologyShuo Yang, Peize Sun, Yi Jiang … Min XuICLR
    PDF ↗
  26. 2022
    Sequential Reptile: Inter-Task Gradient Alignment for Multilingual LearningSeanie Lee, Haebeom Lee, Juho Lee, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  27. 2021
    Omnidirectional Transfer for Quasilinear Lifelong LearningJayanta Dey, Joshua T Vogelstein, Hayden S. Helm … Carey E. PriebeResearch Square · Johns Hopkins University · Baylor College of Medicine · +1
    PDF ↗
  28. 2021
    Hypernetworks for Continual Semi-Supervised LearningDhanajit Brahma, Vinay Kumar Verma, Piyush RaiarXiv · Indian Institute of Technology Kanpur
    PDF ↗
  29. 2021
    GROWN: GRow Only When Necessary for Continual LearningYang, Li, Sen Lin, Junshan Zhang, Deliang FanarXiv
    PDF ↗
  30. 2021
    Co2L: Contrastive Continual LearningHyuntak Cha, Jaeho Lee, Jinwoo ShinICCV · Korea Advanced Institute of Science and Technology
    PDF ↗
  31. 2021PDF ↗
  32. 2021
    SS-IL: Separated Softmax for Incremental LearningHongjoon Ahn, Jihwan Kwak, Subin Lim … Taesup MoonICCV · Sungkyunkwan University · Seoul National University
    PDF ↗
  33. 2021
    Always Be Dreaming: A New Approach for Data-Free Class-Incremental LearningJames Smith, Yen-Chang Hsu, Jonathan Balloch … Zsolt KiraICCV · Georgia Institute of Technology · Samsung (United States) · +1
    PDF ↗
  34. 2021
    RECALL: Replay-based Continual Learning in Semantic SegmentationAndrea Maracani, Umberto Michieli, Marco Toldo, Pietro ZanuttighICCV · University of Padua
    PDF ↗
  35. 2021
    Rehearsal revealed: The limits and merits of revisiting samples in continual learningEli Verwimp, Matthias De Lange, Tinne TuytelaarsICCV · KU Leuven
    PDF ↗
  36. 2021
    Online Continual Learning with Natural Distribution Shifts: An Empirical Study with Visual DataZhipeng Cai, Ozan Şener, Vladlen KoltunICCV · Intel (United States)
    PDF ↗
  37. 2021
    Deep Metric Learning for Open World Semantic SegmentationJun Cen, Yun Peng, Junhao Cai … Ming LiuICCV · Hong Kong University of Science and Technology · Sun Yat-sen University
    PDF ↗
  38. 2021
    Synthesized Feature based Few-Shot Class-Incremental Learning on a Mixture of SubspacesAli Cheraghian, Shafin Rahman, Sameera Ramasinghe … Mehrtash HarandiICCV · Australian National University · Data61 · +2
    PDF ↗
  39. 2021
    Generalized and Incremental Few-Shot Learning by Explicit Learning and Calibration without ForgettingAnna Kukleva, Hilde Kuehne, Bernt SchieleICCV · Max Planck Society · Max Planck Innovation · +4
    PDF ↗
  40. 2021
    Wanderlust: Online Continual Object Detection in the Real WorldJianren Wang, Xin Wang, Yue Shang-Guan, Abhinav GuptaICCV · Carnegie Mellon University · Microsoft Research (United Kingdom) · +1
    PDF ↗
  41. 2021
    Class-Incremental Learning for Action Recognition in VideosJaeyoo Park, Minsoo Kang, Bohyung HanICCV · Seoul National University
    PDF ↗
  42. 2021
    Powerpropagation: A sparsity inducing weight reparameterisationJonathan Schwarz, Siddhant M. Jayakumar, Razvan Pascanu … Yee Whye TehNeurIPS · Google (United States)
    PDF ↗
  43. 2021
    Continual Learning on Noisy Data Streams via Self-Purified ReplayChris Dongjoo Kim, Jinseo Jeong, Sangwoo Moon, Gunhee KimICCV · Seoul National University
    PDF ↗
  44. 2021
    Online Continual Learning For Visual Food ClassificationJiangpeng He, Fengqing ZhuICCV · Purdue University West Lafayette
    PDF ↗
  45. 2021
    Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential ObservationsZike Yan, Yuxin Tian, Xuesong Shi … Hongbin ZhaICCV · King University · Peking University · +1
    PDF ↗
  46. 2021
    Few-Shot and Continual Learning with Attentive Independent MechanismsEugene Lee, Cheng‐Han Huang, Chen‐Yi LeeICCV · National Yang Ming Chiao Tung University
    PDF ↗
  47. 2021
    Continual Learning for Image-Based Camera LocalizationShuzhe Wang, Zakaria Laskar, Iaroslav Melekhov … Juho KannalaICCV · Aalto University · Kaneka (United States)
    PDF ↗
  48. 2021PDF ↗
  49. 2021PDF ↗
  50. 2021
    Towards a theory of out-of-distribution learningJayanta Dey, Ali Geisa, Ronak Mehta … Joshua T. VogelsteinarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.