Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

532 papers of 6,984 · showing 51–100Sort Recent · Most cited
  1. 2021
    Self-Supervised Class Incremental LearningZixuan Ni, Siliang Tang, Yueting ZhuangarXiv
    PDF ↗
  2. 2021
    Continual Learning via Local Module CompositionOleksiy Ostapenko, Pau Rodríguez, M. Caccia, Laurent CharlinNeurIPS · Taras Shevchenko National University of Kyiv · University of Insubria · +1
    PDF ↗
  3. 2021
    Target Layer Regularization for Continual Learning Using Cramer-Wold GeneratorMarcin Mazur, Łukasz Pustelnik, Szymon Knop … Przemysław SpurekarXiv
    PDF ↗
  4. 2021
    Kronecker Factorization for Preventing Catastrophic Forgetting in Large-scale Medical Entity LinkingDenis Jered McInerney, Luyang Kong, Kristjan Arumae … Parminder BhatiaarXiv · Universidad del Noreste · Amazon (Germany)
    PDF ↗
  5. 2021
    Reactive Multi-Fitness Learning for Robust Multiagent TeamingConnor Yates, Ayhan Alp Aydeniz, Kagan TumerInternational Symposium on Multi-Robot and Multi-Agent Sy… · Oregon State University
  6. 2021PDF ↗
  7. 2021
    One Pass ImageNetHuiyi Hu, Ang Li, Daniele Calandriello, Dilan GörürarXiv
    PDF ↗
  8. 2021
    A Meta-Learned Neuron model for Continual LearningRodrigue SiryarXiv · Normandie Université · Université de Caen Normandie
    PDF ↗
  9. 2021
    Continual learning classification method with single-label memory cells based on the intelligent mechanism of the biological immune systemDong Li, Lanlan Gong, Shulin Liu … Kun QianJournal of Intelligent & Fuzzy Systems · Changzhou University · Shanghai University
  10. 2021
    Incremental Learning of Object Detector with Limited Training DataMuhammad Abdullah Hafeez, Adnan Ul-Hasan, Faisal ShafaitDigital Image Computing: Techniques and Applications (DICTA) · Abdus Salam Centre for Physics · National University of Sciences and Technology
  11. 2021
    Novelty detection for unsupervised continual learning in image sequencesRuiqi Dai, Mathieu Lefort, Frédéric Armetta … Stefan DuffnerIEEE 33rd International Conference on Tools with Artifici… · Lyon 1 Université · Centre National de la Recherche Scientifique · +3
  12. 2021
    A Novel Class-wise Forgetting Detector in Continual LearningXuan Cuong Pham, Alan Wee‐Chung Liew, Can WangDigital Image Computing: Techniques and Applications (DICTA) · Griffith University
  13. 2021
    Variance Guided Continual Learning in a Convolutional Neural Network Gaussian Process Single Classifier Approach for Multiple Tasks in Noisy ImagesMahed Javed, Lyudmila Mihaylova, Nidhal BouaynayaInformation Fusion · University of Sheffield · Rowan University
    PDF ↗
  14. 2021
    Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat MinimaGuangyuan Shi, Jiaxin Chen, Wenlong Zhang … Xiao-Ming WuNeurIPS · Hong Kong Polytechnic University
    PDF ↗
  15. 2021
    Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeeNeurIPS · Harbin Institute of Technology · National University of Singapore
    PDF ↗
  16. 2021
    Learning where to learn: Gradient sparsity in meta and continual learningJohannes von Oswald, Dominic Zhao, Seijin Kobayashi … João SacramentoNeurIPS
    PDF ↗
  17. 2021
    Structure Aware Experience Replay for Incremental Learning in Graph-based Recommender SystemsKian Ahrabian, Yishi Xu, Yingxue Zhang … Mark CoatesACM International Conference on Information & Knowled… · McGill University · Huawei Technologies (Canada)
  18. 2021
    Going Beyond the Point Neuron: Active Dendrites and Sparse Representations for Continual LearningKaran Grewal, Jérémy Forest, Benjamin P. Cohen, Subutai AhmadbioRxiv · Numerica Corporation (United States) · Lumentum (United States)
  19. 2021PDF ↗
  20. 2021PDF ↗
  21. 2021
    Exploring System Performance of Continual Learning for Mobile and Embedded Sensing ApplicationsYoung D. Kwon, Jagmohan Chauhan, Abhishek Kumar … Cecilia MascoloTyöväentutkimus Vuosikirja · University of Cambridge · University of Southampton
    PDF ↗
  22. 2021
    Mixture-of-Variational-Experts for Continual LearningHeinke Hihn, Daniel BraunarXiv · Universität Ulm
    PDF ↗
  23. 2021
    AFEC: Active Forgetting of Negative Transfer in Continual LearningLiyuan Wang, Ming‐Tian Zhang, Zhongfan Jia … Yi ZhongNeurIPS · Tsinghua University · University College London
    PDF ↗
  24. 2021
    Center Loss Regularization for Continual LearningKaustubh Olpadkar, Ekta GavasarXiv
    PDF ↗
  25. 2021
    A Biologically Plausible Model for Continual Learning using Synaptic Weight AttractorsRomik Ghosh, D. Mastrovito, Ştefan MihalaşbioRxiv · Ohio University · Allen Institute · +3
  26. 2021
    A TinyML Platform for On-Device Continual Learning With Quantized Latent ReplaysLeonardo Ravaglia, Manuele Rusci, Davide Nadalini … Luca BeniniIEEE Journal on Emerging and Selected Topics in Circuits… · University of Bologna · University of Modena and Reggio Emilia · +1
    PDF ↗
  27. 2021
    Continual Learning in Multilingual NMT via Language-Specific EmbeddingsAlexandre BérardConference on Machine Translation
    PDF ↗
  28. 2021
    Coordinating Experience Replay: A Harmonious Experience Retention approach for Continual LearningZhong Ji, Jiayi Liu, Qiang Wang, Zhongfei ZhangKnowledge-Based Systems · Tianjin University · State Key Laboratory on Integrated Optoelectronics · +1
  29. 2021
    Behavioral Experiments for Understanding Catastrophic ForgettingSamuel J. Bell, Neil D. LawrencearXiv · University of Cambridge
    PDF ↗
  30. 2021
    Class Incremental Online Streaming LearningSoumya Banerjee, Vinay Kumar Verma, Toufiq Parag … Vinay P. NamboodiriarXiv · Indian Institute of Technology Kanpur · Duke University · +1
    PDF ↗
  31. 2021
    A Simple Approach to Continual Learning by Transferring Skill ParametersK.R. Zentner, Ryan Julian, Ujjwal Puri … Gaurav S. SukhatmearXiv
    PDF ↗
  32. 2021PDF ↗
  33. 2021
    Dendritic Self-Organizing Maps for Continual LearningKosmas Pinitas, Spyridon Chavlis, Panayiota PoiraziarXiv · Technical University of Crete · Foundation for Research and Technology Hellas
    PDF ↗
  34. 2021
    Co-Transport for Class-Incremental LearningDa-Wei Zhou, Han-Jia Ye, De‐Chuan ZhanACM International Conference on Multimedia · Nanjing University
    PDF ↗
  35. 2021
    CoReD: Generalizing Fake Media Detection with Continual Representation using DistillationMinha Kim, Shahroz Tariq, Simon S. WooACM MM · Sungkyunkwan University
    PDF ↗
  36. 2021
    An EM Framework for Online Incremental Learning of Semantic SegmentationShipeng Yan, Jiale Zhou, Jiangwei Xie … Xuming HeACM International Conference on Multimedia · ShanghaiTech University · Shanghai Institute of Microsystem and Information Technology · +1
    PDF ↗
  37. 2021
    When Video Classification Meets Incremental ClassesHanbin Zhao, Xin Qin, Shihao Su … Xi LiACM International Conference on Multimedia · Zhejiang University
    PDF ↗
  38. 2021
    Remember and Reuse: Cross-Task Blind Image Quality Assessment via Relevance-aware Incremental LearningRui Ma, Hanxiao Luo, Qingbo Wu … Linfeng XuACM International Conference on Multimedia · University of Electronic Science and Technology of China
  39. 2021
    Accounting for the Effect of Inter-Task Similarity in Continual Learning Models*Alaa El Khatib, Mahmoud Nasr, Fakhri KarrayIEEE International Conference on Systems, Man, and Cybern… · University of Waterloo
  40. 2021
    Accelerating Lifelong Reinforcement Learning via Reshaping Rewards*Kun Chu, Xianchao Zhu, William ZhuIEEE International Conference on Systems, Man, and Cybern… · University of Electronic Science and Technology of China
  41. 2021
    Growing Representation LearningRyan King, Bobak J. MortazaviarXiv
    PDF ↗
  42. 2021
    Blind Adaptive Gait Planning on Non-stationary Environments via Continual Reinforcement LearningHao Hu, Yang LiuIEEE International Conference on Unmanned Systems (ICUS) · Sun Yat-sen University
  43. 2021
    Carousel Memory: Rethinking the Design of Episodic Memory for Continual LearningSoobee Lee, Minindu Weerakoon, Jonghyun Choi … Myeongjae JeonarXiv · Ulsan National Institute of Science and Technology · Gwangju Institute of Science and Technology · +1
    PDF ↗
  44. 2021
    Online Continual Learning in Image Classification: An Empirical SurveyZheda Mai, Ruiwen Li, Jihwan Jeong … Scott SannerNeurocomputing · University of New Brunswick · University of Toronto · +1
    PDF ↗
  45. 2021
    Block Contextual MDPs for Continual LearningShagun Sodhani, Franziska Meier, Joëlle Pineau, Amy ZhangConference on Learning for Dynamics & Control · Meta (Israel)
    PDF ↗
  46. 2021
    Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual LearningDanruo Deng, Guangyong Chen, Jianye Hao … Pheng‐Ann HengNeurIPS · Chinese University of Hong Kong · Shenzhen Institutes of Advanced Technology · +1
    PDF ↗
  47. 2021
    Combining Accuracy and Plasticity in Convolutional Neural Networks Based on Resistive Memory Arrays for Autonomous LearningS. Bianchi, Irene Muñoz-Martín, Erika Covi … Daniele IelminiIEEE Journal on Exploratory Solid-State Computational Dev… · Politecnico di Milano · NaMLab (Germany) · +4
  48. 2021
    Omnidirectional Transfer for Quasilinear Lifelong LearningJayanta Dey, Joshua T Vogelstein, Hayden S. Helm … Carey E. PriebeResearch Square · Johns Hopkins University · Baylor College of Medicine · +1
  49. 2021
  50. 2021
    Hypernetworks for Continual Semi-Supervised LearningDhanajit Brahma, Vinay Kumar Verma, Piyush RaiarXiv · Indian Institute of Technology Kanpur
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.