Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3651–3700Sort Recent · Most cited
  1. 2022PDF ↗
  2. 2022PDF ↗
  3. 2022PDF ↗
  4. 2022
    Robust Saliency Guidance for Data-free Class Incremental LearningXialei Liu, Jiang-Tian Zhai, Andrew D. Bagdanov … Ming-Ming ChengarXiv
    PDF ↗
  5. 2021PDF ↗
  6. 2021
    Embodied Learning for Lifelong Visual PerceptionDavid Nilsson, Aleksis Pirinen, Erik Gärtner, Cristian SminchisescuarXiv
    PDF ↗
  7. 2021
    Generative Kernel Continual learningMohammad Mahdi Derakhshani, Xiantong Zhen, Ling Shao, Cees G. M. SnoekarXiv
    PDF ↗
  8. 2021
    DILF-EN framework for Class-Incremental LearningMohammed Asad Karim, Indu Joshi, Pratik Mazumder, Pravendra SingharXiv
    PDF ↗
  9. 2021
    How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?Dong, Xinhsuai, Tuan, Luu Anh, Min Lin … Hanwang ZhangNeurIPS
    PDF ↗
  10. 2020PDF ↗
  11. 2023
    An Empirical Investigation of the Role of Pre-training in Lifelong LearningSanket Vaibhav Mehta, Darshan Patil, Sarath Chandar, Emma StrubellJMLR
    PDF ↗
  12. 2021PDF ↗
  13. 2021
    Imbal-OL: Online Machine Learning from Imbalanced Data Streams in Real-world IoTBharath Sudharsan, John G. Breslin, Muhammad Intizar AliIEEE International Conference on Big Data (Big Data) · Ollscoil na Gaillimhe – University of Galway · Dublin City University
    PDF ↗
  14. 2021PDF ↗
  15. 2021
    Incremental Learning for End-to-End Automatic Speech RecognitionLi Fu, Xiaoxiao Li, Libo Zi … Bowen ZhouIEEE Automatic Speech Recognition and Understanding Works… · Jingdong (China)
    PDF ↗
  16. 2021
    Improving Vision Transformers for Incremental LearningPei Yu, Yinpeng Chen, Ying Jin, Zicheng LiuarXiv
    PDF ↗
  17. 2020
    MgSvF: Multi-Grained Slow versus Fast Framework for Few-Shot Class-Incremental LearningHanbin Zhao, Yongjian Fu, Mintong Kang … Xi LiTPAMI · Zhejiang University of Science and Technology · Huawei Technologies (China)
    PDF ↗
  18. 2022PDF ↗
  19. 2022
    Modeling the Background for Incremental and Weakly-Supervised Semantic SegmentationFabio Cermelli, Massimiliano Mancini, Samuel Rota Bulo … Barbara CaputoTPAMI · Politecnico di Torino · TH Bingen University of Applied Sciences · +3
    PDF ↗
  20. 2021
    Gradient-matching coresets for continual learningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  21. 2022
    CoMPS: Continual Meta Policy SearchGlen Berseth, Zhiwei Zhang, Grace Zhang … Sergey LevineICLR
    PDF ↗
  22. 2021PDF ↗
  23. 2021
    Overcome Anterograde Forgetting with Cycled Memory NetworksJian Peng, Dingqi Ye, Bo Tang … Haifeng LiarXiv
    PDF ↗
  24. 2022PDF ↗
  25. 2022
    Controlling Conditional Language Models without Catastrophic ForgettingTomasz Korbak, Hady Elsahar, Germán Kruszewski, Marc DymetmanICML
    PDF ↗
  26. 2021
    Continual Learning for Multivariate Time Series Tasks with Variable Input DimensionsVibhor Gupta, Jyoti Narwariya, Pankaj Malhotra … Gautam ShroffICDM
    PDF ↗
  27. 2021PDF ↗
  28. 2021
    CVPR 2020 Continual Learning in Computer Vision Competition: Approaches, Results, Current Challenges and Future DirectionsVincenzo Lomonaco, Lorenzo Pellegrini, Pau Rodríguez … Davide MaltoniArtificial Intelligence · University of Bologna · Mila - Quebec Artificial Intelligence Institute · +7
    PDF ↗
  29. 2021
    Reviewing continual learning from the perspective of human-level intelligenceYifan Chang, Wenbo Li, Jian Peng … Haifeng LiarXiv
    PDF ↗
  30. 2021
    Learning by Active Forgetting for Neural NetworksJian Peng, Xian Sun, Min Deng … Haifeng LiarXiv · Central South University
    PDF ↗
  31. 2021
    Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights ModificationYanni Li, Bing Liu, Kaicheng Yao … Jiangtao CuiarXiv
    PDF ↗
  32. 2021
    Lifelong Reinforcement Learning with Temporal Logic Formulas and Reward MachinesXuejing Zheng, Chao Yu, Chen Chen … Hankz Hankui ZhuoarXiv
    PDF ↗
  33. 2021
    Self-Supervised Class Incremental LearningZixuan Ni, Siliang Tang, Yueting ZhuangarXiv
    PDF ↗
  34. 2021
    Continual Learning via Local Module CompositionOleksiy Ostapenko, Pau Rodríguez, M. Caccia, Laurent CharlinNeurIPS · Taras Shevchenko National University of Kyiv · University of Insubria · +1
    PDF ↗
  35. 2021
    Target Layer Regularization for Continual Learning Using Cramer-Wold GeneratorMarcin Mazur, Łukasz Pustelnik, Szymon Knop … Przemysław SpurekarXiv
    PDF ↗
  36. 2021
    Kronecker Factorization for Preventing Catastrophic Forgetting in Large-scale Medical Entity LinkingDenis Jered McInerney, Luyang Kong, Kristjan Arumae … Parminder BhatiaarXiv · Universidad del Noreste · Amazon (Germany)
    PDF ↗
  37. 2021PDF ↗
  38. 2021
    One Pass ImageNetHuiyi Hu, Ang Li, Daniele Calandriello, Dilan GörürarXiv
    PDF ↗
  39. 2021
    A Meta-Learned Neuron model for Continual LearningRodrigue SiryarXiv · Normandie Université · Université de Caen Normandie
    PDF ↗
  40. 2022
    Incremental Object Detection via Meta-LearningK J Joseph, Jathushan Rajasegaran, Salman Khan … Vineeth N BalasubramanianTPAMI · Indian Institute of Technology Hyderabad · Mohamed bin Zayed University of Artificial Intelligence
    PDF ↗
  41. 2021
    Variance Guided Continual Learning in a Convolutional Neural Network Gaussian Process Single Classifier Approach for Multiple Tasks in Noisy ImagesMahed Javed, Lyudmila Mihaylova, Nidhal BouaynayaInformation Fusion · University of Sheffield · Rowan University
    PDF ↗
  42. 2021
    Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat MinimaGuangyuan Shi, Jiaxin Chen, Wenlong Zhang … Xiao-Ming WuNeurIPS · Hong Kong Polytechnic University
    PDF ↗
  43. 2021
    Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeeNeurIPS · Harbin Institute of Technology · National University of Singapore
    PDF ↗
  44. 2021
    Learning where to learn: Gradient sparsity in meta and continual learningJohannes von Oswald, Dominic Zhao, Seijin Kobayashi … João SacramentoNeurIPS
    PDF ↗
  45. 2022
    Provable Lifelong Learning of RepresentationsXinyuan Cao, Weiyang Liu, Santosh VempalaAISTATS · Georgia Institute of Technology · University of Cambridge
    PDF ↗
  46. 2021PDF ↗
  47. 2021PDF ↗
  48. 2021
    Exploring System Performance of Continual Learning for Mobile and Embedded Sensing ApplicationsYoung D. Kwon, Jagmohan Chauhan, Abhishek Kumar … Cecilia MascoloTyöväentutkimus Vuosikirja · University of Cambridge · University of Southampton
    PDF ↗
  49. 2021
    Mixture-of-Variational-Experts for Continual LearningHeinke Hihn, Daniel BraunarXiv · Universität Ulm
    PDF ↗
  50. 2021
    AFEC: Active Forgetting of Negative Transfer in Continual LearningLiyuan Wang, Ming‐Tian Zhang, Zhongfan Jia … Yi ZhongNeurIPS · Tsinghua University · University College London
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.