Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

645 papers of 4,574 · showing 51–100Sort Recent · Most cited
  1. 2023PDF ↗
  2. 2023PDF ↗
  3. 2023
    Carpe diem: On the Evaluation of World Knowledge in Lifelong Language ModelsYujin Kim, Jaehong Yoon, Seonghyeon Ye … Yun, Se-youngNAACL
    PDF ↗
  4. 2023
    Extending Multilingual Machine Translation through Imitation LearningWen‐Cheng Lai, Viktor Hangya, Shen, Yingli, Fraser, AlexanderarXiv
    PDF ↗
  5. 2023PDF ↗
  6. 2023
    Leveraging Hamilton-Jacobi PDEs with time-dependent Hamiltonians for continual scientific machine learningPaula Chen, Tingwei Meng, Zongren Zou … George Em KarniadakisConference on Learning for Dynamics & Control
    PDF ↗
  7. 2023
    LifeLearner: Hardware-Aware Meta Continual Learning System for Embedded Computing PlatformsYoung D. Kwon, Jagmohan Chauhan, Hong Jia … Cecilia MascoloACM International Conference on Embedded Networked Sensor…
    PDF ↗
  8. 2023
    Efficiently Adapting Pretrained Language Models To New LanguagesZoltan Csaki, Pian Pawakapan, Urmish Thakker, Qiantong XuarXiv
    PDF ↗
  9. 2023PDF ↗
  10. 2023
    Continual Learning Under Language ShiftEvangelia Gogoulou, Timothée Lesort, Magnus Boman, Joakim NivreInternational Conference on Text, Speech and Dialogue
    PDF ↗
  11. 2023
    Look-Ahead Selective Plasticity for Continual Learning of Visual TasksRouzbeh Meshkinnejad, Jie Mei, Daniel J. Lizotte, Yalda MohsenzadehUniReps
    PDF ↗
  12. 2023
    Class-wise Classifier Design Capable of Continual Learning using Adaptive Resonance Theory-based Topological ClusteringNaoki Masuyama, Yusuke Nojima, Farhan Dawood, Zongying LiuApplied Sciences · Osaka Metropolitan University · Tokyo Metropolitan University · +3
    PDF ↗
  13. 2023
    A Definition of Open-Ended Learning Problems for Goal-Conditioned AgentsOlivier Sigaud, Gianluca Baldassarre, Cédric Colas … Vieri Giuliano SantucciarXiv · Sorbonne Université · Institut Systèmes Intelligents et de Robotique · +5
    PDF ↗
  14. 2023PDF ↗
  15. 2023
    Class Incremental Learning with Pre-trained Vision-Language ModelsXialei Liu, Xusheng Cao, Haori Lu … Ming‐Ming ChengarXiv
    PDF ↗
  16. 2023
    Constructing Sample-to-Class Graph for Few-Shot Class-Incremental LearningFuyuan Hu, Jian Zhang, Fan Lyu … Fenglei XuarXiv
    PDF ↗
  17. 2023
    NPCL: Neural Processes for Uncertainty-Aware Continual LearningSaurav Jha, Dong Gong, He Zhao, Lina YaoNeurIPS
    PDF ↗
  18. 2023
    Fast Trainable Projection for Robust Fine-TuningJunjiao Tian, Yen‐Cheng Liu, Smith, James Seale, Zsolt KiraNeurIPS
    PDF ↗
  19. 2023PDF ↗
  20. 2023
    Using Curiosity for an Even Representation of Tasks in Continual Offline Reinforcement LearningPankayaraj Pathmanathan, Natalia Díaz-Rodríguez, Javier Del SerCognitive Computation · University of Maryland, College Park · Universidad de Granada · +3
    PDF ↗
  21. 2023
    Handling Label Uncertainty for Camera Incremental Person Re-IdentificationZexian Yang, Dayan Wu, Wanqian Zhang … Weipinng WangACM International Conference on Multimedia · Institute of Information Engineering · University of Chinese Academy of Sciences · +1
    PDF ↗
  22. 2023
    CUCL: Codebook for Unsupervised Continual LearningCheng Chen, Jingkuan Song, Xiaosu Zhu … Heng Tao ShenACM MM · University of Electronic Science and Technology of China
    PDF ↗
  23. 2023
    FDCNet: Feature Drift Compensation Network for Class-Incremental Weakly Supervised Object LocalizationSejin Park, Tae‐Hyung Lee, Yeejin Lee, Byeongkeun KangACM MM · Seoul National University of Science and Technology
    PDF ↗
  24. 2023
    Towards Fast and Stable Federated Learning: Confronting Heterogeneity via Knowledge AnchorJinqian Chen, Jihua Zhu, Qinghai ZhengACM MM · Xi'an Jiaotong University · Fuzhou University
    PDF ↗
  25. 2023
    UER: A Heuristic Bias Addressing Approach for Online Continual LearningHuiwei Lin, Shanshan Feng, Baoquan Zhang … Yunming YeACM International Conference on Multimedia · Harbin Institute of Technology
    PDF ↗
  26. 2023
    Neuro-Inspired Fragmentation and Recall to Overcome Catastrophic Forgetting in CuriosityJaedong Hwang, Zhang-Wei Hong, Eric Chen … Ila FietearXiv
    PDF ↗
  27. 2023
    Lifetime policy reuse and the importance of task capacityDavid M. Bossens, A.J. SobeyAI Communications · University of Southampton · Turing Institute · +1
    PDF ↗
  28. 2023
    Minimax Forward and Backward Learning of Evolving Tasks with Performance GuaranteesVerónica Álvarez, Santiago Mazuelas, José A. LozanoNeurIPS
    PDF ↗
  29. 2023
    COPR: Continual Learning Human Preference through Optimal Policy RegularizationHan Zhang, Lin Gui, Yuanzhao Zhai … Ruifeng XuarXiv
    PDF ↗
  30. 2023
    CITB: A Benchmark for Continual Instruction TuningZihan Zhang, Meng Fang, Ling Chen, Mohammad‐Reza Namazi‐RadEMNLP
    PDF ↗
  31. 2023
    Continual Named Entity Recognition without Catastrophic ForgettingDuzhen Zhang, Cong Wei, Jiahua Dong … Zhen FangEMNLP
    PDF ↗
  32. 2023
    Coordinated Replay Sample Selection for Continual Federated LearningJack Good, Jimit Majmudar, Christophe Dupuy … Rahul GuptaEMNLP
    PDF ↗
  33. 2023
    Orthogonal Subspace Learning for Language Model Continual LearningXinghuan Wang, Tianze Chen, Qiming Ge … Xuanjing HuangEMNLP
    PDF ↗
  34. 2023PDF ↗
  35. 2023
    Continual Learning for Generative Retrieval over Dynamic CorporaJiangui Chen, Ruqing Zhang, Jiafeng Guo … Xueqi ChengCIKM · University of Chinese Academy of Sciences · Amsterdam University of the Arts · +1
    PDF ↗
  36. 2023
    Task Relation Distillation and Prototypical Pseudo Label for Incremental Named Entity RecognitionDuzhen Zhang, Hongliu Li, Wei Wei Cong … Xiuyi ChenCIKM · Baidu (China) · Hong Kong Polytechnic University · +3
    PDF ↗
  37. 2023
    L2R: Lifelong Learning for First-stage Retrieval with Backward-Compatible RepresentationsYinqiong Cai, Keping Bi, Yixing Fan … Xueqi ChengCIKM · University of Chinese Academy of Sciences
    PDF ↗
  38. 2023
    Look At Me, No Replay! SurpriseNet: Anomaly Detection Inspired Class Incremental LearningAnton Lee, Yaqian Zhang, Heitor Murilo Gomes … Bernhard PfahringerCIKM · Victoria University of Wellington · University of Waikato
    PDF ↗
  39. 2023
    Towards a General Framework for Continual Learning with Pre-trainingLiyuan Wang, Jingyi Xie, Xingxing Zhang … Jun ZhuarXiv
    PDF ↗
  40. 2023
    Continual Invariant Risk MinimizationFrancesco Alesiani, Shujian Yu, Mathias NiepertarXiv
    PDF ↗
  41. 2023
    Learnware: small models do bigZhihua Zhou, Zhi-Hao TanInformation Sciences · Nanjing University
    PDF ↗
  42. 2023PDF ↗
  43. 2023PDF ↗
  44. 2023
    New Insights on Relieving Task-Recency Bias for Online Class Incremental LearningGuoqiang Liang, Zhaojie Chen, Zhaoqiang Chen … Yanning ZhangIEEE TCSVT · Northwestern Polytechnical University · Institute of Software
    PDF ↗
  45. 2023
    Recasting Continual Learning as Sequence ModelingSoochan Lee, Jaehyeon Son, Gunhee KimNeurIPS
    PDF ↗
  46. 2023
    Bayesian Flow Networks in Continual LearningMateusz Pyla, Kamil Rafał Deja, Bartłomiej Twardowski, T. P. TrzcinskiarXiv
    PDF ↗
  47. 2023
    Enhancing Plasticity for First Session Adaptation Continual LearningImad Eddine Marouf, Subhankar Roy, Stéphane Lathuilière, Enzo TartaglionearXiv
    PDF ↗
  48. 2023
    CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and GeneralizationBodhisattwa Prasad Majumder, Bhavana Dalvi Mishra, Peter Jansen … Peter E. ClarkarXiv
    PDF ↗
  49. 2023
    Prior-Free Continual Learning with Unlabeled Data in the WildTao Zhuo, Zhiyong Cheng, Hehe Fan, Mohan KankanhalliarXiv
    PDF ↗
  50. 2023PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.