Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

645 papers of 4,574 · showing 551–600Sort Recent · Most cited
  1. 2023
    Do Pre-trained Models Benefit Equally in Continual Learning?Kuan-Ying Lee, Yuanyi Zhong, Yu-Xiong WangWACV · University of Illinois Urbana-Champaign
    PDF ↗
  2. 2023
    Attribution-aware Weight Transfer: A Warm-Start Initialization for Class-Incremental Semantic SegmentationDipam Goswami, René Schuster, Joost van de Weijer, Didier StrickerWACV · German Research Centre for Artificial Intelligence · Birla Institute of Technology and Science, Pilani · +2
    PDF ↗
  3. 2023
    Saliency Guided Experience Packing for Replay in Continual LearningGobinda Saha, Kaushik RoyWACV · Purdue University West Lafayette
    PDF ↗
  4. 2023
    Large-scale Lifelong Learning of In-context Instructions and How to Tackle ItJisoo Mok, Jaeyoung Do, Sung‐Jin Lee … Sungroh YoonACL · Seoul National University · New Generation University College · +4
    PDF ↗
  5. 2023
    InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction TuningSamuel Cahyawijaya, Holy Lovenia, Tiezheng Yu … Pascale FungFirst Workshop in South East Asian Language Processing · Hong Kong University of Science and Technology · Red Cross Hospital
    PDF ↗
  6. 2023
    Knowledge Transfer in Incremental Learning for Multilingual Neural Machine TranslationKaiyu Huang, Peng Li, Jin Ma … Yang LiuACL · Tsinghua University · Beijing Academy of Artificial Intelligence · +5
    PDF ↗
  7. 2023
    Learning “O” Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NERRuotian Ma, Xuanting Chen, Lin Zhang … Yun Wen ChenACL · Fudan University · Wanfang Data (China)
    PDF ↗
  8. 2023
    Continual Learning with Dependency Preserving HypernetworksDupati Srikar Chandra, Sakshi Varshney, P. K. Srijith, Sunil GuptaWACV · Indian Institute of Technology Hyderabad · Deakin University
    PDF ↗
  9. 2023PDF ↗
  10. 2023
    Cross-lingual Continual LearningMeryem M’hamdi, Xiang Ren, Jonathan MayACL · University of Southern California · California Southern University
    PDF ↗
  11. 2023
    Continual Learning for Multilingual Neural Machine Translation via Dual Importance-based Model DivisionJunpeng Liu, Kaiyu Huang, Hao Yu … Degen HuangEMNLP · Dalian University of Technology · Tsinghua University · +1
    PDF ↗
  12. 2023
    Neural Weight Search for Scalable Task Incremental LearningJiang Jian, Oya ÇeliktutanWACV · King's College London
    PDF ↗
  13. 2023PDF ↗
  14. 2023
    Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse NetworksGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiySpringer LNCS · Eindhoven University of Technology · University of Twente
    PDF ↗
  15. 2023
    Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language LearningAru Maekawa, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu OkumuraEACL · Tokyo Institute of Technology · Nara Institute of Science and Technology
    PDF ↗
  16. 2023
    Replay to Remember: Continual Layer-Specific Fine-tuning for German Speech RecognitionTheresa Pekarek Rosin, Stefan WermterSpringer LNCS · Universität Hamburg · Hamburg University of Technology
    PDF ↗
  17. 2023
    Self-Organizing Multiple Readouts for Reservoir ComputingYuichiro Tanaka, Hakaru TamukohIEEE Access · Kyushu Institute of Technology
    PDF ↗
  18. 2023
    Multilingual Continual Learning Approaches for Text ClassificationReveal, Chicago, IL, USA, Karan Praharaj, Irina Matveeva, Reveal, Chicago, IL, USAConference Recent Advances in Natural Language Processing…
    PDF ↗
  19. 2023
    Soft Alignment Objectives for Robust Adaptation of Language GenerationMichal Štefánik, Marek Kadlčík, Petr SojkaACL · Masaryk University
    PDF ↗
  20. 2023
    Visually Grounded Continual Language Learning with Selective SpecializationKyra Ahrens, Lennart Bengtson, Jae Yeol Lee, Stefan WermterEMNLP · Universität Hamburg
    PDF ↗
  21. 2023
    CLiCK: Continual Learning Exploiting Intermediate Network Models With A Slack ClassHyejin Kim, Seunghyun Yoon, Hyuk LimIEEE Access · Gwangju Institute of Science and Technology
    PDF ↗
  22. 2023
    Generalising via Meta-Examples for Continual Learning in the WildAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniSpringer LNCS · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  23. 2023
    Incorporating Syntactic Knowledge into Pre-trained Language Model using Optimization for Overcoming Catastrophic ForgettingRan Iwamoto, Issei Yoshida, Hiroshi Kanayama … Masayasu MuraokaEMNLP · Keio University · IBM Research - Tokyo
    PDF ↗
  24. 2023
    FETCH: A Memory-Efficient Replay Approach for Continual Learning in Image ClassificationMarkus Weißflog, Peter Protzel, Peer NeubertSpringer LNCS · Chemnitz University of Technology · Koblenz University of Applied Sciences · +1
    PDF ↗
  25. 2023
    Filter Bank Networks for Few-Shot Class-Incremental LearningYanzhao Zhou, Binghao Liu, Yiran Liu, Jianbin JiaoComputer Modeling in Engineering & Sciences · University of Chinese Academy of Sciences
    PDF ↗
  26. 2023
    Human Inspired Progressive Alignment and Comparative Learning for Grounded Word AcquisitionYuwei Bao, Barrett Lattimer, Joyce ChaiACL · University of Michigan
    PDF ↗
  27. 2023
    Machine Learning and Knowledge Discovery in Databases: Research Track: European Conference, ECML PKDD 2023, Turin, Italy, September 18–22, 2023, Proceedings, Part VDanai Koutra, Claudia Plant, Manuel Gomez-Rodriguez … Francesco BonchiSpringer LNCS · University of Michigan · University of Vienna · +2
    PDF ↗
  28. 2023
    Prototypical quadruplet for few-shot class incremental learningSanchar Palit, Biplab Banerjee, Subhasis ChaudhuriProcedia Computer Science · Indian Institute of Technology Bombay
    PDF ↗
  29. 2023
    Incrementally Learned Angular Representations for Few-Shot Class-Incremental LearningIn-Ug Yoon, Jong-Hwan KimIEEE Access · Korea Advanced Institute of Science and Technology
    PDF ↗
  30. 2023
    Towards Continual Reinforcement Learning for Quadruped RobotsGiovanni Minelli, Vassilis VassiliadesIMET
    PDF ↗
  31. 2023PDF ↗
  32. 2023
    Deep Class-Incremental Learning: A SurveyDa-Wei Zhou, Qiwen Wang, Zhi-Hong Qi … Ziwei LiuarXiv
    PDF ↗
  33. 2023
    Real-Time Evaluation in Online Continual Learning: A New ParadigmYasir Ghunaim, Adel Bibi, K. Alhamoud … Bernard GhanemarXiv
    PDF ↗
  34. 2023
    Addressing Catastrophic Forgetting in Federated Class-Continual LearningJie Zhang, Chen Chen, Weiming Zhuang, Ling-Juan LvarXiv
    PDF ↗
  35. 2023PDF ↗
  36. 2023
    Continual Learning of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bin LiuICLR
    PDF ↗
  37. 2023
    Learning Representations on the Unit Sphere: Application to Online Continual LearningNicolas Michel, Giovanni Chierchia, R. Negrel, Jean-François BercherarXiv
    PDF ↗
  38. 2023PDF ↗
  39. 2023
    Active Continual Learning: Labelling Queries in a Sequence of TasksThuy-Trang Vu, Shahram Khadivi, Dinh Q. Phung, Gholamreza HaffariarXiv
    PDF ↗
  40. 2023
    Continually learning new languagesNgoc-Quan Pham, J. Niehues, A. WaibelarXiv
    PDF ↗
  41. 2023PDF ↗
  42. 2023PDF ↗
  43. 2023PDF ↗
  44. 2023PDF ↗
  45. 2023
    Primal-Dual Continual Learning: Stability and Plasticity through Lagrange MultipliersJuan Elenter, Navid Naderializadeh, Tara Javidi, Alejandro RibeiroarXiv
    PDF ↗
  46. 2023
    E2Net: Resource-Efficient Continual Learning with Elastic Expansion NetworkRuiqi Liu, Boyu Diao, Libo Huang … Yong-Jun XuarXiv
    PDF ↗
  47. 2023
    Few-Shot Continual Learning for Conditional Generative Adversarial NetworksCat P. Le, Juncheng Dong, Ahmed Aloui, Vahid TarokharXiv
    PDF ↗
  48. 2023PDF ↗
  49. 2023PDF ↗
  50. 2023
    Sparse Coding in a Dual Memory System for Lifelong LearningFahad Sarfraz, Elahe Arani, Bahram ZonoozAAAI
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.