Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

23 papers of 6,984Sort Recent · Most cited
  1. 2023
    Continual Contrastive Spoken Language UnderstandingUmberto Cappellazzo, Enrico Fini, Muqiao Yang … Bhiksha RajACL
    PDF ↗
  2. 2023
    Domain-Agnostic Neural Architecture for Class Incremental Continual Learning in Document Processing PlatformMateusz Wójcik, Witold Kościukiewicz, Mateusz Baran … Adam GonczarekACL
    PDF ↗
  3. 2023
    Exploring Continual Learning for Code Generation ModelsPrateek Yadav, Qing Sun, Hantian Ding … Bing XiangACL
    PDF ↗
  4. 2023
    Class-Incremental Learning based on Label GenerationYijia Shao, Yiduo Guo, Dongyan Zhao, Bing LiuACL
    PDF ↗
  5. 2023PDF ↗
  6. 2023PDF ↗
  7. 2023PDF ↗
  8. 2023
    Overcoming Catastrophic Forgetting in Massively Multilingual Continual LearningGenta Indra Winata, Lingjue Xie, Karthik Radhakrishnan … Daniel Preoţiuc-PietroACL
    PDF ↗
  9. 2023PDF ↗
  10. 2023
    Learning Non-linguistic Skills without Sacrificing Linguistic ProficiencyMandar Sharma, Nikhil Muralidhar, Naren RamakrishnanACL
    PDF ↗
  11. 2023PDF ↗
  12. 2023
    Domain Incremental Lifelong Learning in an Open WorldYi Dai, Hao Lang, Yinhe Zheng … Yongbin LiACL
    PDF ↗
  13. 2023
    Rehearsal-free Continual Language Learning via Efficient Parameter IsolationZhicheng Wang, Yufang Liu, Tao Ji … Wenqiu ZengACL · East China Normal University · China Institute of Finance and Capital Markets
    PDF ↗
  14. 2023
    Improving Gender Fairness of Pre-Trained Language Models without Catastrophic ForgettingZahra Fatemi, Xing Chen, Wenhao Liu, Caimming XiongACL · University of Illinois Chicago · University of Chicago · +1
    PDF ↗
  15. 2023
    Consistent Prototype Learning for Few-Shot Continual Relation ExtractionXiudi Chen, Hui Wu, Xiaodong ShiACL · Xiamen University
    PDF ↗
  16. 2023
    Large-scale Lifelong Learning of In-context Instructions and How to Tackle ItJisoo Mok, Jaeyoung Do, Sung‐Jin Lee … Sungroh YoonACL · Seoul National University · New Generation University College · +4
    PDF ↗
  17. 2023
    Knowledge Transfer in Incremental Learning for Multilingual Neural Machine TranslationKaiyu Huang, Peng Li, Jin Ma … Yang LiuACL · Tsinghua University · Beijing Academy of Artificial Intelligence · +5
    PDF ↗
  18. 2023
    Learning “O” Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NERRuotian Ma, Xuanting Chen, Lin Zhang … Yun Wen ChenACL · Fudan University · Wanfang Data (China)
    PDF ↗
  19. 2023
    Cross-lingual Continual LearningMeryem M’hamdi, Xiang Ren, Jonathan MayACL · University of Southern California · California Southern University
    PDF ↗
  20. 2023PDF ↗
  21. 2023
    Soft Alignment Objectives for Robust Adaptation of Language GenerationMichal Štefánik, Marek Kadlčík, Petr SojkaACL · Masaryk University
    PDF ↗
  22. 2023
    Human Inspired Progressive Alignment and Comparative Learning for Grounded Word AcquisitionYuwei Bao, Barrett Lattimer, Joyce ChaiACL · University of Michigan
    PDF ↗
  23. 2023PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.