Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

118 papers of 4,574 · showing 101–118Sort Recent · Most cited
  1. 2022
    ELLE: Efficient Lifelong Pre-training for Emerging DataYujia Qin, Jiajie Zhang, Yankai Lin … Jie ZhouACL
    PDF ↗
  2. 2022PDF ↗
  3. 2022PDF ↗
  4. 2022PDF ↗
  5. 2022
    TimeLMs: Diachronic Language Models from TwitterDaniel Loureiro, Francesco Barbieri, Leonardo Neves … Jose Camacho-colladosACL · Universidade do Porto · Snap (United States) · +2
    PDF ↗
  6. 2022
    Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic SamplesYu Xia, Quan Wang, Yajuan Lyu … Dai DaiACL · Peking University · Baidu (China)
    PDF ↗
  7. 2022PDF ↗
  8. 2021
    K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan … Ming ZhouACL · Fudan University · Microsoft (United States) · +1
    PDF ↗
  9. 2020
    Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation ExtractionLi Cui, Deqing Yang, Jiaxin Yu … Yanghua XiaoACL · Fudan University
    PDF ↗
  10. 2020
    Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and MaskingBinzong Geng, Fajie Yuan, Qiancheng Xu … Min YangACL · University of Science and Technology of China · Chinese Academy of Sciences · +7
    PDF ↗
  11. 2020
    Learning to Solve NLP Tasks in an Incremental Number of LanguagesGiuseppe Castellucci, Simone Filice, Danilo Croce, Roberto BasiliACL · Amazon (United States) · Seattle University · +3
    PDF ↗
  12. 2020
    Rational LAMOL: A Rationale-based Lifelong Learning FrameworkKasidis Kanwatchara, Thanapapas Horsuwan, Piyawat Lertvittayakumjorn … Peerapon VateekulACL · Chulalongkorn University · Imperial College London
    PDF ↗
  13. 2020
    Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao … Jie ZhouACL · Intelligent Systems Research (United States) · Intelligent Health (United Kingdom) · +3
    PDF ↗
  14. 2019
    Psycholinguistics Meets Continual Learning: Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiACL · University of Trento · IT University of Copenhagen · +1
    PDF ↗
  15. 2019
    Continual and Multi-Task Architecture SearchRamakanth Pasunuru, Mohit BansalACL · University of North Carolina at Chapel Hill · University of North Carolina Health Care
    PDF ↗
  16. 2019
    Incremental Learning from Scratch for Task-Oriented Dialogue SystemsWeikang Wang, Jiajun Zhang, Qian Li … Zhifei LiACL · Shandong Institute of Automation · Institute of Automation · +3
    PDF ↗
  17. 2018
    Continuous Learning in a Hierarchical Multiscale Neural NetworkThomas Wolf, Julien Chaumond, Clément DelangueACL · Central European University · Bio Signal Group (United States)
    PDF ↗
  18. 2017
    Lifelong Learning CRF for Supervised Aspect ExtractionLei Shu, Hu Xu, Bing LiuACL · University of Illinois Chicago
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.