Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

21 papers of 6,984Sort Recent · Most cited
  1. 2024
    MoExtend: Tuning New Experts for Modality and Task ExtensionShanshan Zhong, Shanghua Gao, Zhongzhan Huang … Pan ZhouACL
    PDF ↗
  2. 2024PDF ↗
  3. 2024PDF ↗
  4. 2024PDF ↗
  5. 2024PDF ↗
  6. 2024PDF ↗
  7. 2024
    Unveiling Linguistic Regions in Large Language ModelsZhihao Zhang, Jun Zhao, Qi Zhang … Xuanjing HuangACL
    PDF ↗
  8. 2024
    Self-Distillation Bridges Distribution Gap in Language Model Fine-TuningZhaorui Yang, Tianyu Pang, Haozhe Feng … Qian LiuACL
    PDF ↗
  9. 2024
    Incremental Sequence Labeling: A Tale of Two ShiftsShengjie Qiu, Junhao Zheng, Zhen Liu … Qianli MaACL
    PDF ↗
  10. 2024PDF ↗
  11. 2024
    Model Editing at Scale leads to Gradual and Catastrophic ForgettingAkshat Gupta, Anurag Rao, Gopala AnumanchipalliACL
    PDF ↗
  12. 2024
    LLaMA Pro: Progressive LLaMA with Block ExpansionChengyue Wu, Yukang Gan, Yixiao Ge … Ping LuoACL
    PDF ↗
  13. 2024
    SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language ModelsWeixiang Zhao, Shilong Wang, Yulin Hu … Wanxiang CheACL · Harbin Institute of Technology · XTC (China)
    PDF ↗
  14. 2024
    TaSL: Continual Dialog State Tracking via Task Skill Localization and ConsolidationYujie Feng, Xu Chu, Yongxin Xu … Xiao-Ming WuACL · Hong Kong Polytechnic University · Peking University · +1
    PDF ↗
  15. 2024
    Continual Learning with Semi-supervised Contrastive Distillation for Incremental Neural Machine TranslationYunlong Liang, Fandong Meng, Jiaan Wang … Jie ZhouACL · Beijing Jiaotong University · Tencent (China)
    PDF ↗
  16. 2024
    Continual Dialogue State Tracking via Reason-of-Select DistillationYujie Feng, Bo Liu, Xiaoyu Dong … Albert Y. S. LamACL · Hong Kong Polytechnic University · Fano Labs (China)
    PDF ↗
  17. 2024
    Flexible Weight Tuning and Weight Fusion Strategies for Continual Named Entity RecognitionYahan Yu, Duzhen Zhang, Xiuyi Chen, Chenhui ChuACL · Kyoto University · Shandong Institute of Automation · +1
    PDF ↗
  18. 2024
    Non-compositional Expression Generation and its Continual LearningJianing Zhou, Suma BhatACL · University of Illinois Urbana-Champaign
    PDF ↗
  19. 2024
  20. 2024PDF ↗
  21. 2024PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.