Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

73 papers of 6,984 · showing 51–73Sort Recent · Most cited
  1. 2019
    Facilitating Bayesian Continual Learning by Natural Gradients and Stein GradientsYu Chen, Tom Diethe, Neil D. LawrencearXiv · University of Bristol · Amazon (Germany)
    PDF ↗
  2. 2019
    Continual Learning with Self-Organizing MapsPouya Bashivan, Martin Schrimpf, Robert Ajemian … Yuhai TuarXiv · Massachusetts Institute of Technology
    PDF ↗
  3. 2019
    A Multi-Task Learning Framework for Overcoming the Catastrophic Forgetting in Automatic Speech RecognitionJiabin Xue, Jiqing Han, Tieran Zheng … Jiaxing GuoarXiv · Harbin Institute of Technology
    PDF ↗
  4. 2019PDF ↗
  5. 2019
    M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental LearningPeng Zhou, Long Mai, Jianming Zhang … Larry S. DavisarXiv
    PDF ↗
  6. 2019
    Efficient Incremental Learning for Mobile Object DetectionDawei Li, Şerafettin Taşcı, Shalini Ghosh … Larry HeckarXiv · Samsung (United States) · Research!America (United States) · +3
    PDF ↗
  7. 2019
  8. 2019
    Online continual learning with no task boundariesRahaf Aljundi, Min Lin, Baptiste Goujaud, Yoshua BengioarXiv
  9. 2019PDF ↗
  10. 2019
    Continual Learning via Neural PruningSiavash Golkar, M. Kagan, Kyunghyun ChoarXiv
    PDF ↗
  11. 2019
    Using World Models for Pseudo-Rehearsal in Continual LearningNicholas Ketz, Soheil Kolouri, Praveen K. PillyarXiv · HRL Laboratories (United States)
    PDF ↗
  12. 2019
    Attention-Based Structural-PlasticitySoheil Kolouri, Nicholas Ketz, Xinyun Zou … Praveen K. PillyarXiv · HRL Laboratories (United States)
    PDF ↗
  13. 2019
    Continual Learning with Tiny Episodic MemoriesArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … Marc’Aurelio RanzatoarXiv · University of Oxford
    PDF ↗
  14. 2019
    ORACLE: Order Robust Adaptive Continual LEarningJaehong Yoon, Saehoon Kim, Eunho Yang, Sung Ju HwangarXiv
  15. 2019
    Generative Memory for Lifelong Reinforcement LearningAswin Raghavan, Jesse Hostetler, Sek ChaiarXiv
    PDF ↗
  16. 2019
    Adaptive Masked Weight Imprinting for Few-Shot SegmentationMennatullah Siam, Boris N. Oreshkin, Martin JägersandarXiv · University of Alberta
    PDF ↗
  17. 2019
    Differentially Private Continual LearningSebastian Farquhar, Yarin GalarXiv · University of Oxford
    PDF ↗
  18. 2019
  19. 2019
    EILearn: Learning Incrementally Using Previous Knowledge Obtained From an Ensemble of ClassifiersShivang Agarwal, C. Ravindranath Chowdary, Shripriya MaheshwariarXiv
    PDF ↗
  20. 2019PDF ↗
  21. 2019
    Learning and Evaluating General Linguistic IntelligenceDani Yogatama, Cyprien de Masson d’Autume, Jerome T. Connor … Phil BlunsomarXiv · Google (United States)
    PDF ↗
  22. 2019PDF ↗
  23. 2019
    Incremental Reading for Question AnsweringSamira Abnar, Tania Bedrax-Weiss, Tom Kwiatkowski, William W. CohenarXiv · University of Amsterdam · Google (United States)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.