Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

76 papers of 4,574 · showing 51–76Sort Recent · Most cited
  1. 2018
    Dynamic Few-Shot Visual Learning Without ForgettingSpyros Gidaris, Nikos KomodakisCVPR
    PDF ↗
  2. 2018
    Differentiable plasticity: training plastic neural networks with backpropagationThomas Miconi, Jeff Clune, Kenneth O. StanleyICML · Neurosciences Institute · University of Wyoming · +1
    PDF ↗
  3. 2018
    HOUDINI: Lifelong Learning as Program SynthesisLazar Valkov, Dipak Chaudhari, Akash Srivastava … Swarat ChaudhuriNeurIPS · Indian Institute of Technology Bombay · IBM (United States) · +2
    PDF ↗
  4. 2018
    Task Agnostic Continual Learning Using Online Variational BayesChen Zeno, Itay Golan, Elad Hoffer, Daniel SoudryNeurIPS
    PDF ↗
  5. 2018
    Memory-based Parameter AdaptationPablo Sprechmann, Siddhant M. Jayakumar, Jack W. Rae … Charles BlundellICLR · Google (United States)
    PDF ↗
  6. 2018
    One Big Net For EverythingJuergen SchmidhuberarXiv
    PDF ↗
  7. 2018
    Unicorn: Continual Learning with a Universal, Off-policy AgentDaniel J. Mankowitz, Augustin Žídek, André Barreto … Tom SchaularXiv
    PDF ↗
  8. 2018PDF ↗
  9. 2018
    Continual Reinforcement Learning with Complex SynapsesChristos Kaplanis, Murray Shanahan, Claudia ClopathICML · Imperial College London
    PDF ↗
  10. 2018
    Bayesian Incremental Learning for Deep Neural NetworksMax Kochurov, Timur Garipov, Dmitry Podoprikhin … Dmitry VetrovICLR · Skolkovo Institute of Science and Technology · Samsung (South Korea) · +1
    PDF ↗
  11. 2018
    Pseudo-Recursal: Solving the Catastrophic Forgetting Problem in Deep Neural NetworksCraig Atkinson, Brendan McCane, Lech Szymanski, Anthony RobinsarXiv
    PDF ↗
  12. 2018
    Incremental Classifier Learning with Generative Adversarial NetworksYue Wu, Yinpeng Chen, Lijuan Wang … Yun FuarXiv
    PDF ↗
  13. 2018PDF ↗
  14. 2018
    Focused learning promotes continual task performance in humansTimo Flesch, Jan Balaguer, Ronald Dekker … Christopher SummerfieldbioRxiv · University of Oxford · Science Oxford
    PDF ↗
  15. 2018
    Overcoming catastrophic forgetting with hard attention to the taskJoan Serrà, Dídac Surís, Marius Miron, Alexandros KaratzoglouICML
    PDF ↗
  16. 2018
    Memory Aware Synapses: Learning what (not) to forgetRahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny … Tinne TuytelaarsECCV · IMEC · KU Leuven · +2
    PDF ↗
  17. 2018
    Riemannian Walk for Incremental Learning: Understanding Forgetting and IntransigenceArslan Chaudhry, Puneet K. Dokania, Thalaiyasingam Ajanthan, Philip H. S. TorrECCV · University of Oxford
    PDF ↗
  18. 2018
    End-to-End Incremental LearningFrancisco M. Castro, Manuel J. Marín‐Jiménez, Nicolás Guil … Karteek AlahariECCV · Universidad de Málaga · University of Córdoba · +5
    PDF ↗
  19. 2018PDF ↗
  20. 2018
    Catastrophic Forgetting: Still a Problem for DNNsBenedikt Pfülb, Alexander Gepperth, Syahrul Afzal Che Abdullah, Axel KilianSpringer LNCS · Fulda University of Applied Sciences
    PDF ↗
  21. 2018
    Overcoming Catastrophic Forgetting in Convolutional Neural Networks by Selective Network AugmentationAbel Zacarias, Luı́s A. AlexandreSpringer LNCS · University of Beira Interior · Instituto de Telecomunicações
    PDF ↗
  22. 2018
    Continuous Learning in a Hierarchical Multiscale Neural NetworkThomas Wolf, Julien Chaumond, Clément DelangueACL · Central European University · Bio Signal Group (United States)
    PDF ↗
  23. 2018
    Alleviating Catastrophic Forgetting with Modularity for Continuously Learning Linked Open DataLu Chen, Masayuki MurataInternational Journal of Computer Theory and Engineering · The University of Osaka
    PDF ↗
  24. 2018
    FearNet: Brain-Inspired Model for Incremental LearningRonald Kemker, Christopher KananICLR
    PDF ↗
  25. 2018
    Modular Continual Learning in a Unified Visual EnvironmentKevin Feigelis, Blue Sheffer, Daniel YaminsICLR · Rutgers, The State University of New Jersey · Stanford University
    PDF ↗
  26. 2018
    Lifelong Learning with Dynamically Expandable NetworksJaehong Yoon, Eunho Yang, Jeongtae Lee, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.