Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

138 papers of 6,984 · showing 51–100Sort Recent · Most cited
  1. 2018
    Born to Learn: the Inspiration, Progress, and Future of Evolved Plastic Artificial Neural NetworksAndrea Soltoggio, Kenneth O. Stanley, Sebastian RisiNeural Networks · Loughborough University · University of Central Florida · +1
    PDF ↗
  2. 2018
    Rotate your Networks: Better Weight Consolidation and Less Catastrophic ForgettingXialei Liu, Marc Masana, Luis Herranz … Andrew D. BagdanovICPR · Computer Vision Center · University of Florence
    PDF ↗
  3. 2018
    Local learning rules to attenuate forgetting in neural networksMichael Deistler, Martino Sorbaro, Michael E. Rule, Matthias H. HennigarXiv
    PDF ↗
  4. 2018
    On catastrophic forgetting and mode collapse in Generative Adversarial NetworksHoang Thanh-Tung, Truyen TranarXiv · Deakin University
    PDF ↗
  5. 2018
  6. 2018
    Multi-Agent Distributed Lifelong Learning for Collective Knowledge AcquisitionMohammad Rostami, Soheil Kolouri, Kyungnam Kim, Eric EatonAdaptive Agents and Multi-Agent Systems · University of Pennsylvania · HRL Laboratories (United States)
    PDF ↗
  7. 2018
    Modeling Consecutive Task Learning with Task Graph AgendasDavid Isele, Eric Eaton, Mark Roberts, David W. AhaAdaptive Agents and Multi-Agents Systems · University of Pennsylvania · United States Naval Research Laboratory
  8. 2018PDF ↗
  9. 2018
    Embodiment can combat catastrophic forgettingJoshua Powers, Sam Kriegman, Josh BongardGenetic and Evolutionary Computation Conference Companion · University of Vermont
  10. 2018
    Policy and Value Transfer in Lifelong Reinforcement LearningDavid Abel, Yuu Jinnai, Yue (Sophie) Guo … M. LittmanICML
  11. 2018
    Combating catastrophic forgetting with developmental compressionShawn L. E. Beaulieu, Sam Kriegman, Josh C. BongardGenetic and Evolutionary Computation Conference · University of Vermont
    PDF ↗
  12. 2018
    Enhancing CNN Incremental Learning Capability with an Expanded NetworkShanshan Cai, Zhuwei Xu, Zhichao Huang … C.‐C. Jay KuoIEEE International Conference on Multimedia and Expo (ICME) · University of Southern California · Tsinghua University
  13. 2018
    Adaptive Incremental Gaussian Mixture Network for Non-Stationary Data Stream ClassificationJorge C. Chamby-Diaz, Mariana Recamonde‐Mendoza, Ana L. C. Bazzan, Ricardo GrunitzkiIJCNN · Universidade Federal do Rio Grande do Sul
  14. 2018
    Fast Factorization-free Kernel Learning for Unlabeled Chunk Data StreamsYi Wang, Nan Xue, Xin Fan … Zhongxuan LuoIJCAI · Dalian University of Technology · University of Rochester
    PDF ↗
  15. 2018
    Lifelong Metric LearningGan Sun, Yang Cong, Ji Liu … Haibin YuIEEE Trans. Cybernetics · Shenyang Institute of Automation · University of Chinese Academy of Sciences · +3
    PDF ↗
  16. 2018
    Evaluating and Characterizing Incremental Learning from Non-Stationary DataAlejandro Cervantes, Christian Gagné, Pedro Isasi, Marc ParizeauarXiv
    PDF ↗
  17. 2018
    Meta Continual LearningRisto Vuorio, Dong-Yeon Cho, Daejoong Kim, Jiwon KimarXiv
    PDF ↗
  18. 2018
  19. 2018PDF ↗
  20. 2018
    PackNet: Adding Multiple Tasks to a Single Network by Iterative PruningArun Mallya, Svetlana LazebnikCVPR · University of Illinois Urbana-Champaign
    PDF ↗
  21. 2018
    New Metrics and Experimental Paradigms for Continual LearningTyler L. Hayes, Ronald Kemker, Nathan D. Cahill, Christopher KananCVPR · Rochester Institute of Technology
  22. 2018
    Subset Replay Based Continual Learning for Scalable Improvement of Autonomous SystemsPratik Prabhanjan Brahma, Adrienne OthonCVPR · Volkswagen Group (United States)
  23. 2018
    Adaptive Matrix Sketching and Clustering for Semisupervised Incremental LearningZilin Zhang, Yan Li, Zhengwen Zhang … Meiguo GaoIEEE Signal Processing Letters · Beijing Institute of Technology
  24. 2018
    Learn to Detect Objects IncrementallyLinting Guan, Yan Wu, Junqiao Zhao, Chen YeIEEE Intelligent Vehicles Symposium (IV) · Tongji University
  25. 2018
    Deep Face Detector Adaptation Without Negative Transfer or Catastrophic ForgettingMuhammad Abdullah Jamal, Haoxiang Li, Boqing GongCVPR · University of Central Florida · Adobe Systems (United States) · +1
  26. 2018
    Incremental Learning in Deep Convolutional Neural Network VIA Adaptive RegularizationSihyeon Seong, Pyunghwan Ahn, Jiwhan Kim, Junmo KimIEEE International Conference on Consumer Electronics - A… · Korea Advanced Institute of Science and Technology
  27. 2018
    Reinforced Continual LearningJu Xu, Zhanxing ZhuNeurIPS
    PDF ↗
  28. 2018
    Distributed Weight Consolidation: A Brain Segmentation Case StudyPatrick McClure, Charles Zheng, Jakub Kaczmarzyk … Francisco PereiraNeurIPS · National Institutes of Health · Massachusetts Institute of Technology
    PDF ↗
  29. 2018
  30. 2018
    Towards Robust Evaluations of Continual LearningSebastian Farquhar, Yarin GalICML · University of Oxford
    PDF ↗
  31. 2018
    Online Structured Laplace Approximations For Overcoming Catastrophic ForgettingHippolyt Ritter, Aleksandar Botev, David BarberNeurIPS
    PDF ↗
  32. 2018PDF ↗
  33. 2018
    Progress & Compress : A scalable framework for continual learningJonathan Schwarz, Jelena Luketina, Wojciech Marian Czarnecki … Raia HadsellICML
    PDF ↗
  34. 2018
    Measuring Catastrophic Forgetting in Neural NetworksRonald Kemker, Marc McClure, Angelina Abitino … Christopher KananAAAI · Rochester Institute of Technology · Swarthmore College
    PDF ↗
  35. 2018
    Selective Experience Replay for Lifelong LearningDavid Isele, Akansel CosgunAAAI · Honda (United States) · University of Pennsylvania · +1
    PDF ↗
  36. 2018
    Active Lifelong Learning With "Watchdog"Gan Sun, Yang Cong, Xiaowei XuAAAI · Shenyang Institute of Automation · Chinese Academy of Sciences · +2
  37. 2018
    Labeled Memory Networks for Online Model AdaptationShiv Shankar, Sunita SarawagiAAAI · Indian Institute of Technology Bombay
  38. 2018
    Lifelong Learning Networks: Beyond Single Agent Lifelong LearningMohammad Rostami, Eric EatonAAAI · California University of Pennsylvania
  39. 2018
    Dynamic Few-Shot Visual Learning Without ForgettingSpyros Gidaris, Nikos KomodakisCVPR
    PDF ↗
  40. 2018
    Differentiable plasticity: training plastic neural networks with backpropagationThomas Miconi, Jeff Clune, Kenneth O. StanleyICML · Neurosciences Institute · University of Wyoming · +1
    PDF ↗
  41. 2018
    HOUDINI: Lifelong Learning as Program SynthesisLazar Valkov, Dipak Chaudhari, Akash Srivastava … Swarat ChaudhuriNeurIPS · Indian Institute of Technology Bombay · IBM (United States) · +2
    PDF ↗
  42. 2018
    Task Agnostic Continual Learning Using Online Variational BayesChen Zeno, Itay Golan, Elad Hoffer, Daniel SoudryNeurIPS
    PDF ↗
  43. 2018
  44. 2018
    Mitigate catastrophic forgetting for continuously learning linked open data using modularityLu Chen, Masayuki MurataInternational Conference on Innovation in Artificial Inte… · The University of Osaka
  45. 2018
    Memory-based Parameter AdaptationPablo Sprechmann, Siddhant M. Jayakumar, Jack W. Rae … Charles BlundellICLR · Google (United States)
    PDF ↗
  46. 2018
    One Big Net For EverythingJuergen SchmidhuberarXiv
    PDF ↗
  47. 2018
    Unicorn: Continual Learning with a Universal, Off-policy AgentDaniel J. Mankowitz, Augustin Žídek, André Barreto … Tom SchaularXiv
    PDF ↗
  48. 2018PDF ↗
  49. 2018
    Continual Reinforcement Learning with Complex SynapsesChristos Kaplanis, Murray Shanahan, Claudia ClopathICML · Imperial College London
    PDF ↗
  50. 2018
    Bayesian Incremental Learning for Deep Neural NetworksMax Kochurov, Timur Garipov, Dmitry Podoprikhin … Dmitry VetrovICLR · Skolkovo Institute of Science and Technology · Samsung (South Korea) · +1
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.