2000 character limit reached
Elastic Weight Consolidation (EWC): Nuts and Bolts (2105.04093v1)
Published 10 May 2021 in cs.CV, cs.LG, and stat.ML
Abstract: In this report, we present a theoretical support of the continual learning method \textbf{Elastic Weight Consolidation}, introduced in paper titled `Overcoming catastrophic forgetting in neural networks'. Being one of the most cited paper in regularized methods for continual learning, this report disentangles the underlying concept of the proposed objective function. We assume that the reader is aware of the basic terminologies of continual learning.