Ablation: The Role of Fused Labels and Teacher EMA in Instance-Incremental Learning

Machine Learning Tech Brief By HackerNoon

This story was originally published on HackerNoon at: https://hackernoon.com/ablation-the-role-of-fused-labels-and-teacher-ema-in-instance-incremental-learning.
This ablation study on Cifar-100 validates the three core components of the proposed IIL method.
Check more stories related to machine-learning at: https://hackernoon.com/c/machine-learning. You can also check exclusive content about #machine-learning, #cifar-100, #instance-incremental-learning, #dbd, #knowledge-consolidation, #fused-labels, #dusting-input-space, #model-ema-frequency, and more.
This story was written by: @instancing. Learn more about this writer by checking @instancing's about page, and for more stories, please visit hackernoon.com.
The proposed method mainly consists of three components: DBD with fused label (FL), DBD. with dusting the input space ( DIS), and knowledge consolidation (KC) The ablation study on these three components is shown in Fig. 5. It can be seen that all components contributes to the continual knowledge accumulation with new data.