Abstract
The secret ingredient behind the unprecedented results of modern models lies in the quality and quantity of training data. This ingredient, however, imposes several computational challenges that have motivated efforts toward data distillation methods. This family of techniques produces a synthetic dataset, much smaller than the original, capable of achieving results equivalent to the init…