Knowledge Distillation

Turkish equivalent: Bilgi damıtmaDomain: Machine Learning

A model-compression technique in which a smaller student model is trained to reproduce informative outputs or representations from a larger teacher model.

  • Model Compression
  • Teacher Model
  • Student Model
  • Quantization