Distillation vs. Quantization: Understanding the Trade-offs of LLM Compression using Images
When researching LLMs, I found these two terms often used interchangeably — distillation and quantization. After some thought, I began to see them like the process of storing a digital image. When you take a picture of an object, you’re not capturing the object itself but recording a representation — something…