Democratic vs autocratic AI: Top OpenAI executive on China's 'distillation' tactics

OpenAI has informed US lawmakers that Chinese AI startups may be using “model distillation” techniques to extract ...
Quanta Magazine

How Distillation Makes AI Models Smaller and Cheaper

The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said ...
Wired

Distillation Can Make AI Models Smaller and Cheaper

The original version of this story appeared in Quanta Magazine. The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it ...

OpenAI accuses DeepSeek of distillation: What it is, how it works

Artificial intelligence (AI) has become the latest source of US-China tensions, with OpenAI accusing Chinese startup DeepSeek ...
InfoWorld

Researchers propose a self-distillation fix for ‘catastrophic forgetting’ in LLMs

LLMs tend to lose prior skills when fine-tuned for new tasks. A new self-distillation approach aims to reduce regression and ...