Was "distillation" removed from docs (and/or facilities)?

[johnroy]

Was distillation removed? housekeeping issue or deeper stuff going on?

[_j]

Likely developer engagement was approaching zero.

@_j

The videos are all dead, so the feature may have gone by the wayside.

Distillation is good for using bulk data to produce submodels. For curated synthetic data, where both a high-quality model is used and custom prompting to generate that, inputs not employed in inference in a final specialized fine-tuning model, it didn’t fit the bill.

[kwhinnery]

It was intentionally removed, because the content had gone out of date, and the practice is already implicitly covered in other documentation on the site. We should have redirected this though instead of letting this be a 404, we will fix.

Thanks!