How are Maverick and Scout distilled from Behemoth if the latter is not done tra... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		utopcell 9 months ago \| parent \| context \| favorite \| on: The Llama 4 herd How are Maverick and Scout distilled from Behemoth if the latter is not done training? Do they distill from some intermediate, "good enough" snapshot?

harisec 9 months ago [–]

Yes, during training multiple checkpoints are created, you can distill from any checkpoint you want.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact