2.71bit DeepSeek-V3-0324 | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		2.71bit DeepSeek-V3-0324 (unsloth.ai)
		1 point by danielhanchen 6 months ago \| hide \| past \| favorite \| 1 comment

danielhanchen 6 months ago [–]

I shrank DeepSeek V3 to 230GB or so from 720GB and it works still! Model uploads are at https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact