Qwen3 235B A22B GGUF bf16 is 470GB size lol that's 3x h100? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		tough 4 months ago \| parent \| context \| favorite \| on: Qwen3: Think deeper, act faster Qwen3 235B A22B GGUF bf16 is 470GB size lol that's 3x h100?

aurareturn 4 months ago [–]

No one inferences at bf16. It's always in 8 bit now. So you can fit comfortably in a 512GB Mac.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact