(haven't read the paper). Maybe you can flip bits with a probability distributio... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

joelthelion on Feb 28, 2024 | parent | context | favorite | on: The Era of 1-bit LLMs: ternary parameters for cost...

(haven't read the paper). Maybe you can flip bits with a probability distribution that depends on the gradient?

stormfather on Feb 28, 2024 [–]

That's an interesting idea! Would love to try that on MNIST one day.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact