They propagate information in a binary way (either they activate or not). | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rafaelero on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... They propagate information in a binary way (either they activate or not).

PhunkyPhil on Feb 28, 2024 [–]

Neurons activate on a gradient

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact