If it's desired integer performance could far exceed float performance, since AL... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		KeplerBoy on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... If it's desired integer performance could far exceed float performance, since ALUs need less die area than FPUs. If this paper holds, I'd expect that's where custom accelerators will be heading.

gpderetta on Feb 28, 2024 [–]

Oh, I agree, I'm just saying that there is no reason in principle for floats performance to be better than integer.

edit: also this might be implementable purely using bitwise vector operations. Would need to check the throughput of those.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact