Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
rafaelero
on Feb 28, 2024
|
parent
|
context
|
favorite
| on:
The Era of 1-bit LLMs: ternary parameters for cost...
It's more likely that Nvidia will offer support to INT2 in the next generation and keep their dominance.
Klipper3
on Feb 28, 2024
|
next
[–]
INT2 ternary is equivalent to INT1 + binary mask. Nvidia supprted INT1 matrix multiply in RTX20 and RTX30 generations, nobody used it, so they removed INT1 support from RTX40 generation.
ByThyGrace
on Feb 29, 2024
|
parent
|
next
[–]
What I get from your comment is now older RTX gens are going to be in high demand soon.
ActionHank
on Feb 29, 2024
|
prev
[–]
"next generation" those two words mean a whole lot.
Intel and AMD could also implement support in their "next generation" and that would be huge.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
