Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
tome
on Feb 19, 2024
|
parent
|
context
|
favorite
| on:
Groq runs Mixtral 8x7B-32k with 500 T/s
Yes, we pipeline requests so multiple users are being handled by the same hardware at one time.
mrtksn
on Feb 19, 2024
[–]
Thanks for the clarification. So, would you say that Groq has a potential to have let's say OpenAI speeds on handheld devices at reasonable energy consumption? Or is that not really what this tech's strength is maybe?
tome
on Feb 19, 2024
|
parent
[–]
The industry as a whole is a very long way away from that. The power requirements are too high for mobile.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: