Relevant thread from 5 months ago: https://news.ycombinator.com/item?id=37469434... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ppsreejith on Feb 19, 2024 \| parent \| context \| favorite \| on: Groq runs Mixtral 8x7B-32k with 500 T/s Relevant thread from 5 months ago: https://news.ycombinator.com/item?id=37469434 I'm achieving consistent 450+ tokens/sec for Mixtral 8x7b 32k and ~200 tps for Llama 2 70B-4k. As an aside, seeing that this is built with flutter Web, perhaps a mobile app is coming soon?

tome on Feb 19, 2024 [–]

There was also another discussion about Groq a couple of months ago https://news.ycombinator.com/item?id=38739199

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact