This is incredibly fast, indeed. What are the current speeds in T/s for say Chat... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		aphit on Feb 19, 2024 \| parent \| context \| favorite \| on: Groq runs Mixtral 8x7B-32k with 500 T/s This is incredibly fast, indeed. What are the current speeds in T/s for say ChatGPT 3.5 or ChatGPT 4? Just how much faster is this?

kumarm on Feb 19, 2024 [–]

I ran the same (Code generation) query and here are my results as end user:

ChaGPT: 1 minute 45 seconds.

Gemini: 16 seconds.

Groq: 3 seconds.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact