Any chance you plan to offer the API to cloud LPUs? And not just the LLM API? It... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		cheptsov on Feb 20, 2024 \| parent \| context \| favorite \| on: Groq runs Mixtral 8x7B-32k with 500 T/s Any chance you plan to offer the API to cloud LPUs? And not just the LLM API? It would be cool run custom code (training, serving, etc).

tome on Feb 20, 2024 [–]

Yes, in the future we'd like to do that.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact