Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
Ask HN: Has anyone used llama.cpp in production?
3 points
by
Nevin1901
on Nov 22, 2023
|
hide
|
past
|
favorite
|
2 comments
I’ve found ggerganovs work on llama.cpp to be amazing, and I’ve loved playing around with it. However, has anyone used it in production? I’m sure there are some really cool use cases, but I haven’t seen any yet.
runjake
on Nov 24, 2023
|
next
[–]
Some people are.
https://old.reddit.com/r/localllama
linusg789
on Nov 22, 2023
|
prev
[–]
4chan /g/ has a small community of people playing around with local LLMs, maybe check there.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
https://old.reddit.com/r/localllama