Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
zoe_dk
on Nov 30, 2023
|
parent
|
context
|
favorite
| on:
Llamafile lets you distribute and run LLMs with a ...
Noob question - how might I call this from my Python script? Say as a replacement gpt3.5 turbo of sorts. Is there an option without GUI?
This is great thank you, very user friendly (exhibit a: me)
simonw
on Nov 30, 2023
[–]
The llama.cpp server version runs a JSON API that you can call. It's currently missing any documentation though as far as I can tell - I found dome details on Reddit:
https://www.reddit.com/r/LocalLLaMA/comments/185kbtg/llamacp...
zoe_dk
on Nov 30, 2023
|
parent
[–]
Thank you Simon I will check it out.
Join us for
AI Startup School
this June 16-17 in San Francisco!
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
This is great thank you, very user friendly (exhibit a: me)