Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

A better question would be over something like Jan or LibreChat. Ollama's is CLI/API/backend for easily downloading and running models.

https://github.com/janhq/jan

https://github.com/danny-avila/LibreChat

Jan's probably the closest thing to a open-source LLM chat interface that is relatively easy to get started with.

I personally prefer Librechat (which supports integration with image generation) but it does have to spin up some docker stuff and that can make it a bit more complicated.



There is also Msty (https://msty.app), which I find much easier to get started with and it comes with interesting features such as web search, RAG, Delve mode, etc.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: