Yes, but ramalama defaults to podman. Podman Desktop is very easy to install and use.

He also built a nice "little" cluster with Nat for their startups: https://andromeda.ai/

Yes, used by Grok: https://twitter.com/qdrant_engine/status/1721097971830260030 Oh wow, completely missed that they're German. Should have noticed their "Impressum"..

Care to enlighten us why?

Most of this stuff is replaced within a calendar year and that will probably accelerate.

It sounds dumb to me.

We just held a workshop about this a few weeks ago: https://red.ht/llmappdev We created a simple chatbot using local models with Ollama (llamacpp), LlamaIndex and streamlit. Have a look at the streamlit folder, it's super easy.

I used this simple example to teach about RAG, the importance of the system prompt and prompt injection. The notebook folder has a few more examples, local models can even do natural language SQL querying now.

Llamaindex has so mucu potential. Any benchmarks on performance compared to fine-tuning?

You probably don't need fine-tuning, at least if it's just new content (and no new instructions). It may even be detrimental, since LLMs are als good at forgetting: https://twitter.com/abacaj/status/1739015011748499772

looks very promising, do you plan to keep this single repo up to date as new things are released?

Good question, as you can see I haven't touched it for a month. I wanted to show what's possible then with open source and (open) local models and there's already so much new stuff out there.

I'll probably fix some things this week and then either update it or start from scratch. Guided generation, structured extraction, function calling and multi-modal are things I wanted to add and chainlit looks interesting.

I can't even see the pay what you like feature on the app.

Not sure about the app, but on the website, it was below the tiers. On my laptop screen, the pay-what-you-like option was below the fold.

That version of libnc_cuda.so doesn't seem to be compatible with ts_server though.

$25B and they can't even afford an API..

If you want analytics you have to rely on a 3rd party provider who somehow gets the information by logging into your account. I guess if you're a key account they will send you some data and maybe even some nice visualizations.

I did some research and people really track their audience with spread sheets. Influencers send screenshots of their accounts to advertisment companies to prove how many followers they have. Seriously.. If they want to monetarize their platform they should open at least part of their API.

Please do not use Telegram. It' closed source and uses some half-baked crypto. Signal is open source and is actually end-to-end encrypted.

Wire[1] is also an excellent option. Unlike Open Whisper Systems they wont hang you from a tree for building a third party app. Signal wont work without Gapps or Google Play Services on your Android phone and Google Chrome for desktop.

[1] https://wire.com/

Signal does work with MicroG (https://microg.org/), an open source reimplementation of Google Play Services.

But that still requires using the Google Play Services library in the Signal APK, still doing analytics.

I tried Wire after this WhatsApp news came out initially and brought about 10 people (friends/family) to it. They're satisfied how it works.

Signal is pseudo-open-source but will not allow you to use it except via the closed-source google play services, so I still wouldn't have confidence in it.

Yes. Also, on what payroll is Moxie now? He was working with Facebook on WhatsApp and then worked with Google on their new messaging app.

This is incorrect. There is an open source reimplementation of Google Play Services (https://microg.org/) and Signal works beautifully with it.

And wherefrom can you get Signal except for the Google Play store? I was looking for it a while ago to install on my phone but only found two other projects which were threatened by moxie and then shut down.

I compile my own binaries. Not too bad actually.

Telegrams clients (and the e2e encryption) are open source. For instance: https://github.com/DrKLO/Telegram

Curious if you know why the crypto is half-baked. Has it been broken?

edit: found Signal server, I think: https://github.com/WhisperSystems/TextSecure-Server

Nice it's out there. This will help Signal live a long time.

Exactly. Not to mention if it becomes popular it will get sold to megacorp in a heartbeat.

I'll give signal another try, last time I couldn't register.

A lot of people here use twitter.

Why must things be provably sure to have any value?

No windows phone client :-(

There is a NeuroBayes plugin for TMVA. I've put it on Github with some additional patches: https://github.com/sroecker/tmva-neurobayes