Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

These are smaller scale model that you can export and run anywhere.

Even the smallest multimodal LLM would be wayyyyyyy bigger than an exported model from this



How small are these models? can I export a model here and embed it in an Android/ios app?


The website says they can be embedded in a web app, and export to a format called TensorFlow Lite. I am sure you could embed it.

https://www.tensorflow.org/lite


https://www.tensorflow.org/lite/android

TF Lite has first-class Android support with hardware acceleration if I'm not mistaken.


You can supposedly embed them for Arduinos, so an app should be no problem.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: