Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Have a 16GB one, just setup ollama yesterday.

gpt-oss-20b eats too much ram to use for anything other than an overnight task. maybe 3tok/s.

Been playing around with the 8b versions of qwen and deepseek. Seems usable so far. YMMV, i'm just messing around in chat at the moment, haven't really had it do any tasks for me



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: