Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

To clarify, you're still gonna want enough RAM for the entire model plus context. Scout being 109B params means 64GB at q4, but then your context and other applications will have about 9GB left to work with.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: