Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yup, that's a thing. Mostly along the lines of "CPU memory is cheap, GPU memory is expensive, if CPU performance is made good enough we can run really really big models for much less because of cheaper RAM"




I'm all for it. It enables those really big models with a relatively small number of active parameters.



Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: