Not going to happen: https://www.servethehome.com/wp-content/uploads/2022/08/NVI... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		my123 on Feb 12, 2023 \| parent \| context \| favorite \| on: How to train large models on many GPUs? (2021) Not going to happen: https://www.servethehome.com/wp-content/uploads/2022/08/NVID... That unless an utterly revolutionary new interconnect technology comes... LPDDR is getting adopted more and more too, with CPUs losing memory expansion capabilities in exchange of huge power savings.

amelius on Feb 12, 2023 [–]

I bet a lot of people would be happy if their GPU could train large models, even if it took 5x as long.

my123 on Feb 12, 2023 | [–]

That's getting a multi-level DRAM config, see Grace Superchip for an example.

Or just a plain slower GPU: Apple's GPU series, but that's at very much higher price tags than desktop GPUs at a given perf level.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact