Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Because they can't do that for a "good consumer price".

If you want more than ~48GB, you're looking at HBM which is extremely expensive (HBM chips are very expensive, packaging+interposer is extremely expensive, designing and producing a new GPU is expensive).

Normal GPUs are limited by both their bus width (wider bus = more pins = harder to design, more expensive to produce, and increases power consumption), and GDDR6(x) (which maxes out at 2GB/chip currently), so on a 384bit bus (4090/7900xtx, don't expect anyone to make a 512bit busses anymore) you need 12x2GB (GDDR6 uses 32 pins per package) which gives you 24GB. You can double the memory capacity to 48GB, but that requires putting the chips on the back of the GPU which leads to a bunch of cooling issues (and GDDR6 is expensive).

Of course, even if they did all that they're selling expensive GPUs to a small niche market and cannibalizing sales of their own high end products (and even if AMD somehow managed to magic up a 128GB gpu for $700 people still wouldn't buy it because so much of the ML software is CUDA only).



3090 has a lot of vram chips on the back though


And because of it there were issues with the vram overheating in memory intensive workloads, and on some GPUs the vram even separated off the board.

https://www.igorslab.de/en/looming-pads-and-too-hot-gddrx6-m...


Yes I have one that has one fried chip. Once I gave another a Bykski water block with backplate it's been no issue for a year


Ah, filler problems. Microsoft called, they want to tell you about a billion dollar mistake.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: