If M4 Max could finally break the 400GBps limit of the past few years and hit 600 GBps, it would be huge for local AI since it could directly translate into inference speedups.
The M4 has increased the bandwidth from 100 to 120 GB/s. The M4 Max would probably be 4x that at 480 GB/s, but the M4 Ultra would be 960 GB/s compared to M2 Ultra at 800 GB/s.
Dang. +20% is still a nice difference, but not sure how they did that. Here's hoping M4 Max can include more tech, but that's copium.
960 GB/s is 3090 level so that's pretty good. I'm curious if the Macbooks right now are actually more so compute limited due to tensor throughput being relatively weak, not sure about real-world perf.
https://forums.macrumors.com/threads/lpddr6-new-beginning-of...
If M4 Max could finally break the 400GBps limit of the past few years and hit 600 GBps, it would be huge for local AI since it could directly translate into inference speedups.