>Stop obsessing about cloud GPUs.

>Go buy retail GPUs.

If you're doing this professionally, you know what you need and what your budget is.

If you're doing this personally, to simply learn? I did the math for myself and figured I could probably buy enough gpu credits for the cost of a 4090 build that it would probably serve me all the way through getting a phd.

>Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs.

See your R&D investment goes up in flames after driver update to block such workload.

There's something to this.

But also... don't update drivers and accept you are missing out on updates that might also be useful.

> Solve the barriers/limitations

I don't think this is possible when you can't pool memory on the 40 series retail GPUs.

Ok, so make an enormous capital investment in tech that will be outdated in two years - if not already outdated, as you mentioned AMD and Intel. Then, I'll need to hire geniuses who can extract juice out of this hardware at a scale that not even Google, Amazon, Microsoft and others could.

Or, I rent just as much top performance hardware as I need, scaling as I go along, and worry about execution and implementation of my niche application instead. You can see why cloud is winning right now.

Except as the previous post points out, you can’t get cloud GPUs.

You can't buy GPUs to build your own cloud. You can access cloud GPUs via the ones that NVidia is selling to.

No it doesn't, and yes you can.