> Why isn't there a framework that does all this automatically for you? Question...

		amelius on Feb 11, 2023 \| parent \| context \| favorite \| on: How to train large models on many GPUs? (2021) > Why isn't there a framework that does all this automatically for you? Question: could this be implemented in PyTorch in an opaque way? Or would it require changes to its API?