Do libraries like torch and tensorflow facilitate this? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		amelius on Sept 4, 2022 \| parent \| context \| favorite \| on: Running Stable Diffusion on Your GPU with Less Tha... Do libraries like torch and tensorflow facilitate this?

fragmede on Sept 4, 2022 | [–]

Yes, eg https://pytorch.org/docs/stable/generated/torch.nn.parallel....

amelius on Sept 4, 2022 | | [–]

Thank you!

matsemann on Sept 4, 2022 | [–]

Quite trivial to implement this yourself if you want to. See gradient accumulation in fastai for instance https://www.kaggle.com/code/jhoward/scaling-up-road-to-the-t...

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact