8 H100s would have enough VRAM to finetune a 70B model.

		ioedward on Sept 17, 2023 \| parent \| context \| favorite \| on: Run LLMs at home, BitTorrent‑style 8 H100s would have enough VRAM to finetune a 70B model.