16 iterations of inference. Like each of 8 models is processed 2 times.

		coolspot on June 21, 2023 \| parent \| context \| favorite \| on: GPT4 is 8 x 220B params = 1.7T params 16 iterations of inference. Like each of 8 models is processed 2 times.