What's 16 iter inference? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		letitgo12345 on June 21, 2023 \| parent \| context \| favorite \| on: GPT4 is 8 x 220B params = 1.7T params What's 16 iter inference?

coolspot on June 21, 2023 [–]

16 iterations of inference. Like each of 8 models is processed 2 times.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact