What's the context length? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		lostmsu 5 months ago \| parent \| context \| favorite \| on: QwQ-32B: Embracing the Power of Reinforcement Lear... What's the context length?

dulakian 5 months ago [–]

The model has a context of 131,072, but I only have 48G of VRAM so I run it with a context of 32768.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact