Good question, I was wondering the same. My hunch would be that even if we had a...

		jpcompartir 4 months ago \| parent \| context \| favorite \| on: Context Rot: How increasing input tokens impacts L... Good question, I was wondering the same. My hunch would be that even if we had a lot more annotated examples of reasoning and retrieval over 10,000+ tokens, the architectures we have today would still be limited.