Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This isn’t practical at scale. You’ll run into too many novel lessons and burn through too many tokens setting up context.


At scale you need to use more tricks. For example, only inject examples if the tool is going to be needed. Or amass lessons, then ask the LLM to summarize them to prune redundant information before it is used in the context.




Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: