Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Someone tested this, and it doesn't look to be saturated.

https://dylancastillo.co/posts/pelicanmaxxing.html

Simon made I think a very good argument for why it's still useful, if not the most robust benchmark in the world.

https://simonwillison.net/2026/Jul/16/kimi-k3/



> Someone tested this, and it doesn't look to be saturated.

They could still pelicanmaxxing but the RL for "pelican riding a bicycle" does incidentally improve "<animal> <verb> <vehicle>".

Or they could've predicted someone would check if they're pelicanmaxxing or the benchmark would switch eventually, so they preemptively RL'd a mixture of animals and vehicles.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: