I think they would be less disappointed if it meant a consistent schedule. These benchmarks are really a lot of fun, not sure if they change hearts and minds, but they are beautiful and fun.

I think being time-boxed rather than implementation-boxed make sense. If you miss a month, you got 30 days to fix it.

Also, they could only "update" the test rules quarterly or every 6 months, give the authors a bit of time to respond.