Good summary. I wonder if the "perform like aggregated humanity" behavior comes from using greedy decoding. If you actually sample according to the token probs, it seems like you should still end up "on the edge".