> As with image generation, one thing I think we haven't adequately considered is once a sizable fraction of the available online data is machine generated, but isn't marked as such, and we begin training models on the outputs of the last generation of models, structurally we can enter a different regime.

Ahh but the spark of true genius lights itself.