Isn’t that exactly what engineers do? Even very strong bridges aren’t designed to survive every possible eventuality.
I'm talking about engineering a bridge for 50 cars that collapses at 51, not engineering a bridge for 500 cars that is only expected to get 50
Engineering does require tradeoffs of course. But that's not what the minimum possible quality is
An LLM system, on the other hand, can fail because you moved some punctuation around.
An LLM system can fail without changing anything, it could just fail more or less randomly without any way to diagnose why it happened
Isn’t that exactly what engineers do? Even very strong bridges aren’t designed to survive every possible eventuality.