Yeah, I tried to touch on that analogy flaw in the article:
> One interesting difference here is that in the Facebook example people have personal evidence that makes them believe they understand what’s going on.
> With AI we have almost the complete opposite: AI models are weird black boxes, built in secret and with no way of understanding what the training data was or how it influences the model.
Completely agree that our biggest threat right now is complacency. If people form incorrect mental models of what's going on and then shrug their shoulders and accept that's just how it is, we won't make much progress in improving the actual problems.
> One interesting difference here is that in the Facebook example people have personal evidence that makes them believe they understand what’s going on.
> With AI we have almost the complete opposite: AI models are weird black boxes, built in secret and with no way of understanding what the training data was or how it influences the model.
Completely agree that our biggest threat right now is complacency. If people form incorrect mental models of what's going on and then shrug their shoulders and accept that's just how it is, we won't make much progress in improving the actual problems.