>Such oversight is essential to defend against systems driven by what I call the phrenological impulse: drawing faulty assumptions about internal states and capabilities from external appearances, with the aim of extracting more about a person than they choose to reveal.

I think the reality is a bit more cynical. People are looking to filter on who will provide the right social performance. But that's not as comfortable to admit when you're on the side of using or selling such a system.