That doesn't work. For that to work, the person needs to understand how that algorithm creates its output, and understand its flaws and vulnerabilities, AND be diligent about interrogating the results with those things in mind. Nobody technically sophisticated enough to do that will also have the domain knowledge to evaluate the most consequential decisions.
For example, sentencing "recommendations" are supposed to be exactly that-- recommendations for judges. But, judges seem to rubber stamp the recommendations. I'm sure for some it's a scapegoat in case someone accuses them of not really thinking about it, the more credulous probably assume the algorithm saw something they didn't, and for others, the influence might be more subtle. This is something we should have studied before we started letting this algorithm put people in jail. These are judges. Their most important function is impartiality.
Do you have specifics? A lot of people say things like that when they're toe-to-toe with human psychology but humanity still has a whole lot of problems that a whole lot of people are pretty heavily incentivized to avoid. I don't see how this would be any different.
For example, sentencing "recommendations" are supposed to be exactly that-- recommendations for judges. But, judges seem to rubber stamp the recommendations. I'm sure for some it's a scapegoat in case someone accuses them of not really thinking about it, the more credulous probably assume the algorithm saw something they didn't, and for others, the influence might be more subtle. This is something we should have studied before we started letting this algorithm put people in jail. These are judges. Their most important function is impartiality.