A PhD will tell you if you're asking the wrong question. Human empathy allows us to intuit what a person's actual goals might be and provide a course correction.
For example, on Stack Overflow you'll see questions like how do I accomplish this thing, but the best answer is not directly solving that question. The expert was able to intuit that you don't actually want to do the thing you're trying to do. You should instead take some alternative approach.
Is there any chance that models like these are able to course correct a human in this way?
Jeesh, don't bring this up, you're apt to get ten people arguing about the X,Y problem instead, and why you should or shouldn't to 10 other things, rather than ask the user if they are on a legacy system where they can't make major changes.
For example, on Stack Overflow you'll see questions like how do I accomplish this thing, but the best answer is not directly solving that question. The expert was able to intuit that you don't actually want to do the thing you're trying to do. You should instead take some alternative approach.
Is there any chance that models like these are able to course correct a human in this way?