You probably can't do this with google (rhasspy on the other hand...), but what is really needed is every-time someone tries something that doesn't work they go program the response that would have been correct.
I think speech recognition is good enough for this, but what is left is making a complex tree. See the 20 questions game where because so many people have put in new answers it now can guess almost everything after just a few questions. This is not easy and it takes a lot of effort to figure out where things didn't work and fix it so it will for the next person. At least some of those things you fix will never be asked again, but you need to do it.
Part of the above is speech recognition needs to expose a confidence and if it thinks it knows ask useful questions about what you mean. (they already do in some cases)
I think speech recognition is good enough for this, but what is left is making a complex tree. See the 20 questions game where because so many people have put in new answers it now can guess almost everything after just a few questions. This is not easy and it takes a lot of effort to figure out where things didn't work and fix it so it will for the next person. At least some of those things you fix will never be asked again, but you need to do it.
Part of the above is speech recognition needs to expose a confidence and if it thinks it knows ask useful questions about what you mean. (they already do in some cases)