I had voice control set up for the house lights for a few months, and went back to having a manual remote clicker in most of the house and a PIR switch in the pantry.

For me at least, button pushing has a lower cognitive load than talking at something.