I loved the grayscale mode, but in the end I had to set so many exceptions via tasker for apps where I do need color for the UI (Such as Google Maps, Uber, and Calendar), that it proved to be more of a hassle.
I use an iPhone with a home button. I bound greyscale to a triple-click of that so I can switch on and off at will pretty handy if that’s possible on your end.
Good point that I’d never considered—though I honestly didn’t notice and adjusted to it pretty easily. Could see how it would bother some people, though.