Android 4.3 has that fine-grained permission control built in now, but it's hidden. It may not be 100% production ready, but it can be exposed and used by apps that launch it, such as: https://play.google.com/store/apps/details?id=com.schurich.a...

Of course, the chances are that no small number of apps you might be tempted to restrict will promptly crash since they'll assume that having asked for the permission up front means they'll get whatever data they want when they ask for it.