If I'm not mistaken this is because without this permission they can only see audio, video and image files. You wouldn't be able to use it comfortably to do it's job.

Personally I use it with Storage Scopes on GrapheneOS.