The reason most musicians don't use staff notation is because most musicians do not need it unless they want to engage with the literate tradition of music, and are not disadvantaged if they can't. Not because of any inherent difficulties in the notation itself.
Literacy is just as helpful in music as in any other artform. One can certainly play and create music without learning how to read and write staff notation, but being literate can only help!
