No, because no harm is done once I delete the files after looking over the notes, and I am able to perform my job far better than otherwise. It's just that from an outside perspective it is unlikely to sound innocuous despite being so.

It's a bit like those 'wait I can explain' situations in sitcoms.

You do you, but if it would creep them out and you knowingly continue while hiding the fact from them, that feels to me like a breach of trust.