Thanks for the comment. This defense works: but you have to remember to lock your phone when you put it down.

Siri can be used for many things when the device is locked.

Not necessarily. Both Android and iOS allow voice assistants to interact with phones for certain activities even without unlocking the phones. Typical scenario: someone puts a phone on the table and does something else (typing on a computer), not paying attention to the screen.