"but it would be very bad if my bank or brokerage gets rooted"

Yup. I put everything in the password manager except primary email and bank/brokerage.