Why would you touch your face more often? At least you won't have a direct contact with your hands. Besides, why do you think putting on a mask and washing hands are somehow mutually exclusive?
To adjust the mask. You won't have direct contact with your hands, but the mask is a better environment for disease than your skin is, so touching it instead of your skin isn't any better.
