This is pretty much like people who say that we could just get rid of the police because all they do is harass everyone all day anyway.

Users in a well behaved system never notice the fantastic amount of work that goes into keeping the system well behaved. If you do your job right as few people as possible know you exist. It's the dilemma of the maintainer: extremely vital component of the system who everyone thinks does nothing in the best case and enraged at when something breaks in the worst case.