Personally, I think for people like that, who think that "taxes are theft" and that they shouldn't have to pay for stuff they don't agree with, that we should allow them to opt out of paying taxes and the entire social contract.

In exchange, they give up all police protection. If someone wants to rob them or kill them, no problem, it's not a crime and the police won't intervene.