The first few flaming wrecks with self-driving trucks involving particularly ugly (complete crushing, burn-out, etc.) passenger car deaths are going to trigger a massive backlash. I don't think at that point that any arguments about how the overall accident rates are being cut, etc., will hold much water for most people.