No, we shouldn't. But the cost of installing bollards and the "harm to society" are two distinct costs. There are about 2.37 pedestrian deaths per billion vehicle miles traveled in America. Even if we assign a generous cost of 5M$ per life lost, that only amounts to a 0.01$ per mile driven, which is probably not enough to cover the cost of installing bollards all over the place.
How about 10 bollards per sold car, you can probably get away with $ 1k per bollard (including installation), most cars cost a multiple of 10k. Let‘s see how far that gets you. You can of course modify the bollard tax by car weight or by price.