It's depends on which society. It certainly damage the society who perfer to eat meat.

Right is something that you or someone else has to fight for it. If you prefer to eat meat you have to fight for your right, likewise with the non meat eater.