Their holdings gained at the expense of the population?

There’s a huge difference between a family that has gathered obscene wealth through royal privilege and families that pass on their moderate inheritances to children.

Let’s start by enforcing normal inheritance tax on them, rather than letting them sidestep it using family trusts.