"Amateurs" here meaning people that didn't go to an Ivy League school and isn't part of the same clubs. They definitely are not small fish. That's the point. They made out like bandits (literally), and they're not part of the "club," therefore, they have to go.