The literal definition of "opportunity cost" of something is what that thing costs you in terms of opportunity, i.e. what you could have done otherwise.

If you have millions of dollars in the bank, then you can do a LOT more stuff than some poor schmuck. The opportunity cost of having that freedom taken away, therefore, is a lot higher.