The issue with that is that I'd be at a 5 digit number of cards by now, certainly wouldn't keep all of those around, and so I'd stop revising old knowledge.
True. The method sends cards that are already memorized to the back (so to speak) where they are revisited less often. You could conceivably retire those cards forever and take them out the box.