Well the memory available to the processor for state is finite, too. Thus, every classical computer is a finite state machine.

That said, some programs have state that is more finite than others. :-) Deep down, a "state machine-based design" is a mindset of the designer.