Any data that is small enough to quickly iterate on for learning is small enough to use a simpler approach. The point is learning the techniques.