Choosing a specific track is easier on vinyl than cassette, not tougher; there are often visual cues, and you can seek in constant time rather than linear. It takes a steady hand to be sure, but I'll take it any day over fast forwarding / rewinding some arbitrary amount, hunting for the start by sound...
(There are cassette players that can stop winding when they detect silence, and that helps, but they fail on albums with gapless mixing. Admittedly such albums are also difficult to seek by sight on vinyl. On the other hand, there are vinyl players with motorized arms that obviate the need for a steady hand, at the cost of introducing a linear term in seek time, albeit still faster than cassettes.)
Cassette is more difficult, but I will say from experience that after enough time with a specific player (a walkman for example) and a tape you could get uncannily good at seeking to the start/end of a specific track.
(There are cassette players that can stop winding when they detect silence, and that helps, but they fail on albums with gapless mixing. Admittedly such albums are also difficult to seek by sight on vinyl. On the other hand, there are vinyl players with motorized arms that obviate the need for a steady hand, at the cost of introducing a linear term in seek time, albeit still faster than cassettes.)