That only works for applications that uses terminfo. Most don't; VT100/ANSI escape sequences are universally supported nowadays, and a lot of programs just hard-code that.
Plenty of stuff doesn't even check for terminfo (doesn't even check for a TTY) and just dumps ANSI escape sequences over the wire. Like, say, into a file. Which makes grepping it fun later.