Sure, decomposition is already in the pre-training corpus. and then we can do some "instruction-tuning" on top. This is fine for the last mile, but that's it. I would consider this unaddressed and after with the root comment.
It's not as one-dimensional as good vs bad. Transformers generally are extremely useful. Do I want to read your transformer generated writing? Fuck no. Is code generation/understanding/natural language interfaces to a computer good? I'd have to argue yes, certainly.
I cry every time somebody tries to frame it one dimensionally.
Cultured people have no need for such words in public discourse so I'd rather not see either of them or the need. People are judged by the words they use.
reply