this attitude is so ridiculously disingenuous. Surely if a computer can score incredibly well on math olympiad questions, among other things, "a computer can make plausible-looking but incorrect sentences" is dismissive at best.
I have no idea about AGI but honestly how can you use claude or chatgpt and come away unimpressed? It's like looking at spaceX and saying golly the space winter is going to be harsh because they haven't gotten to Mars yet.
There's a big difference between those two examples.
Mars is hard but there are paths forward. More efficient engines, higher energy density fuels, lighter materials, better shielding, etc, etc. It's hard but there are paths forward to make it possible with enough time and money. We have an understanding of how to get from what we have now to what makes Mars possible.
With LLMs, there is no path from LLM -> gAI. No amount of time, money or compute will make that happen. They are fundamentally a very 'simple' tool that is only really capable of one thing - predicting text. There is no intelligence. There is no understanding. There is no creativity or problem solving or thought of any kind. They just spit out text based on weighted probabilities. If you want gAI you have to go in a completely different direction that has no relationship with LLM tools.
Don't get me wrong, the work that's been done so far took a long time and is incredibly impressive, but it's a lot more smoke and mirrors than most people realize.
I'll grant that we could send humans to mars sooner if we really wanted to. My point is that not achieving a bigger dream doesn't make current progress a hype wave followed by a winter.
And "LLM's just make plausible looking but incorrect text" is silly when that text is more correct than the average adult a large percentage of the time.
I have no idea about AGI but honestly how can you use claude or chatgpt and come away unimpressed? It's like looking at spaceX and saying golly the space winter is going to be harsh because they haven't gotten to Mars yet.