Far far more people use ChatGPT than Claude.ai

I started skimming and instantly thought AI, then came to the comments to see if it was just me.

School incentives are not really aligned around maximizing learning rate for every student. (E.g. that is why there is/was debate around teaching phonetics)

Cool experiment! My intuition suggests you would get a better result if you let the LLM generate tokens for a while before giving you an answer. Could be another experiment idea to see what kind of instructions lead to better randomness. (And to extend this, whether these instructions help humans better generate random numbers too.)

ChatGPT's tone is slowly taking over the entire internet

People still play chess, even though now AI is far superior to any human. In the future you will still be able to hand-write code for fun, but you might not be able to earn a living by doing it.

Same with sewing/knitting by hand.

The live demos are using a very cheap and not very smart model. Do not update your opinion on AI capabilities based on the poor performance of gpt-4o-mini

The system prompt can include examples. That is often a good idea.

> because in 6 months when the AI labs release a more capable model

How many years do we have to keep hearing this line? ChatGPT is two years old and still can't be relied on.

and where is that product that was developed on the edge of current AI capabilities and now with latest AI model plugged in it's suddenly working consistently? All I am seeing is models getting better and better in generating videos of spaghetti eating movie stars.

They're coming. I've seen the observability tools try to do this but I still have to tweak it. it's just time-consuming. Empromptu.ai is the closest to solving this problem. They are the only ones that have a library that you install in your to do system optimization, evals, for accuracy in real-time.

For me, they have come from the AI labs themselves. I have been impressed with Claude Code and OpenAI's Deep Research.

while i'm bullish on AI capabilities, that is not a very optimistic observation for developers building on top of it

In 6 months when FSD is completed, and we get robots in every home? I suspect we keep adding features, because reliability is hard. I do not know what heuristic you would be looking to conclude that this problem will eventually be solved by current AI paradigms.

GP comment is what has already happened "every 6 months" multiple times

This is the crux of the issue. Whether you think this is like extending a ladder to the moon, or more like we figured out how to get to the moon and are now aiming at Jupiter.