What shines better in a resume? ex-founder or ex-founding engineer? If ex-founder is a better role for next job, I think founders are taking much less risk than founding engineers. They get all the exposure to talking to rich people, VCs, learning how financial game works, which i regard much more rewarding career-wise.
proves my point that llms are simply a next token predictor. There are many interesting properties that we see "emergence" of intelligence but I think it's just human's incapability to hold so much knowledge on active memory.
"Next token predictor" isn't quite the burn that it seems like, because perfect next token prediction would require actual understanding. That's because you can almost always cast any question about understanding into a form where it depends solely on the next token (there are a couple nitpicky exceptions and caveats but not many).
GPT 4 is at a high enough level of performance that mere simple statistics aren't really helping it do any better, it really is developing structures especially in the middle layers that perform some amount of high level understanding.
I don't think that pure next token prediction will always be the optimal way to train and enhance these behaviors, but it's not fair to say that it's unrelated, if this really was just stochastic parroting then LLMs would have topped out way before the level they're at now.
That's the thing. Although given the source of their knowledge is pure condensed wisdom, which is some sort of artificial intelligence, they lack the ability to "think", which is crucial to solve problems.
More shocking are those that insists that the human brain must then also work by just guessing the next missing thing. As if the thought process behind I'm hungry starts with "I" and then trying to figure out what next best fits in... it's absurd.
The token would be the pure sensation of hunger, not the word for self, which is merely a convenient abstraction which we use to share knowledge between outside and over time.
> As if the thought process behind I'm hungry starts with "I"
That sounds like {you think that {people who think LLMs work like humans} believe that {the human sensation of hunger} is merely {saying the phrase "I am hungry"}}.
The author is roasting Jeanine Banks and she is probably the real motivation that drove the author writing a whole long article of google's culture when things were beautiful.
Is ADHD a real thing? I see too many SV engineers diagnosed with ADHD to the point that it feels like a large scam run by psychiatrists that they lowered the threshold of the actual ADHD.
It's real but most people don't have ADHD, they can't focus because they aren't actually interested in what they are doing but blame ADHD and take drugs.
