Hacker Newsnew | past | comments | ask | show | jobs | submit | haaz's commentslogin

it is barely an improvement according to their own benchmarks. not saying thats a bad thing, but not enough for anybody to notice any difference


i think its probably mostly vibes but that still counts, this is not in the charts

> Windsurf reports Opus 4.1 delivers a one standard deviation improvement over Opus 4 on their junior developer benchmark, showing roughly the same performance leap as the jump from Sonnet 3.7 to Sonnet 4.


That is a big improvement.


That's why they named it 4.1 and not 4.5


When it's "that's why they incremented the version by a tenth instead of a half" you know things have really started to slow for the large models.


Opus 4 came out 10 weeks ago. So this is basically one new training run improvement.


And in 52 weeks we've gone 3.5->4.1 with this training improvement, meanwhile the 52 weeks prior to that were Claude -> Claude 3. The absolute jumps per version delta also used to be larger.

I.e. it seems we don't get much more than new training run levels of improvement anymore. Which is better than nothing, but a shame compared to the early scaling.


Is it really a bigger jump to go from plausible to frequently useful, than from frequently useful to indispensable?


Why is there supposed to be no step between frequently useful and indispensable? Quickly going from nothing to frequently useful (which involved many rapid hops between) was certainly surprising, and that's precisely the lost momentum.


They released this because competitors are releasing things


They need to leave some room to release 10 more models. They could crank benchmarks to 100% but then no new model is needed lol? Pretty sure these pretty benchmark graphs are all completely staged marketing numbers since they do solve the same problems they are being trained on – no novel or unknown problematic is presented to them.


I am still very early, but output quality wise, yes, there does not seem to be any noticeable improvement in my limited personal testing suite. What I have noticed though is subjectively better adherence to instructions and documentation provided outside the main prompt, though I have no way to quantify or reliably test that yet. So beyond reliably finding Needles-in-the-Haystack (which Frontier models have done well on lately), Opus 4.1 seems to do better in following those needles even if not explicitly guided to compared to Opus 4.


I will only add that it's interesting that in the results graphic, they simply highlighted Opus 4.1 - choosing not to display which models have the best scores - as Opus 4.1 only scored the best on about half of the benchmarks - and was worse than Opus 4.0 on at least one measure.


"You pay $20/mo for X, and now I'm giving you 1.05*X for the same price." Outrageous!


Good! I'm glad they are just giving us small updates. Opus 4 just came out, if you have small improvements, why not just release them? There's no downside for us.


I don't think this could even be called an improvement? It's small enough that it could just be random chance


I’ve always wondered about this actually. My assumption is that they always “pick the best” result from these tests.

Instead, ideally they’d run the benchmark tests many times, and share all of the results so we could make statistical determinations.


Public transport simply does not work at low densities, and improves with density. Car based societies are, almost by definition, not walkable. Dense, walkable cities are cheaper, healthier, prettier, greener, and more productive.

There are problems that come with density, like crime, but there are solutions to that other than low density. I encourage you to explore life in Asian cities, especially SE China or Singapore, to see how great low crime, high density cities can really be.


When I worked at a large bank they blocked ChatGPT on the network. Unfortunately I was a new grad who didn’t know Java working in a Java team. I just turned off the vpn and copy pasted the code back and forth until it worked. Boss didn’t seem to mind. Left the job after 2 months anyway.


> I was a new grad who didn’t know Java working in a Java team

All the more reason not to use ChatGPT then.


Very cool, thanks for sharing. How did you train it? Just manually labeling the data?


I hired some workers in Bangladesh


Seems similar to plotly dash, no?


The biggest difference I see (though I'm not super familiar with Plotly) is that we define data transformations in SQL, while Plotly uses Python. One benefit of SQL is that it provides the advantage of tracing data lineage from source to visualization, which gives you visibility into data dependencies - something that Python code in Plotly Dash doesn't offer.


Doubt it. If somebody attacked my dog I’d shoot them, but not if they attacked my hoover.


This scenario has almost nothing to do with a scenario that includes armed law enforcement.


You sound too reasonable, you wouldn't be able to work in law enforcement.


Great guide, especially for beginners/laymen.


I consider these advanced splices. Someone fixing a power cord in their house need not go to such extremes.


I always splice wires considering these good practices, regardless of what application. I just like doing things correctly and reliably.

I also have a little bit of a fetish. I really enjoy it when other people do their work correctly and do those small things that show their prowess. And I like to to think somebody someday sees what I did and will enjoy it the same.

That's why, when I sail, I always have all my lines neatly tied and organised. And use proper knots for their applications. And look at other yachts when docked to see if their owners know what they are doing or not.


Do you knoll when building Lego?


These days I leave Lego for my kids.


Just a reminder to all homeowners that the other extreme is also bad; you can't just wire-tape two Romex cables together in an attic and call it a day!


I wish someone had told the person that did nearly this very thing to the low voltage control cable to my external AC compressor. At least in the attic it would not be exposed to weather and UV. <facepalmEmoji>


Unbelievable, thanks so much. I’ll definitely use this for my job hunt.


Glad you like it! If you have any other suggestions or feedback, feel free to share. Aloha


This is why we’ll never have an all in one wechat app in the west.


Thank you for setting this up, it was incredibly helpful when I moved to Berlin


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: