Hacker Newsnew | past | comments | ask | show | jobs | submit | 1dom's commentslogin

> Really, LLMs are kind of like convenient, wildly inefficient proxies for useful processes. But I'm not convinced they should often end up as permanent fixtures of logical pipelines. Unless you're making a chat bot, I guess.

I think I agree with this. It's made me realise LLMs are great for prototyping processes in the same way that 3D printers are great at prototyping physical things. They make it quick and easy to get something close enough to see the unforeseen problems a proper solution might have.


3d printing is a great analog because there are so many critical considerations that are often missed or can't be accounted for in the prototype, but, it's alright because it's a prototype. The strain testing, durability, manufacturing at scale; none of that is properly addressed. Those might involved some serious, expensive challenges, too. But it's alright because you've got something in your hand that informs you whether or not those challenges are worth contending with. I really love this about LLMs and 3d printing.

This feels like a ridiculous thread that captures everything wrong with modern Javascript ecosystem.

It's grown into a product of cults and attempted zingers rather than pragmatic or sensible technical discussions about what we should and shouldn't expect to be able to do with an individual programming language.

edit: to clarify, I assume there needs to be a basical level of comprehension of programming languages to debate the nuance of one, and if you can't think of a single reason as to why someone would want types removed, that's a possible indicator you don't have that necessary level yet, and I think the most effective way for you to learn that is to Google it. Sorry for coming across as rude if you genuinely don't know this stuff.

If you already know many reasons as to why types would be removed, then it seems disingenuous to ask that question, other than to make the point that you feel types shouldn't be stripped. If you think that, say it, and explain why you think they shouldn't be stripped.


The current state of Javascript is you _have_ to remove types; I was pointing out I can think of reasons why I sometimes wouldn't want to. (Admittedly in a glib manor; though on this site many prefer that to four paragraphs)

How goes that saying?... always assume ignorance or malice will getcha

I really like solutions in this space, and this is quite nice. Seeing people try create solutions like this really tickles my brain a lot. Even if I think more into it and conclude it has catastrophic issues, I still really get a weird kick learning about novel decentralised networks. I really can't explain it. Fancy combinations of encryption and decentralisation just really do it for me, to an abnormal and uncomfortable extent. Hopefully someone else relates to this.

Anyway, I really like this idea, it's cool. When I think about this one though, I feel there's too much friction in the follow/unfollow process. Having unfollowing requiring reenecrypting and rebuilding the entire website for everyone seems cumbersome. It's not a killer in itself, but combined with this:

> If the original post is inaccessible (e.g. the viewer doesn’t follow the author), the reply is hidden entirely. A user only sees replies from people they follow — this is the spam prevention mechanism.

I think this is going to prevent it from scaling in any desirable way. I know it's not intended to scale, and is targetted at smaller freinds networks, not influencers, but again, even small friendship networks grow complex, and I can see the experience on S@t turning into the worst parts of activitypub where you can only read half of the interesting replies because not being friends, and it being a pain to then become mutual friends.

But, I really, really do like that s@t feels like a combination of RSS, activity pub and static sites, having a browser heavy client is interesting to.

It does feel a bit like s@t wants stuff to be easily locked down between a dynamic list of friends though, and it feels a bit weird to have the foundational tech of such a protocol be static sites, which by definition make it hard to lock stuff down to a dynamic list of friends. Hmmmm, I really do love/hate static site architecture

This is nice though, thanks for sharing.


Fedify is really fun to mess around with. The fedify tutorial was also really great for learning about developing with Activity pub and the fediverse in general.

I don't use Discord generally, but the fedify Discord is particularly useful, and I see how some discussions there have evolved into features in this release which is nice too!


I think the appeal and use case for Graphene and similar OS for most users is the Google/privacy/ownership type argument.

I do understand your point that people at risk of state level attacks might get a false surface level appearance of defence from this. But then anyone who's a target of state level attacks and is making OS decisions based on a surface level understanding of the tech is not going to have a good time anyway.


Personally I run an ollama server. Models load pretty quickly.

There's a distinction between tokens per second and time to first token.

Delays come for me when I have to load a new model, or if I'm swapping in a particularly large context.

Most of the time, since the model is already loaded, and I'm starting with a small context that builds over time, tokens per second is the biggest impactor.

It's worth noting I don't do much fancy stuff, a tiny bit of agent stuff, I mainly use qwen-coder 30a3b or qwen2.5 code instruct/base 7b.

I'm finding more complex agent stuff where multiple agents are used can really slow things down if they're swapping large contexts. ik_llama has prompt caching which help speed this up when swapping between agent contexts up until a point.

tldr: loading weights each time isn't much of a problem, unless you're having to switch between models and contexts a lot, which modern agent stuff is starting to.


I always felt the idea of trying to align your code, policy, software and infrastructure so it's easy to do compliance is the bread and butter of devops and devsecops in a regulated environment,

Is this an article by someone who's just done ISO 27001 for the first time and realised that?


I really dislike it too.

I think it might be adults ignoring established grammar rules to make a statement about how they identify a part of a group of AI evangelists.

Kind of like how teenagers do nonsensical things like where thick heavy clothing regardless of the weather to indicate how much of a badass them and their other badass coat wearing friends are.

To normal humans, they look ridiculous, but they think they're cool and they're not harming anyone so I just leave them to it.


make a statement about how they identify a part of a group

That’s what it is. A shibboleth. They’re broadcasting group affiliation. The fact that it grates on the outgroup is intentional. If it wasn’t costly to adopt it wouldn’t be as honest of a signal.


On a scale from the purest, not lifting a finger anymore than to strike a keyboard, of virtue signaling to putting one's money where their mouth is this shibboleth is about as costly as the tidal zone is dry land.


can't imagine getting this riled up over lowercase text. some serious fist-shaking-at-clouds energy.

it's meant to convey a casual, laid back tone - it's not that big of a deal.


You convey tone through word choice and sentence structure - trying to convey tone through casing or other means is unnecessary and often just jarring.

Like look at the sentence "it has felt to me like all threads of conversation have veered towards the extreme and indefensible." The casing actually conflicts with the tone of the sentence. It's not written like a casual text - if the sentence was "ppl talking about this are crazy" then sure, the casing would match the tone. But the stodgy sentence structure and use of more precise vocabulary like "veered" indicates that more effort has gone into this than the casing suggests.

Fair play if the author just wants to have a style like this. It's his prerogative to do so, just as anyone can choose to communicate exclusively in leetspeak, or use all caps everywhere, or write everything like script dialogue, whatever. Or if it's a tool to signal that he's part of an in-group with certain people who do the same, great. But he is sacrificing readability by ignoring conventions.


It's hard to find sentence breaks, it is actually about readability and accessibility


Ironically, this sentence is called a comma splice or run-on sentence. A period or semicolon would be correct.

I agree with the sentiment too, or maybe I am getting old :P


I don't think it's about getting old, it's about expecting clear and parsable communication

Some people are being lazy, they will get less attention, ideally


I also agree it sucks, and I don't see a problem pointing it out.


It's just very poser behavior.


TIL hacker news is dominated by boomers


if by boomers you mean a community with above average expectations for the quality of submissions and commentary, sure


I thought it was a joke about a propensity to peddle public policy that will drive the world off a cliff, but not until after we get ours.


That's politicians and media influencers of all ages, not the general public

The new generation of tiktok / podcast "independent journalists" is a serious issue / case of what you describe. They are many doing zero journalism and repeating propaganda, some paid by countries like Russia (i.e. Tim Pool and that whole crew that got caught and never face consequences)


> to normal humans, they look ridiculous, but they think they're cool and they're not harming anyone so i just leave them to it.

fixed it for you! now it’s in a casual, laid back tone.


I run Qwen3-Coder-30B-A3B-Instruct gguf on a VM with 13gb RAM and a 6gb RTX 2060 mobile GPU passed through to it with ik_llama, and I would describe it as usable, at least. It's running on an old (5 years, maybe more) Razer Blade laptop that has a broken display and 16gb RAM.

I use opencode and have done a few toy projects and little changes in small repositories and can get pretty speedy and stable experience up to a 64k context.

It would probably fall apart if I wanted to use it on larger projects, but I've often set tasks running on it, stepped away for an hour, and had a solution when I return. It's definitely useful for smaller project, scaffolding, basic bug fixes, extra UI tweaks etc.

I don't think "usable" a binary thing though. I know you write lot about this, but it'd be interesting to understand what you're asking the local models to do, and what is it about what they do that you consider unusable on a relative monster of a laptop?


I've had usable results with qwen3:30b, for what I was doing. There's definitely a knack to breaking the problem down enough for it.

What's interesting to me about this model is how good it allegedly is with no thinking mode. That's my main complaint about qwen3:30b, how verbose its reasoning is. For the size it's astonishing otherwise.


30-A3B model gives 13 t/s without GPU (I noticed that token/sec * # of params matches memory bandwidth).


Something like 21 t/s on pure CPU on a mini PC that's <2 years old.


Honestly I've been completely spoiled by Claude Code and Codex CLI against hosted models.

I'm hoping for an experience where I can tell my computer to do a thing - write a code, check for logged errors, find something in a bunch of files - and I get an answer a few moments later.

Setting a task and then coming back to see if it worked an hour later is too much friction for me!


This is interesting! Do you have any more info? I just discovered sunshine/moonlight work surprisingly well on Quest 3 for remote desktop to linux, I'd not really considered Termux X11 natively though.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: