MRAM and MRAM-CIM is like 10 years ahead of this and going to make a huge impact on efficiency and performance in the next few years, right? Or so I thought I heard.
Memristors are also probably coming after MRAM-CIM and before photonic computing.
So if I understand, this is basically advanced activation steering as a service? And you have already identified vectors for several open models that make them more truthful or better at reasoning and apply them automatically?
Because the API has a persona option which might be achieved with something like this https://github.com/Mihaiii/llm_steer or maybe for closed models you just have to append to the prompt.
What open source models are available? In the docs I only see mention of Google Flash Lite or something which is closed.
Hearing the clarity, creativity, and force behind his thoughts and speech, I'd give a more than 1/200 chance Ali Behrouz gets himself a Turing award. At the very least, I think he will end making major contributions to AI.
I am an autist in a family filled with autists - some of whom I think you would CLEARLY recognize as autistic, but some of whom you'd have this "absolute nonsense" reaction to. I say that because that is the reaction I had myself, I was very skeptical of this whole thing until I came to learn a lot about it after my daughter was diagnosed.
I don't think it's mainstream science, but monotropism is a theory of attention which has been theorized as the central underlying feature of autism and you might be interested in looking it up. It makes a lot of sense to me. I think the more mainstream way of talking about it is bottom up processing (details, the trees rather than the forest) vs top down processing (holistic, the forest rather than the trees).
Either way - you can get a very diverse set of results depending on how which sorts of things the individual's attention gets commandeered by, and by how much. Some people can't stop paying attention to individual sounds or individual tactile sensations or any other individual sensation, some people have difficulty putting sentences together despite having an excellent grasp of each word, some get stuck trying to process specific individual facial expressions and fail to grasp the actual social dynamics going on around them - it goes on and on.
Some have special interests (deep attention to a specific topic) that are extremely economically profitable (programming) or simply socially mainstream (music or movies) which give them social cachet. Some have special interests that mark them as weird and socially outcast (collecting bugs, memorizing bus routes). Some are very intelligent and are able to make up for a lot of difficulties with effort. Some have a great focus on social dynamics and come off quite charming. All of this can add up to very different experiences though life, very different sets of difficulties, and that of course can compound.
I think you should expect there to be a very wide variety of autistic people, if there is an underlying similarity in processing things. There is a very wide variety of non-autistic people, too. Heck, I think there's a wide variety of people with only one hand, just because Jim Abbott was a major league baseball pitcher doesn't mean he actually had two hands, and just because Muggsy Bogues was a great NBA player doesn't mean he wasn't short.
What's your thesis here? I'm getting "shy, slightly socially awkward and very intelligent is not what autism is," and "people who are intelligent, knowledgeable, socially tuned and socially integrated claiming to be autistic must obviously be lying, autistics could not possibly be those things."
There are social (cut me some slack, I'm autistic) and in socialized medicine systems, financial benefits to an autism diagnosis. So yeah, why wouldn't you claim to be autistic, what's the downside?
Add to that Gen-Z, socially awkward, isolated and poisoned by their obessive phone addictions frantically searching the internet "Why do I feel socially awkward?" and a million "Take out autism test!" links later get their answer. Yes indeed, they have autism, the test proved it.
Autism is much more than social awkwardness, and I'm sure you're not intending to be, but this post is extremely dehumanizing and insulting to people dealing with the issues that an ASD diagnosis typically presents with. and, by the way, many high functioning individuals have to fight for their entire lives to even get a diagnosis, so I'm not sure where you're getting your information from that these are being "handed out like candy" or whatever. I can point you to a variety of sources online if you're interested in learning what this actually is.
Unfortunate you have been downvoted because this is definitely the case. I am not actually sure that anyone disagrees with this, UK governments on both the left and right have identified this.
Ten years ago in the UK getting disability money for autism meant being non-verbal, requires extensive in-home care, unable to live independently, etc. Whatever you think about the definitions, it is very clearly not the same now and refers exclusively to some kind of social disorder. Rates of the former haven't changed significantly, rates of the latter are exploding.
When I say this, I don't think people understand the scale here: in some regions of the UK as much 40% of primary-school age children are disabled. Spending in this area is projected to bankrupt many local governments...to be clear, these are economic units with multi-billion pound budgets and responsibility for basic societal functions. It is difficult to understate the extent to which this is an issue.
I don't necessarily think people who engage in the over-diagnosis are ill-meaning: individuals are being given money to do this, psychologists are raking it in hand over fist, and the UK is now a place with a very effective disability lobby with lots of incentives to keep it all going. But it remains true despite all of this that it cannot continue.
Just imo, the damage done already is close to irretrievable. The situation in UK schools is dire: teachers are frequently attacked physically (in some regions in the UK, this is so frequent and so little support is provided because of the inability to exclude "disabled" children that there are frequent staff walkouts), typical classes have 5-6 ASD assistants at all times, behaviour is so poor that other children are unable to learn, parenting of these children is non-existent because parents gain financially and the incentives to blame a medical condition rather than poor parenting are clear, etc. If you consider other trends, it is dire...we are talking about most of the workforce entrants coming out: many unable to speak English, can't perform basic tasks without support, zero impulse control, usually claiming benefits straight out of secondary...it is so bleak.
Lol. You don't think that Microsoft has _a_ compelling AI product? The new version of 365 Copilot is objectively compelling, even if it is a work in progress. And Github Copilot is also objectively compelling.
Love Tektronix vector computers. xterm can run Tek vector commands (search for "Tektronix xterm" such as the last time it came up on here) and I think a few demos are even included in some distros.
kitty doesn't have Tektronix vector support right? Would be cool if they would consider adding.
But something interesting happened recently which is that it is now apparently a given that terminal programs support raster graphics. At least, the people at r/command line were treating it as such when someone recently posted a program that requires something like kitty graphics protocol to work at all.
The kitty raster protocol is somewhat efficient. It could be interesting to combine that with some ideas for low latency lightweight computing and social networking.
The simplest version of that might be just to have a group of people start setting up some type of BBSs over ssh, but designed to upgrade the graphics just slightly over ANSI, or even perhaps combined with ANSI. People could use emulated vector monochrome graphics for some screens if they wanted that Tek vibe.
Another step up possibly would be to make a few STUN/TURN servers or some setup so people on IPV6 could find and each other even if at home and if IPV4 still connect with whatever NAT traversal or maybe there can be such as thing as ssh over WebRTC? That might not make sense.
You could also make it content centric and set up something to easily do RSS over IPFS (I assume that exists) with a group that has agreed they will target ANSI plus kitty graphics with some set document size limits to keep things fast and lightweight.
Because kitty graphics are based on escape codes, you might also use such a social network for distributing lightweight (binary size limited) web assembly applications and games that are designed to run in a terminal supporting that. Because web assembly runtime support for text output is good I believe.
I do think that there should be some built in load latency or data size limit tested and enforced somehow to ensure that you keep the snappiness possible with text interfaces.
Greg Kohs and his team are brilliant. For example, the way it captured the emotional triumph of the AlphaFold achievement. And a lot of other things.
One of the smart choices was that it omitted a whole potential discussion about LLMs (VLMs) etc. and the fact that that part of the AI revolution was not invented in that group, and just showed them using/testing it.
One takeaway could be that you could be one of the world's most renowned AI geniuses and not invent the biggest breakthrough (like transformers). But also somewhat interesting is that even though he had been thinking about this for most of his life, the key technology (transformer-type architecture) was not invented until 2017. And they picked it up and adapted it within 3 years of it being invented.
Also I am wondering if John Jumper and/or other members of the should get a little bit more credit for adapting transformers into Evoformer.
Yeah I don’t mean to say they’re not a real filmmaker or untalented etc, I mean more the context they’re doing it. That they’ve chosen to cover this topic themselves, and that they would show critical angles of it and not just promo + hagiography
Many researchers may be interested in making minds that are more animal-like and therefore more human. While this makes sense to certain extent to gain capabilities, if you take it too far then you run into obvious problems.
There is enough science fiction demonstrating reasons for not creating full-on digital life.
It seems like for many there is this (false) belief that in order to create a fully general purpose AI, we need a total facsimile of a human.
It should be obvious that these are two somewhat similar but different goals. Creating intelligent digital life is a compelling goal that would prove godlike powers. But we don't need something fully alive for general purpose intelligence.
There will be multiple new approaches and innovations, but it seems to me that VLAs will be able to do 95+% of useful tasks.
Maybe the issues with brittleness and slow learning could both be addressed by somehow forcing the world models to be built up from strong reusable abstractions. Having the right underlying abstractions available could make the short term adaptation more robust and learning more efficient.
I disagree. As many intellectuals and spiritual mystics attest to their personal experience, knowledge actually liberates mind. Imagine a mind which truly understands that it is embedded inside a vastness which spans from planck scale to blackholes. It would be humble or more likely amoral.
Okay, sure, at least according to a certain interpretation, but...
> Imagine a mind which truly understands that it is embedded inside a vastness which spans from planck scale to blackholes. It would be humble or more likely amoral.
This is just gobbledygook. The conclusion does not even follow from the premises. You are question begging, assuming that moral nihilism is actually true, and so naturally, any mind in touch with the truth would conclude that morality is bullshit.
Memristors are also probably coming after MRAM-CIM and before photonic computing.
reply