Interesting observation. One one hand, these resemble more the notes that an actual participant would write while solving the problem. Also, less words = less noise, more focus. But also, specifically for LLMs that output one token at a time and have a limited token context, I wonder if limiting itself to semantically meaningful tokens can be create longer stretches of semantically coherent thought?
The original thread mentions “test-time compute scaling” so they had some architecture generating a lot of candidate ideas to evaluate. Minimizing tokens can be very meaningful from a scalability perspective alone!
This is just speculation but I wouldn't be surprised if there were some symbolic AI 'tricks'/tools (and/or modern AI trained to imitiate symbolic AI) under the hood.
In transformers generating each token takes the same amount of time, regardless of how much meaning it carries. By cutting out the filler from the text, you get a huge speedup.
Except generating more tokens also effectively extends the computational power beyond the depth of the circuit, which is why chain of thought works in the first place. Even sampling only dummy tokens that don't convey anything still provides more computational power.
I mean, generating more tokens means you use more computing power, and there's som e evidence that not all of these filler words go to waste (esp since they are not really words, but vectors that can carry latent meaning), as models tend to become smarter when allowed to generate a lot of heeming and hawing.
It's been proven that this accidental computation is actually helping CoT models, but they're not supposed to work like that - they're supposed to generate logical observations and use said observations to work further towards the goal (and they primarily do do that).
Considering filler tokens occupy context space and are less useful than meaningful tokens, a model that tries to maximize useful results per amount of compute, you'd want a terse context window without any fluff.
This feels like a sort of granular MPAA/content rating but instead of movies it is for mobile games. Of course that is very valuable, and knowing that a particular game has certain attributes could help someone avoid it before they come across them while playing it (similar to how people approach content ratings and trigger warnings), but I don't think it makes sense to rank games based on that. I don't care to know what is the game with the fewest dark patterns, I care to know what is the best game that doesn't have that many (or particular ones that affect me). It looks like the data is there, so this is likely just an improvement on the presentation side. They seem to have coverage of around 50000* games which is very impressive, so perhaps at this point they should spend some time to make that data actually accessible.
I would personally recommend https://nobsgames.stavros.io/ for similar purposes, even though it has a much smaller collection as it seems better curated and way easier on the eyes.
*Edit: Scratch that, it looks like games after page 9 don't have ratings so it's more like 300 games total with a couple of reviews each.
> Secular therapists often don't advertise that they are humanist or atheist because that might alienate the churches and ministers who frequently make referrals to them, as well as potentially driving away religious clients.
I'm not sure I totally buy it, but at least that's their rationale, and it sounds fairly reasonable to a certain degree. Therapists might not want to advertise that they take a secular approach if they believe it might drive away potential customers. Though I'm not exactly sure why it would drive away potential customers -- isn't the point that they get recommended to by ministries because they are good therapists regardless of their faith? If they do not push spirituality onto their customers, and ministries still recommend them, would those ministries stop recommending them if they found out that they advertise that they don't push spirituality (i.e. the actual approach they take with patients)?
I have to say though that some parts of this feel a bit strange. The registration page has an (optional) question asking "What, if any, is your former religion?". Like, wouldn't it be reasonable for a currently religious person to seek out a secular therapist? Sure, this doesn't exclude religious people in any shape or form, but at the very least it feels a bit leading as a question, almost as if being an atheist is expected of the patient. Full disclosure, I consider myself to be vaguely religious, so I might be looking at this from a tinted lens, but I would also prefer a secular therapist to one that matches my beliefs.
I'm a minister, in New Zealand (not the US!). I'd always recommend a Christian counsellor to a parishioner who needed counselling, and I'd always go to one myself. If I'm going to unburden myself on a professional I'd rather have a counsellor who was on the same wavelength about God stuff, and I'd really really rather not have one who thought my beliefs were wrong/stupid/etc.
Looking at the Secular Therapists project they clearly fall into the "think my beliefs are wrong/stupid/etc" category. The about us page talks about religion "infecting minds!"
Nice, pretty cool stuff. In high-school I worked on something similar (https://github.com/rafket/pam_duress), though this seems to have a somewhat cleaner implementation which is nice to see, and hopefully a more eager maintainer.
I’m reading the readme of your project, and got to the part where it says
> for example a mail could be automatically sent from his computer to a rescuer, a script could delete sensitive files in his hard-disk or a certain Rick Astley song could be appropriately played
And I’m just imagining someone having set two duress passwords; one for kidnapping situations and one that they put there as a joke. And then they get kidnapped and they try to input the one supposed to call for help, but they misremember so they input the rickroll trigger instead.
And the kidnappers are like “hey what the hell, you think this is funny man? turn that off” and the kidnapped person cries for having messed up their one chance at calling for help.
There are some issues with nuvious' pam-duress that allow for untrusted string inputs when handling scripts with system() call, and I sent a patch to them via E-mail in an attempt to highlight the issues and provide a basis for a better way to handle it.
Hey, just found that patch in my email. Will try to get that encoded into a formal issues on the project. If you have time yourself feel free to that or any other issue yourself. Also looking for 3rd party reviews on the PR's I have open now and into the future.
I am working on a Firefox extension for search aggregation. It currently works with DuckDuckGo, Wikipedia, Stack Overflow, Reddit, and others. The idea is that for 80% of my searches I can find the answer on Wikipedia or Stack Overflow, removing the need for a general search engine such as DuckDuckGo or Google, and thus hopefully avoiding blogspam and tracking to some extent. Extraction works through XPath, and I am trying to make it easier to add new engines without looking at the HTML.
Unfortunately, it currently looks terrible, and so far has received one 1-star review, which is not doing much to help my motivation.
I originally read Thermomechanical as Thermonuclear, and thought that this was related to the recent r/ShowerThoughts post [1]. I guess we could use this simulation to answer that question more convincingly :)
I'm glad I misread anyway because the video was very impressive!
I don't really get how this works. Since it is completely offline, what's stopping someone from paying some amount, but not subtracting it from their account? I guess each party could sync the transactions when they get back online, but this seems messy.
In my experience, what helped me the most when starting to learn how to code was having a motivating problem that I wanted to solve. Why do I care what a for-loop is if I can't see how it is even helpful? Many tutorials have examples when teaching, but I believe that the problem should come first, and act as the glue between the basic ideas that will be introduced. Then, the mentor's most important role is to guide the student through best practices, such as style and performance.
His father is a coder too and he is making a specific IT school here. So he comes with basic knowledge about data structures, databases and how code is build.
Yeah, real world problems are what my favorite way to teach particular ways of building things. No one wants to build the 7th calculator.
I was surprised by how fast he was able to type, and despite the fact that it seemed like a terrible/funny idea in the beginning, the end result sounded interesting (if only space wasn't mapped to a single note, so we wouldn't hear it so often). I'm sure that you can't get much faster, but I'd like to see how good one can get after some more practice.
I find that space being always the same note does bring some more musicality actually! It brings structure to the sound instead of sounding like a mess of random notes
I've played around a bit with geometric algebra in the past year, and I have to say that by far the best resource (albeit a bit short) was Ben Lynn's implementation in Haskell [0]. Unfortunately there isn't a well-written source that explains the methods well. There are multiple ways to do things, and I had trouble finding elegant solutions to practical problems.
Why waste time say lot word when few word do trick :)
Also worth pointing out that Alex Wei is himself a gold medalist at IOI.