Hacker Newsnew | past | comments | ask | show | jobs | submit | stellaathena's commentslogin

Nope :(



RWKV had a paper accepted at EMNLP and released models which match the performance of equivalent transformers.

What else are you looking for?


I'm quite busy right now, but maybe in late September or October?


Instead of flaming about "open source" vs "free software" why don't we talk about how whichever terminology you prefer, organizations like EleutherAI, Hugging Face, and LAION (the AI orgs on this letter) release software that is licensed in a way you approve of.


No, it's about how the regulations governing OpenAI and Google's commercial models, research by non-profits like EleutherAI and AI2, and finetunes of public models done by hobbyists should not be the same. The current law puts all three groups in the same bucket.


They’re expensive for you, a random person on the internet, but 5-10M USD is really not prohibitively expensive for a government or large company.


It seems that the user is posting ChatGPT-generated text and not a real summary. It's complete nonsense, with about half of the sentences containing a factual error.


Twitter thread announcing the paper with some additional color commentary: https://twitter.com/AiEleuther/status/1660811179239849986


Our discord servers (a primary one, a spin-off for RWKV, another spinoff for BioML, etc) have tens of thousands of people between them :) So not quite everyone. But this was a community effort with a public call for contributions


Are you the Stella from the Acknowledgements section? Are you in one of those spinoffs like BioML, or you aren't on the author list because you have some conflict with your work where you can't legally do something because of intellectual property laws or license things or NDA? Also when you talk about 'our discord servers' which ones do you mean? Is it ones run by Eleuther?


Yes I am (apparently) in the acknowledgments. I was not an author on the paper because I didn’t have time to contribute too much. I also try to err on the side of not being added to papers, as my position (I run EleutherAI) tends to encourage people to be overgenerous with offers. I anticipate having more time this coming month and being on the version that’s submitted for peer review, but we’ll see.

BlinkDL has been working on this project for two-ish years, originally in the EleutherAI discord and then created his own to house the project.

I wasn’t thinking too hard about my exact wording, but yes I was thinking of EleutherAI and its various spin-off servers. EleutherAI doesn’t /run/ any of the other servers, but we all have a close collaborative relationship. I’m sure there’s a lot of duplication of membership (e.g., I’m in all of them) but quickly adding up the membership of each server comes out to around 70,000. EleutherAI and LAION are the largest at 25k each, with the others typically having around 5k each. I would expect at least 30k of those users to be unique though.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: