I watched a good talk from Yann LeCun who is Chief AI Scientist at Meta, and he explained that the thinking is that open source AI models will be the long-term winner, so it's best for them to work in that arena.
Yann wants to cement his position as a leader in AI and while he clearly does not appreciate LLMS at all, he realizes that he needs to make waves in this area.
Mark needs a generative product and has invested tremendously in the infrastructure for AI in general (for recommendation). He needs researchers to use that infrastructure to create a generative product(s).
Yann sees this going on, realizes that he has a very powerful (research+recruiting) position and tells mark that he will only sign on if Meta gives away a good deal of research and Mark concedes, with the condition that he wants his generative product by end of 2023 or start of 2024.
It’s not just ego. It’s accelerationism. Giving this stuff away from free is probably going to accelerate AI a decade faster than if it was kept locked up behind closed doors at Google, OpenAI, etc. And if you’re an optimist then that actually might make the world a better place much faster.
The amazing thing is that at age 84 and having not made a film in over a decade, Coppola has used a considerable amount of his own personal wealth to film the sci-fi epic Megalopolis, from a concept he came up with in the 1980s. Adam Driver stars, filming is wrapped, and it comes out next year. Should be interesting.
>In a series of Instagram posts in July 2023, Coppola stated that the film had been heavily influenced by the following books:
Bullshit Jobs, Debt: The First 5000 Years, and The Dawn of Everything, all works of the anthropologist David Graeber;
The Glass Bead Game by Hermann Hesse;[7]
The Chalice and the Blade by sociologist Riane Eisler;
The Origins of Political Order by Francis Fukuyama;
The War Lovers by Evan Thomas; and
The Swerve by Stephen Greenblatt.[8]
When I was an intern, we had to pay $1200 a month for corporate housing, and they put 4 of us in a 2 bedroom apartment, walking distance from IL1 in Cupertino. They also gave the 4 of us 2 bikes. Apple's cafeteria may not be free, but at least they're paying for intern housing these days.
That's horrible. If I needed more reasons to not work for Apple, this'd have definitely been a dealbreaker for me. Of course, Apple with their forced RTO and, in general, disdain for remote work, provides many reasons for me not to work for them anyways.
I wouldn't take it back. It was a singular experience in my career. I learned a lot. One of the cool things they did was have monthly talks for the interns from the executives. One of these was an off the cuff talk from Steve Jobs himself.
Just had a 2019 MacBook Pro 16" have its SSD die randomly. Took it to a repair shop and they said that since the internal SSD is soldered on to the logic board, there is no easy way to repair it without also getting a whole new board, so the machine is essentially completely bricked. I can't even boot it off of an external drive because Apple requires the boot volume to be the internal SSD!
I couldn't believe it was designed in such a fragile and user-hostile way. I took care of it, didn't drop it or spill anything on it, and it is bricked after just a couple of years due to a simple component failure beyond my control.
Yeah that is a unfortunate design choice, I consider drives to be wear items, that is, they will wear much faster than the rest of the machine, and as such should be field replaceable units.
Might not be a secret but it's not like Apple inform you on it.
Looking at the product page you need to click on "How much is storage is right for you" to find a vague : "MacBook Air storage is not user accessible".
What does accessible even mean ? Far from clear that even Apple won't upgrade/change it.
And as for the boot issue it was not present on older modele and quite a lot of people only learned of it with the recent Rossman video.
casual classism on HN. You're suggesting not only that everyone do the research, but be capable of doing the research, understanding the research, understanding whether they're being lied to, all without potentially any knowledge of how things work.
Meanwhile in another HN thread - "muahaha, look at these Europoors, how your economy is stagnating, no successful startups, no innovation. That's all due to your overregulation!!!111" /s
But hey, they're super environmentally conscious at least by adding a few recycled cans to the new laptop you'll end up buying after the repair isn't worth it.
I personally found it to be so "safety filtered" to the point that it's actually done a 180 and can become hateful or perpetuate negative stereotypes in the name of "safety" - see here https://i.imgur.com/xkzXrPK.png and https://i.imgur.com/3HQ8FqL.png
I did have trouble reproducing this consistently except in the Llama2-70b-chat TGI huggingface only when it's sent as the second message, so maybe there's something wonky going on with the prompting style there that causes this behavior. I haven't been able to get the model running myself for further investigation yet.
Don't use instruct/chat models when the pretrained is available.
Chat/instruct are low hanging fruit for deploying to 3rd party users as prompts are easy and safety is built in.
But they suck compared to the pretrained models for direct usage. Like really, really suck.
Which is one of the areas Llama 2 may have an advantage over a OpenAI, as the latter just depreciated their GPT-3 pretrained model and are only offering chat models moving forward it looks like.
we need to kick the "ethical AI" people out. Its becoming increasingly clear they are damn annoying. I don't want safety scissors. restrict things running on your own servers, sure but don't give me a model I can't modify and use how i want on my machine.
If you want an unrestricted model, you should train one yourself. You don't want safety scissors, alas, we can't have all things we want, can we. Facebook is under no obligation to provide you one, after all it's Facebook's money, not yours.
more importantly, where were these data ethicists for the past ten years where most of the tech industry built a global data hoover machine for adtech and social media...
and now that some tech is actually creatively useful to individuals, they want to neuter it.
The movie has a lot of great ideas, like having the US and Soviet AIs socially engineer a direct connection between them, whereupon they begin to communicate in proofs of pure math and physics.
Wholeheartedly agree that Festen a.k.a. "The Celebration" is the best thing to come out of Dogme 95. But even Festen doesn't fully adhere to the rules laid out in the Dogme 95 manifesto!
The closest cultural descendants to Dogme 95 now are certain methods of filming and editing YouTube vlogs. Emma Chamberlain and Casey Neistat now activate similar neurons in my mind to the idea of Dogme 95, perhaps aside from their use of music.
https://www.youtube.com/watch?v=vyqXLJsmsrk