I am not against tinygrad or anything, but I can't find any projects using it as a backend. And I can't find benchmarks for, say, the stable diffusion or llama demos.
But I am frustrated that it seems to be attracting lots of attention on social media, while other ML frameworks/projects targeting wide hardware support, and already being used as backends in places, are flying under the radar.
And Hotz's very brief spat with AMD that I saw on his YouTube channel also raised my eyebrows.
What was his spat with AMD about? I think he complained about AMD's drivers being shit on the Lex Fridman podcast but that's not eye brow raising right?
Because of unfixed rocm bugs, Hotz stated that Tinygrad was going to abandon AMD support on GitHub, and was very upset about it in the following YouTube video.
This is when Lisa Su apparently stepped in and patched things up.
Just curious, have you tried adding a feature to TinyGrad? Or are you arguing in the abstract because TinyGrad is small?
Because I personally have tried, and found the code to be so code-golf and spaghetti-like that I gave up, it just wasn’t worth my time (even for the $1000 bounty).
I did small changes, took part of the Twitch sessions and thinking and understanding it. I contributed the main ideas for Kernel search, and was happy to get George out of a mini depression with some quick fun wins. He almost gave it up, but now the progress every day is crazy.
The way to implement anything new and cool is to read it all first.
I love the way convolutions and matmuls are both expressed using ShapeTracker and simple mul operation for example. No other framework has that elegance.
Until you understand that part, it's not worth trying to change it.
...No.
I am not against tinygrad or anything, but I can't find any projects using it as a backend. And I can't find benchmarks for, say, the stable diffusion or llama demos.
But I am frustrated that it seems to be attracting lots of attention on social media, while other ML frameworks/projects targeting wide hardware support, and already being used as backends in places, are flying under the radar.
And Hotz's very brief spat with AMD that I saw on his YouTube channel also raised my eyebrows.