Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I’m so happy to see that someone has finally built such thing. I’ve been asking for tiered storage in Kafka since 2016 (https://gruchalski.com/posts/2016-05-08-the-case-for-kafka-c...) but this approach is so much better.

Kafka itself could solve this with tiered storage OR, at least, allowing adding volumes at runtime. But neither is possible.

Very cool, have to find some time to take this for a test drive.



Just fyi, tiered storage is coming at some point in Kafka: https://cwiki.apache.org/confluence/plugins/servlet/mobile?c...


It’s been like that for a while.


The Uber devs are working hard at it.


I can't edit the above, but it's actually AirBnB.


(WarpStream co-founder)

Thanks for the kind words! I'll just add that tiered storage is not quite the same thing because it means you still have to manage local disks and replication carefully, however briefly. Please reach out with questions any time!


Indeed. The way I was thinking about it was to implement a different file system for it.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: