Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Using Kafka as a work queue is widely documented as a mistake

Could not find any good sources on this. Can you please provide any references?



This is a proposal to extend Kafka to (better) handle queueing use cases: https://cwiki.apache.org/confluence/display/KAFKA/KIP-932%3A...

"For example, a queue is perfect for a situation in which messages are independent work items that can be processed concurrently by a pool of applications, and individually retried or acknowledged as processing completes. This is much easier to achieve using a queue rather than a partitioned topic with a consumer group."


don’t have any off the top of my head sorry, I could be making it up but I’m pretty sure I remember reading that from several sources. Iirc it has to do with the fact that there isn’t really single message acknowledging?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: