Hi,
This might also be of interest: http://www.confluent
.io/blog/how-to-choose-the-number-of-topicspartitions-in-a-kafka-cluster/
Cheers,
Jens
On Monday, August 8, 2016, Daniel Fagnan wrote:
> Thanks Tom! This was very helpful and I’ll explore having a more static
> set of partitions as that
Thanks Tom! This was very helpful and I’ll explore having a more static set of
partitions as that seems to fit Kafka a lot better.
Cheers,
Daniel
> On Aug 8, 2016, at 12:27 PM, Tom Crayford wrote:
>
> Hi Daniel,
>
> Kafka doesn't provide this kind of isolation or scalability for many many
> s
Hi Daniel,
Kafka doesn't provide this kind of isolation or scalability for many many
streams. The usual design is to use a consistent hash of some "key" to
attribute your data to a particular partition. That of course, doesn't
isolate things fully, but has everything in a partition dependent on ea
Hey all,
I’m currently in the process of designing a system around Kafka and I’m
wondering the recommended way to manage topics. Each event stream we have needs
to be isolated from each other. A failure from one should not affect another
event stream from processing (by failure, we mean a downs
