Re: New Idea for Kafka multiple consumers running parallel.

2016-10-04 Thread Ali Akhtar
You may be able to control the starting offset,  but if you try to control
which instance gets offset 4.. you'll lose all benefits of parallelism.

On 4 Oct 2016 3:02 pm, "Kaushil Rambhia/ MUM/CORP/ ENGINEERING" <
kaushi...@pepperfry.com> wrote:

> Hi guys,
> i am using apache kafka with phprd kafka, i want to know how can i use
> multiple Kafka consumers on same partition from different groups to consume
> message parallel, say if consumer are c1,c2,c3 consuming single partition
> 0,
> than if c1 is consuming from 0 offset than c2 should start from 1 and c3
> from 2 and if any new consumer comes up it should start from latest offset
> which is yet to be consumed by any consumer.
>
> --
> Regards,
> Kaushil Rambhia
>
> --
>
>
>
> DISCLAIMER: The contents of this message may be legally privileged and
> confidential and are for the use of the intended recipient(s) only. It
> should not be read, copied and used by anyone other than the intended
> recipient(s). If you have received this message in error, please
> immediately notify the sender, preserve its confidentiality and delete it.
> Before opening any attachments please check them for viruses and defects.
>


New Idea for Kafka multiple consumers running parallel.

2016-10-04 Thread Kaushil Rambhia/ MUM/CORP/ ENGINEERING
Hi guys,
i am using apache kafka with phprd kafka, i want to know how can i use
multiple Kafka consumers on same partition from different groups to consume
message parallel, say if consumer are c1,c2,c3 consuming single partition
0,
than if c1 is consuming from 0 offset than c2 should start from 1 and c3
from 2 and if any new consumer comes up it should start from latest offset
which is yet to be consumed by any consumer.

-- 
Regards,
Kaushil Rambhia

-- 



DISCLAIMER: The contents of this message may be legally privileged and 
confidential and are for the use of the intended recipient(s) only. It 
should not be read, copied and used by anyone other than the intended 
recipient(s). If you have received this message in error, please 
immediately notify the sender, preserve its confidentiality and delete it. 
Before opening any attachments please check them for viruses and defects.