pache.org>"
<users@apex.apache.org<mailto:users@apex.apache.org>>
Subject: Re: kafka input is processing records in a jumbled order
Raja,
Great discussion, just a couple more thoughts.
1. Add this operator to your DAG just before the operator which expects the
tuples to be in
gt;
Date: Thursday, June 9, 2016 at 1:49 PM
To: "users@apex.apache.org<mailto:users@apex.apache.org>"
<users@apex.apache.org<mailto:users@apex.apache.org>>
Subject: Re: kafka input is processing records in a jumbled order
There is no need for an extra thread. In f
apex.apache.org>>
Date: Thursday, June 9, 2016 at 10:51 AM
To: "users@apex.apache.org<mailto:users@apex.apache.org>"
<users@apex.apache.org<mailto:users@apex.apache.org>>
Subject: Re: kafka input is processing records in a jumbled order
Apex can do sta
; Regards,
> Raja
>
> From: Thomas Weise <thomas.we...@gmail.com>
> Reply-To: "users@apex.apache.org" <users@apex.apache.org>
> Date: Tuesday, June 7, 2016 at 10:59 PM
>
> To: "users@apex.apache.org" <users@apex.apache.org>
> Subj
ot;
<users@apex.apache.org<mailto:users@apex.apache.org>>
Subject: Re: kafka input is processing records in a jumbled order
Hi Raja,
When you apply ONE_TO_MANY partitioning scheme, one instance of the operator
consumes from many partitions of a kafka topic.
When you look at th
une 7, 2016 at 5:52 PM
> To: "users@apex.apache.org" <users@apex.apache.org>
> Subject: Re: kafka input is processing records in a jumbled order
>
> Raja,
>
> Are you expecting ordering across multiple Kafka partitions?
>
> All messages from a g
rs@apex.apache.org<mailto:users@apex.apache.org>>
Date: Tuesday, June 7, 2016 at 5:52 PM
To: "users@apex.apache.org<mailto:users@apex.apache.org>"
<users@apex.apache.org<mailto:users@apex.apache.org>>
Subject: Re: kafka input is processing records in a jumbled order
Raja,
Are you expecting ordering across multiple Kafka partitions?
All messages from a given Kafka partition are received by the same consumer
and thus will be ordered. However, when messages come from multiple
partitions there is no such guarantee.
Thomas
On Tue, Jun 7, 2016 at 3:34 PM,
Hi
I have built a DAG, that reads from kafka and in the next operators, does
lookup to a hbase table and update hbase table based on some business logic.
Some times my operator which does hbase lookup and update in the same
operator(Custom written), is processing the records it receives from
