Re: consumer read from specific partition

You can see an example of using the SimpleConsumer here https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example Any suggestions on where in the code to modify the high level producer to support reading from specific partitions ? Thanks, Josh . On Thu, Aug 14, 2014 at

Re: consumer read from specific partition

On Mon, Aug 18, 2014 at 7:27 PM, Josh J joshjd...@gmail.com wrote: You can see an example of using the SimpleConsumer here https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example Any suggestions on where in the code to modify the high level producer to support

Re: consumer read from specific partition

Is it possible to modify and use the high level consumer so that I can ignore processing certain partitions? On Mon, Aug 18, 2014 at 5:07 PM, Sharninder sharnin...@gmail.com wrote: On Mon, Aug 18, 2014 at 7:27 PM, Josh J joshjd...@gmail.com wrote: You can see an example of using the

Re: consumer read from specific partition

One tactic that might be worth exploring is to rely on the message key to facilitate this. It would require engineering careful functions for the key which hashes to the partitions for your topic(s). It would also mean that your consumers for the topic would be evaluating the key and

Re: consumer read from specific partition

One tactic that might be worth exploring is to rely on the message key to facilitate this. It would require engineering careful functions for the key which hashes to the partitions for your topic(s). It would also mean that your consumers for the topic would be evaluating the key and discarding

consumer read from specific partition

Hi, Suppose I have N partitions. I would like to have X different consumer threads ( X N) read from a specified set of partitions. How can I achieve this? Thanks, Josh

Re: consumer read from specific partition

Implement the low level Simple Consumer. -- Sharninder On Thu, Aug 14, 2014 at 2:16 PM, Josh J joshjd...@gmail.com wrote: Hi, Suppose I have N partitions. I would like to have X different consumer threads ( X N) read from a specified set of partitions. How can I achieve this? Thanks,

Re: consumer read from specific partition

You can see an example of using the SimpleConsumer here https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example . On Thu, Aug 14, 2014 at 3:23 AM, Sharninder sharnin...@gmail.com wrote: Implement the low level Simple Consumer. -- Sharninder On Thu, Aug 14, 2014