Re: Invalid KafkaStreams as a result of Decoder problems

2012-11-13 Thread Neha Narkhede
I meant the former. Thanks, Neha On Tue, Nov 13, 2012 at 10:03 AM, Jason Rosenberg wrote: > Neha, > > If I understand correctly, are you saying that it should be possible to > re-create KafkaStreams, without having to create a new ConsumerConnector? > > Or are you saying that we should never get

Re: Invalid KafkaStreams as a result of Decoder problems

2012-11-13 Thread Jason Rosenberg
Neha, If I understand correctly, are you saying that it should be possible to re-create KafkaStreams, without having to create a new ConsumerConnector? Or are you saying that we should never get an exception when iterating over a KafkaStream (e.g. the underlying implementation should just either

Re: Invalid KafkaStreams as a result of Decoder problems

2012-11-13 Thread Neha Narkhede
Bob/Jason, This is a bug. Ideally, we should allow restarting the consumer streams when they encounter an error. Can you file a JIRA ? Thanks, Neha On Mon, Nov 12, 2012 at 6:31 AM, Bob Cotton wrote: > Handling the exceptions in the Decoder is not a problem. > > It was just a larger question abo

Re: Invalid KafkaStreams as a result of Decoder problems

2012-11-12 Thread Bob Cotton
Handling the exceptions in the Decoder is not a problem. It was just a larger question about what to do in the event the stream gets into a failed state. Thanks - Bob On Sun, Nov 11, 2012 at 11:01 PM, Jun Rao wrote: > Currently, the code in Kafka doesn't expect the decoder to throw > exceptio

Re: Invalid KafkaStreams as a result of Decoder problems

2012-11-11 Thread Jun Rao
Currently, the code in Kafka doesn't expect the decoder to throw exceptions. Could you write your decoder to return null on exceptions? Thanks, Jun On Fri, Nov 9, 2012 at 8:17 AM, Bob Cotton wrote: > During the implementation of a custom Encoder/Decoder we noticed that > should the Decoder thr

Re: Invalid KafkaStreams as a result of Decoder problems

2012-11-09 Thread Bob Cotton
Here's the post I saw: http://mail-archives.apache.org/mod_mbox/incubator-kafka-users/201201.mbox/%3CCAOG_4QbzXPJujmOjLuiHOspLfCkA+-gQP2CkN+J-zyg=kn7...@mail.gmail.com%3E On Fri, Nov 9, 2012 at 10:22 AM, Jason Rosenberg wrote: > Wow, this seems a bit restrictive. Can you point me to the discus

Re: Invalid KafkaStreams as a result of Decoder problems

2012-11-09 Thread Jason Rosenberg
Wow, this seems a bit restrictive. Can you point me to the discussion on this? What exactly is an "invalid stream", how can you test for this? Jason On Fri, Nov 9, 2012 at 8:17 AM, Bob Cotton wrote: > During the implementation of a custom Encoder/Decoder we noticed that > should the Decoder t