Broker brought down and under replicated partitions

2014-10-14 Thread Jean-Pascal Billaud
hey folks, I have been testing a kafka cluster of 10 nodes on AWS using version 2.8.0-0.8.0 and see some behavior on failover that I want to make sure I understand. Initially, I have a topic X with 30 partitions and a replication factor of 3. Looking at the partition 0: partition: 0 - leader: 5

Re: Broker brought down and under replicated partitions

2014-10-14 Thread Jean-Pascal Billaud
at 9:27 AM, Jean-Pascal Billaud j...@tellapart.com wrote: hey folks, I have been testing a kafka cluster of 10 nodes on AWS using version 2.8.0-0.8.0 and see some behavior on failover that I want to make sure I understand. Initially, I have a topic X with 30 partitions

Re: Broker brought down and under replicated partitions

2014-10-15 Thread Jean-Pascal Billaud
... but that seemed to make the problem go away. Thanks, On Wed, Oct 15, 2014 at 6:46 AM, Neha Narkhede neha.narkh...@gmail.com wrote: Which version of Kafka are you using? The current stable one is 0.8.1.1 On Tue, Oct 14, 2014 at 5:51 PM, Jean-Pascal Billaud j...@tellapart.com wrote: Hey Neha

Re: Broker brought down and under replicated partitions

2014-10-16 Thread Jean-Pascal Billaud
this would happen. Is there a known issue in the 0.8.0 version that was fixed later on? What can I do to diagnose/fix the situation? Thanks, On Wed, Oct 15, 2014 at 9:58 AM, Jean-Pascal Billaud j...@tellapart.com wrote: So I am using 0.8.0. I think I found the issue actually. It turns out that some

Re: Task not serializable

2015-04-20 Thread Jean-Pascal Billaud
I meant to reach spark users... sorry about the noise. On Mon, Apr 20, 2015 at 8:44 AM, Jean-Pascal Billaud j...@tellapart.com wrote: Hi, I am getting this serialization exception and I am not too sure what Graph is unexpectedly null when DStream is being serialized means? 15/04/20 06:12

Task not serializable

2015-04-20 Thread Jean-Pascal Billaud
Hi, I am getting this serialization exception and I am not too sure what Graph is unexpectedly null when DStream is being serialized means? 15/04/20 06:12:38 INFO yarn.ApplicationMaster: Final app status: FAILED, exitCode: 15, (reason: User class threw exception: Task not serializable) Exception