Re: Produce request failed

2014-09-04 Thread Ryan Williams
a handling. > > Thanks, > > Jun > > > On Tue, Sep 2, 2014 at 11:26 PM, Ryan Williams > wrote: > > > I have a 3 node kafka cluster running 0.8.1.1, recently updated from > 0.8.1 > > and noticing now that producing from Ruby/Poseidon is having trouble. If > >

Produce request failed

2014-09-02 Thread Ryan Williams
I have a 3 node kafka cluster running 0.8.1.1, recently updated from 0.8.1 and noticing now that producing from Ruby/Poseidon is having trouble. If I'm reading correctly, it appears that the Poseidon is attempting to produce on partition 1 on kafka1, but partition 1 is on kafka1. Does this look l

Re: How to perform a controlled shutdown for rolling bounce?

2014-08-14 Thread Ryan Williams
trolled shutdown and do a regular shutdown (SIGTERM) in which case > the partition will remain unavailable while the broker is down. > > > Joel > > On Thu, Aug 14, 2014 at 11:10:14AM -0700, Ryan Williams wrote: > > Running 0.8.1 and am unable to do a controlled shutdown as

How to perform a controlled shutdown for rolling bounce?

2014-08-14 Thread Ryan Williams
Running 0.8.1 and am unable to do a controlled shutdown as part of a rolling bounce. Is this the primary reference for this task? https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-1.ControlledShutdown I've set the config to enable controlled shutdown. controll

Re: LeaderNotAvailableException

2014-08-13 Thread Ryan Williams
s know how 0.8.1.1 goes. > > Thanks, > Neha > > > On Tue, Aug 12, 2014 at 10:12 AM, Ryan Williams > wrote: > > > Using version 0.8.1. > > > > Looking to update to 0.8.1.1 now probably. > > > > > > On Tue, Aug 12, 2014 at 9:25 AM, Guozhang

Re: LeaderNotAvailableException

2014-08-12 Thread Ryan Williams
rg/jira/browse/KAFKA-1393>, which Kafka version > are > you using? > > Guozhang > > > On Mon, Aug 11, 2014 at 10:37 PM, Ryan Williams > wrote: > > > Thanks for the heads up on attachments, here's a gist: > > > > > > > https://gist.githubu

Re: LeaderNotAvailableException

2014-08-11 Thread Ryan Williams
roker failure" before > the offline leader selection process. > > Guozhang > > > > > On Mon, Aug 11, 2014 at 5:08 PM, Ryan Williams > wrote: > > > The broker appears to be running > > > > $ telnet kafka-server 9092 > > Trying... > > Con

Re: LeaderNotAvailableException

2014-08-11 Thread Ryan Williams
hments, so you might have to send a pastebin or something. > > Thanks, > Neha > > > On Mon, Aug 11, 2014 at 5:08 PM, Ryan Williams > wrote: > > > The broker appears to be running > > > > $ telnet kafka-server 9092 > > Trying... > > Connected to kaf

Re: LeaderNotAvailableException

2014-08-11 Thread Ryan Williams
! On Mon, Aug 11, 2014 at 4:30 PM, Guozhang Wang wrote: > Hi Ryan, > > Could you check if all of your brokers are still live and running? Also > could you check the server log in addition to the producer / state-change / > controller logs? > > Guozhang > > &

LeaderNotAvailableException

2014-08-11 Thread Ryan Williams
I have a single broker test Kafka instance that was running fine on Friday (basically out of the box configuration with 2 partitions), now I come back on Monday and producers are unable to send messages. What else can i look at to debug, and prevent? I know how to recover by removing data directo

Recovering from consumer failure

2014-06-13 Thread Ryan Williams
I have a consumer program that encountered an error when handling a message and crashed. It does manual commits, and since it failed, it keeps failing now because it gets the same bad message. I ran the ExportZkOffsets and ImportZkOffsets tools successfully to advance the offset before when this ha

Re: Unclean kafka shutdown

2014-06-04 Thread Ryan Williams
I will check next time I see it. On Wed, Jun 4, 2014 at 10:37 AM, Mingtao Zhang wrote: > Just curious about, whether the memory allocated is released or not. > > Mingtao Sent from iPhone > > > On Jun 4, 2014, at 1:31 PM, Ryan Williams wrote: > > > > I've not

Unclean kafka shutdown

2014-06-04 Thread Ryan Williams
INFO [Replica Manager on Broker 0]: Shutted down completely (kafka.server.ReplicaManager) Thanks, Ryan Williams

Get a list of consumer groups (for ConsumerOffsetChecker)

2014-05-29 Thread Ryan Williams
I'm doing some initial exploration of kafka and the system tools. With the console producer and consumers running, I'd like to run the ConsumerOffsetChecker, but it requires a group parameter. I don't know what to put there. Is there a tool I can run to get a list of consumer groups? I see a hint