Kafka message queue during broker failure

2015-07-22 Thread Jeff Gong
hi all, currently working with a team that is interested in replacing scribe with kafka. currently in scribe's model it is my understanding that when there is a network failure scribe will attempt to persist messages by queueing them and resending the queued messages when those issues are

resources for simple consumer?

2015-07-15 Thread Jeff Gong
hey all, typically i've only ever had to use the high level consumer for my personal needs when handling data. recently, however, I have found the need to be more selective and careful with managing offsets and want the extended capability to do so. i know that there is a bit of documentation on

Re: Launch Kafka/Zookeeper servers without using command line

2015-07-10 Thread Jeff Gong
PM, Jeff Gong j.gon...@gmail.com wrote: Hey Gwen, Thanks for your response. The example was very helpful and exactly what I was looking for! I went ahead and used that as an example and while most things are working as I wanted, there are a few issues I'd like to follow up on: 1. If I

Re: Launch Kafka/Zookeeper servers without using command line

2015-07-09 Thread Jeff Gong
. Any ideas why this might be occuring? Best, Jeff On Tue, Jul 7, 2015 at 10:43 AM, Jeff Gong j.gon...@gmail.com wrote: Hi all, Is it possible to launch Kafka/Zookeeper servers via some part of the API? I noticed in this: http://stackoverflow.com/questions/16946778/how-can-we-create-a-topic

Launch Kafka/Zookeeper servers without using command line

2015-07-07 Thread Jeff Gong
Hi all, Is it possible to launch Kafka/Zookeeper servers via some part of the API? I noticed in this: http://stackoverflow.com/questions/16946778/how-can-we-create-a-topic-in-kafka-from-the-ide-using-api/ that it seems to be possible to create a ZK instance and add a topic to it, but is this the