consumer property - zookeeper.sync.time.ms

2015-07-23 Thread Kris K
Hi, Can someone please throw some light on the consumer property zookeeper.sync.time.ms? What are the implications of decreasing it to lower than 2 secs ? I read the description from documentation but could not understand it completely. Thanks, Kris

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread David Montgomery
Thanks Now I get the below error I am on ubuntu 14.04. sudo add-apt-repository ppa:cwchien/gradle sudo apt-get update sudo apt-get install --upgrade gradle git clone https://github.com/apache/kafka.git cd kafka git checkout -b 0.8.2.1 gradle --debug 04:32:54.478 [DEBUG]

Re: ZK chroot path would be automatically created since Kafka 0.8.2.0?

2015-07-23 Thread yewton
Hi Gwen, I've created the ticket: https://issues.apache.org/jira/browse/KAFKA-2357 Thanks for your reply. On 2015/07/22 16:37, Gwen Shapira wrote: You are right, this sounds like a doc bug. Do you mind filing a JIRA ticket (http://issues.apache.org/jira/browse/KAFKA) so we can keep track of

Disaster Recovery

2015-07-23 Thread Luke Kysow
Hello All, would very much appreciate your thoughts and experiences on backup, restore, and disaster recovery. In the confluent.io docs ( http://docs.confluent.io/1.0/kafka/post-deployment.html under Backup Restoration) it says the best way to backup your cluster is to set up a mirror. 1. Given

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread Ewen Cheslack-Postava
I think you're just having connectivity issues with Maven Central. I just ran your exact set of commands in a VM and the final gradle command (without --debug) ran fine and you can see it downloaded the file you had trouble with (

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread Ewen Cheslack-Postava
Also, the branch you're checking out is very old. If you want the most recent release, that's tagged as 0.8.2.1. Otherwise, you'll want to use the trunk branch. -Ewen On Thu, Jul 23, 2015 at 11:45 AM, Gwen Shapira gshap...@cloudera.com wrote: Sorry, we don't actually do SBT builds anymore.

wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread David Montgomery
Just wondering I am getting this very disapointing error with kafka install. git clone https://git-wip-us.apache.org/repos/asf/kafka.git cd kafka git checkout -b 0.8 remotes/origin/0.8 ./sbt ++2.9.2 update Thanks [warn]

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread Gwen Shapira
Sorry, we don't actually do SBT builds anymore. You can build successfully using Gradle: You need to have [gradle](http://www.gradle.org/installation) installed. ### First bootstrap and download the wrapper ### cd kafka_source_dir gradle Now everything else will work ### Building a

Re: New consumer - poll/seek javadoc confusing, need clarification

2015-07-23 Thread Jason Gustafson
Hey Stevo, Thanks for the early testing on the new consumer! This might be a bug. I wonder if it could also be explained by partition rebalancing. In the current implementation, a rebalance will clear the old positions (including those that were seeked to). I think it's debatable whether this

Re: New consumer - poll/seek javadoc confusing, need clarification

2015-07-23 Thread Stevo Slavić
Thanks Ewen for heads up. It's great that seek is not needed in between poll when business goes as usual. In edge case, when my logic detects it needs to go back and reread events from given position in history, I use seek. I found out that next poll after seek will not respect offset used in

Re: New consumer - poll/seek javadoc confusing, need clarification

2015-07-23 Thread Stevo Slavić
Strange, if after seek I make several poll requests, eventually it will read/return messages from offset that seek set. On Thu, Jul 23, 2015 at 11:03 AM, Stevo Slavić ssla...@gmail.com wrote: Thanks Ewen for heads up. It's great that seek is not needed in between poll when business goes as