Re: mirror maker wiki

2012-12-06 Thread Joel Koshy
Good point - fixed. On Wed, Dec 5, 2012 at 9:22 PM, Jay Kreps jay.kr...@gmail.com wrote: Hey your wiki on mirror maker is very good. It doesn't actually say how to run it, though, does it? -Jay

Re: can't commit to Kafka svn

2012-12-13 Thread Joel Koshy
[0955][jkoshy@jkoshy-ld:~/kafka]$ git branch -r origin/0.7 origin/0.7.0 origin/0.7.1 origin/0.7.2 origin/0.8 origin/HEAD - origin/trunk origin/consumer_redesign origin/legacy_client_libraries origin/trunk On Thu, Dec 13, 2012 at 9:49 AM, Jun Rao jun...@gmail.com wrote:

Re: C/C++ Client

2013-04-02 Thread Joel Koshy
Yes - we would be interested in doing that. I have been spending most of my time over the past couple weeks on the C++ library (currently, only for the producer). It is reasonably stable, although it has not been tried and tested in production. I can start with publishing a wiki describing the

Re: [VOTE] Apache Kafka 0.8.0-beta1 candidate 2

2013-06-21 Thread Joel Koshy
+1 Thanks Joe! On Thu, Jun 20, 2013 at 8:25 AM, Jun Rao jun...@gmail.com wrote: +1. Verified both unit tests and quick start. Thanks, Jun On Wed, Jun 19, 2013 at 9:28 PM, Joe Stein crypt...@gmail.com wrote: This is the second release candidate vote for the Apache Kafka 0.8.0-beta1

Re: criteria for fixes on 0.8 beta

2013-07-02 Thread Joel Koshy
Good question. Some fixes are clearly critical (e.g., consumer deadlocks) that would impact everyone and need to go into 0.8. Unfortunately the criticality of most other fixes is subjective and I'm not sure how feasible it is to develop a global criteria. It probably needs to be determined through

Re: having problem with 0.8 gzip compression

2013-07-10 Thread Joel Koshy
Weird - I tried your exact code and it worked for me (although I was using 0.8 head and not the beta). Can you re-run with trace logs enabled in your producer and paste that output? Broker logs also if you can? Thanks, Joel On Wed, Jul 10, 2013 at 10:23 AM, Scott Wang

Re: [VOTE] Logo runoff vote

2013-08-01 Thread Joel Koshy
+1 296 (changing my vote from the one in the jira) On Wed, Jul 31, 2013 at 10:00 PM, Jun Rao jun...@gmail.com wrote: +1 for 296 Thanks, Jun On Wed, Jul 31, 2013 at 1:34 PM, Jay Kreps jay.kr...@gmail.com wrote: Okay folks we did a survey on the JIRA (KAFKA-982) and it was more or less a

Re: Segment recovery and replication

2013-09-06 Thread Joel Koshy
IIUC it is a pseudo-automation in that you set up the retry interval for controlled shutdown (controlled.shutdown.retry.backoff.ms) and the number of retries (controlled.shutdown.max.retries) high enough so that during a rolling bounce, the likelihood of a controlled shutdown being unsuccessful is

Re: Review Request 14041: MetadataResponse during Consumer's Rebalance Process maybe Stale

2013-09-10 Thread Joel Koshy
to implement selective rebalance - that way the overhead of going to ZK for partition information (for the affected topics alone) should be acceptable. It will also give us the added benefit of reducing the overall time for rebalance on a topic event. - Joel Koshy On Sept. 10, 2013, 6:29 p.m., Guozhang

Re: [VOTE] Bylaws!

2013-09-13 Thread Joel Koshy
+1 binding On Fri, Sep 13, 2013 at 10:00 AM, Joe Stein crypt...@gmail.com wrote: +1 binding /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop

Re: Random Partitioning Issue

2013-09-17 Thread Joel Koshy
://www.stealth.ly Twitter: @allthingshadoop / On Sep 14, 2013, at 8:17 AM, Joel Koshy jjkosh...@gmail.com wrote: Thanks for bringing this up - it is definitely an important point to discuss. The underlying issue of KAFKA-1017

Review Request 14184: Draft patch for KAFKA-1049

2013-09-17 Thread joel koshy
020e73c72a310e874ba07cf0691517a61c1fc35f core/src/main/scala/kafka/utils/Utils.scala e0a5a27c72abf3560f68fc6c2dbfc67d90cc5cd9 core/src/main/scala/kafka/utils/VerifiableProperties.scala d694ba98522a0aa2fc9cac84ebcfc4bd51505300 Diff: https://reviews.apache.org/r/14184/diff/ Testing --- Thanks, joel

Review Request 14188: Draft patch for KAFKA-1049

2013-09-17 Thread joel koshy
020e73c72a310e874ba07cf0691517a61c1fc35f core/src/main/scala/kafka/utils/Utils.scala e0a5a27c72abf3560f68fc6c2dbfc67d90cc5cd9 core/src/main/scala/kafka/utils/VerifiableProperties.scala d694ba98522a0aa2fc9cac84ebcfc4bd51505300 Diff: https://reviews.apache.org/r/14188/diff/ Testing --- Thanks, joel

Re: Review Request 14188: Draft patch for KAFKA-1049

2013-09-17 Thread joel koshy
core/src/main/scala/kafka/utils/Utils.scala https://reviews.apache.org/r/14188/#comment51186 The following getConstructor call fails in this diff - e.g., try running AsyncProducerTest. - joel koshy On Sept. 17, 2013, 11:52 p.m., joel koshy wrote

Re: zkclient dies after UnknownHostException in zk reconnect

2013-09-24 Thread Joel Koshy
node loss. Did the Kafka consumer not respond to rebalance events or did the server not respond to state change events ? Also, ephemeral nodes are lost only when sessions are expired on the zookeeper server or if clients close the session actively, how does losing connection lead to ephemeral

Re: Review Request 14638: Patch for KAFKA-1086

2013-10-15 Thread Joel Koshy
this with InetAddress.getLocalHost.getHostName core/src/main/scala/kafka/tools/GetOffsetShell.scala https://reviews.apache.org/r/14638/#comment52658 Should this be partitionList.split(,)... - Joel Koshy On Oct. 14, 2013, 10:50 p.m., Neha Narkhede wrote

Re: Review Request 14638: Patch for KAFKA-1086

2013-10-15 Thread Joel Koshy
On Oct. 15, 2013, 8:03 p.m., Joel Koshy wrote: core/src/main/scala/kafka/tools/GetOffsetShell.scala, line 71 https://reviews.apache.org/r/14638/diff/1/?file=364653#file364653line71 Nice use of clientId. We should do this in every tool. I would suggest we also prepend

Re: Review Request 14675: Patch for KAFKA-1090

2013-10-16 Thread joel koshy
https://reviews.apache.org/r/14675/#comment52743 Should probably wrap this with an Assert.assertTrue(...) - joel koshy On Oct. 16, 2013, 5 p.m., Jun Rao wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
for configsToBeDeleted right? - i.e., validation could fail for deleted configs which have no associated value. - joel koshy On Nov. 7, 2013, 6:17 p.m., Neha Narkhede wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
://reviews.apache.org/r/15274/#comment55226 Also, if we are adding the deleteConfig option we need not use the same regex and split. i.e., we expect only one argument. - joel koshy On Nov. 7, 2013, 6:17 p.m., Neha Narkhede wrote

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 2

2013-11-07 Thread Joel Koshy
Joe, thanks for doing this. Couple of questions before I can vote because I'm not sure if any of these would block voting: From below: http://svn.apache.org/repos/asf/incubator/kafka/trunk/KEYS in addition to This link is out of date - should be http://svn.apache.org/repos/asf/kafka/KEYS In

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
On Nov. 7, 2013, 6:31 p.m., joel koshy wrote: core/src/main/scala/kafka/admin/TopicCommand.scala, line 153 https://reviews.apache.org/r/15274/diff/4/?file=380482#file380482line153 Also, if we are adding the deleteConfig option we need not use the same regex and split. i.e., we

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
On Nov. 7, 2013, 6:29 p.m., joel koshy wrote: core/src/main/scala/kafka/admin/AdminUtils.scala, line 224 https://reviews.apache.org/r/15274/diff/4/?file=380481#file380481line224 Not sure if this is required any more if we're doing validation earlier - since a validation failure

Re: Review Request 15274: Patch for KAFKA-1119

2013-11-07 Thread joel koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15274/#review28481 --- Ship it! - joel koshy On Nov. 8, 2013, 1:07 a.m., Neha Narkhede

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 3

2013-11-08 Thread Joel Koshy
+1 Thanks Joe. The following are very minor issues that I think don't matter at all, but we can keep in mind for future releases: - won't fix issues still show up in the release notes (the go client jiras for e.g.,) - In

Re: Review Request 15201: address more review comments

2013-11-12 Thread Joel Koshy
and the isTopicAllowed API that it provides? - Joel Koshy On Nov. 12, 2013, 4:34 p.m., Jun Rao wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15201

Re: [DISCUSSION] 0.8.0 release

2013-11-13 Thread Joel Koshy
Based on http://www.apache.org/dev/release.html#distribute-other-artifacts it seems we should close KAFKA-1133 before releasing. quote For example, the Java artifact format is based on a compressed directory structure and those projects wishing to distribute jars must place LICENSE and NOTICE

Re: Auto create chroot on server start up?

2013-11-13 Thread Joel Koshy
Marek was referring to the zookeeper namespace - Marek, there are jira(s) https://issues.apache.org/jira/browse/KAFKA-294 https://issues.apache.org/jira/browse/KAFKA-404 Should be straightforward to finish that up - want to give that a go? Thanks, Joel On Thu, Nov 14, 2013 at 03:48:01AM +0400,

Re: Review Request 15659: Patch for KAFKA-1103

2013-11-19 Thread Joel Koshy
/15659/#comment56263 Typo in message; however, I think we can just drop the entire else block. - Joel Koshy On Nov. 18, 2013, 11:30 p.m., Guozhang Wang wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: Review Request 15711: Patch for KAFKA-930

2013-11-20 Thread Joel Koshy
into onPreferredReplicaElection (although if this feature is turned on you wouldn't need to use the command-line tool anyway). - Joel Koshy On Nov. 20, 2013, 1:38 a.m., Sriram Subramanian wrote: --- This is an automatically generated e-mail. To reply, visit

Re: Review Request 15659: Incorporate Joel/Jun's comments, MM system test passed

2013-11-20 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15659/#review29205 --- Ship it! Looks good. - Joel Koshy On Nov. 20, 2013, 8:59 p.m

Re: Review Request 15744: Patch for KAFKA-1133

2013-11-20 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15744/#review29206 --- Ship it! - Joel Koshy On Nov. 21, 2013, midnight, Joe Stein

Re: Changed ordering guarantee with multiple in-flight messages

2013-11-21 Thread Joel Koshy
I can elaborate further on the wiki tomorrow. The term in-flight in my edit is a bit incomplete. It refers to what's in-flight on the broker-side for actual handling - that is what provides the ordering guarantee. The client can continue to write requests to the socket even while the broker is

Review Request 15793: Patch for KAFKA-1142

2013-11-22 Thread joel koshy
/browse/KAFKA-1142 Repository: kafka Description --- Take diff from last divergent point Diffs - kafka-patch-review.py 7fa6cb5165d0d497ec3004dc2c98b60fb8d0436d Diff: https://reviews.apache.org/r/15793/diff/ Testing --- Thanks, joel koshy

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 4

2013-11-26 Thread Joel Koshy
I'm getting this with console consumer in the binary package which seems to be because it was built under Java 7. Can we stick to 6? Exception in thread main java.lang.UnsupportedClassVersionError: kafka/javaapi/consumer/ConsumerConnector : Unsupported major.minor version 51.0 at

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 5

2013-11-27 Thread Joel Koshy
+1 On Wed, Nov 27, 2013 at 10:22:24AM -0800, Jun Rao wrote: +1. Verified quick start and unit tests. Thanks, Jun On Tue, Nov 26, 2013 at 2:34 PM, Joe Stein joe.st...@stealth.ly wrote: This is the fifth candidate for release of Apache Kafka 0.8.0. This release candidate is now

Re: [jira] [Created] (KAFKA-1171) Gradle build for Kafka

2014-01-04 Thread Joel Koshy
There seem to be missing files - was able to copy those over from samza's setup and was able to build but wasn't able to get the IDE filed generated. Also, is there a javadoc/scaladoc plugin? On Saturday, January 4, 2014, Jun Rao (JIRA) wrote: [

Re: Review Request 16718: Patch for KAFKA-1180

2014-01-07 Thread joel koshy
://reviews.apache.org/r/16718/#comment59807 Thanks for patching this issue. I'm not very clear on the cases here - i.e., is it exhaustive? Also, why is this method named quoteJsonLiteral? Finally, it may be a good idea to add more test cases in TopicFilterTest. - joel koshy On Jan. 8

Re: producer rewrite

2014-01-24 Thread Joel Koshy
Same here: +1 on checking in as is. I should be able to go through the patch on Monday. On Fri, Jan 24, 2014 at 01:48:14PM -0800, Neha Narkhede wrote: I plan to review the code over the weekend and I think it is easier to address the review comments async. +1 for checking it in as is for now.

Re: Review Request 17055: Patch for KAFKA-1055

2014-01-24 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17055/#review32772 --- Ship it! - Joel Koshy On Jan. 21, 2014, 9:29 p.m., Guozhang Wang

Re: Review Request 17263: New producer for Kafka.

2014-01-28 Thread Joel Koshy
/java/kafka/common/network/Send.java https://reviews.apache.org/r/17263/#comment62210 Not sure what the use-case for this would be. clients/src/main/java/kafka/common/utils/CopyOnWriteMap.java https://reviews.apache.org/r/17263/#comment62214 Unused class. - Joel Koshy On Jan. 23, 2014

Re: New Producer Public API

2014-01-30 Thread Joel Koshy
That's a good point about 1A - does seem that we would need to have some kind of TTL for each topic's metadata. Also, WRT ZK dependency I don't think that decision (for the Java client) affects other clients. i.e., other client implementations can use whatever discovery mechanism it chooses. That

Re: New Producer Public API

2014-01-30 Thread Joel Koshy
+ dev (this thread has become a bit unwieldy) On Thu, Jan 30, 2014 at 5:15 PM, Joel Koshy jjkosh...@gmail.com wrote: Does it preclude those various implementations? i.e., it could become a producer config: default.partitioner.strategy=minimize-connections/roundrobin - and so

Re: Review Request 17263: New producer for Kafka.

2014-01-30 Thread Joel Koshy
On Jan. 28, 2014, 8:48 p.m., Joel Koshy wrote: clients/src/main/java/kafka/clients/producer/KafkaProducer.java, line 182 https://reviews.apache.org/r/17263/diff/1/?file=436445#file436445line182 This could add a couple minutes startup for producers that send to several

Re: Proposed Changes To New Producer Public API

2014-02-01 Thread Joel Koshy
. In order to allow correctly choosing a partition the Producer interface will include a new method: ListPartitionInfo partitionsForTopic(String topic); PartitionInfo will be changed to include the actual Node objects not just the Node ids. Why are the node id's alone insufficient?

Re: Logging in new clients

2014-02-03 Thread Joel Koshy
We are already using other libraries in various parts of our code (e.g., metrics, zkclient, joptsimple, etc) some of which pull in these other logging dependencies anyway. i.e., what do we gain by using jul? There may be a good reason why people don't use jul so I think we should fully understand

Re: Review Request 17649: Patch for KAFKA-1237

2014-02-03 Thread Joel Koshy
/#comment62934 Producers are not shut down cleanly. - Joel Koshy On Feb. 3, 2014, 1:02 a.m., Neha Narkhede wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17649

Re: Logging in new clients

2014-02-03 Thread Joel Koshy
for their producer/consumer in addition to the configuration file for the rest of their system. Thanks, Joel On Mon, Feb 3, 2014 at 11:17 AM, Joel Koshy jjkosh...@gmail.com wrote: We are already using other libraries in various parts of our code (e.g., metrics, zkclient, joptsimple, etc) some

Re: Proposed Changes To New Producer Public API

2014-02-03 Thread Joel Koshy
For (3) we could also do the following: - On any retryable producer error, force a metadata refresh (in handleProducerResponse). - In handleMetadataResponse, the producer can (internally) close out connections that are no longer valid. (i.e., connections to {old set of leader brokers} - {new

Re: Review Request 17460: Patch for KAFKA-330

2014-02-04 Thread Joel Koshy
., the lock will in fact be released while awaiting, so maybe you should just say that the lock should be acquired before calling. - Joel Koshy On Feb. 1, 2014, 10:58 p.m., Neha Narkhede wrote: --- This is an automatically generated e-mail

Re: Config for new clients (and server)

2014-02-05 Thread Joel Koshy
Overall, +1 on sticking with key-values for configs. Con: The IDE gives nice auto-completion for pojos. Con: There are some advantages to javadoc as a documentation mechanism for java people. Optionally, both the above cons can be addressed (to some degree) by wrapper config POJOs that

Re: Review Request 17649: Patch for KAFKA-1237

2014-02-06 Thread Joel Koshy
method that we call from the shutdown hook as well as here.) - Joel Koshy On Feb. 4, 2014, 9:12 p.m., Neha Narkhede wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17649

Re: Review Request 17460: Patch for KAFKA-330

2014-02-07 Thread Joel Koshy
... i.e., we should eventually resume. - and I prefer Ineligible to Halted because I think it is weird to have replicas on dead brokers to come back up _have_ to go through a state called ReplicaDeletion_Failed_ if there was in fact no attempt at deletion. - Joel Koshy On Feb. 6, 2014, 7

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-02-12 Thread Joel Koshy
/kafka_system_test_utils.py fb4a9c0 system_test/utils/testcase_env.py bee8716 Diff: https://reviews.apache.org/r/18022/diff/ Testing --- Thanks, Joel Koshy

Re: Metrics in new producer

2014-02-12 Thread Joel Koshy
I have not had a chance to review the new metrics code and its features carefully (apart from your write-up), but here are my general thoughts: Implementing a metrics package correctly is difficult; more so for people like me, because I'm not a statistician. However, if this new package: {(i)

Re: Review Request 17006: Check if there are hanging producer threads in stopping all entities

2014-02-13 Thread Joel Koshy
kafka_system_test_utils.start_entity_in_background for how the PPID is obtained for the broker/console consumer, etc. - Joel Koshy On Jan. 28, 2014, 5:26 p.m., Guozhang Wang wrote: --- This is an automatically generated e-mail

Re: Review Request 16718: Patch for KAFKA-1180

2014-02-13 Thread Joel Koshy
that Jason reported. - Joel Koshy On Feb. 13, 2014, 8:24 p.m., Joe Stein wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16718

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-02-18 Thread Joel Koshy
, visit: https://reviews.apache.org/r/18022/#review34615 --- On Feb. 12, 2014, 7:50 p.m., Joel Koshy wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-02-18 Thread Joel Koshy
/18022/#review34673 --- On Feb. 12, 2014, 7:50 p.m., Joel Koshy wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18022

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-02-18 Thread Joel Koshy
: https://reviews.apache.org/r/18022/#review34677 --- On Feb. 12, 2014, 7:50 p.m., Joel Koshy wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-02-18 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18022/#review34803 --- On Feb. 12, 2014, 7:50 p.m., Joel Koshy wrote

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-03-05 Thread Joel Koshy
--- On Feb. 12, 2014, 7:50 p.m., Joel Koshy wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18022

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-03-05 Thread Joel Koshy
://reviews.apache.org/r/18022/diff/ Testing --- Thanks, Joel Koshy

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-03-05 Thread Joel Koshy
--- On March 5, 2014, 11:53 p.m., Joel Koshy wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18022

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-03-06 Thread Joel Koshy
be worth moving this logic out of here, but I realize that will be some refactoring work. Can we file a JIRA to improve this in the future? Joel Koshy wrote: Yeah it's not my favorite file in our code-base. Do you think it is worth filing a jira given that we are beginning a consumer rewrite

Re: [VOTE] Apache Kafka Release 0.8.1 - Candidate 2

2014-03-10 Thread Joel Koshy
+1 There is the zero-length md5 for 2.8.0-.8.1.tgz.md5 (zero missing). Not sure if that is a blocker though since most people are off 2.8.0 Joel On Mon, Mar 10, 2014 at 10:51:35AM -0700, Neha Narkhede wrote: +1, verified unit tests and quickstart. Thanks Neha On Mon, Mar 10, 2014 at

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-03-13 Thread Joel Koshy
/kafka_system_test_utils.py 29ab2ba system_test/utils/testcase_env.py bee8716 Diff: https://reviews.apache.org/r/18022/diff/ Testing --- Thanks, Joel Koshy

Re: Review Request 18022: KAFKA-1012: In-built offset management in Kafka

2014-03-13 Thread Joel Koshy
-mail. To reply, visit: https://reviews.apache.org/r/18022/#review37130 --- On March 13, 2014, 11:03 p.m., Joel Koshy wrote: --- This is an automatically generated e-mail. To reply

Review Request 19338: Fix cross-compilation issue

2014-03-17 Thread joel koshy
/browse/KAFKA-1309 Repository: kafka Description --- fix Diffs - core/src/main/scala/kafka/javaapi/OffsetCommitRequest.scala 6de320dcc0d9373dd046bda0ea68a9c9f8931630 Diff: https://reviews.apache.org/r/19338/diff/ Testing --- Thanks, joel koshy

Re: Review Request 19338: Fix cross-compilation issue

2014-03-17 Thread Joel Koshy
://reviews.apache.org/r/19338/#comment69072 Ideally, we should use something like mapAsScalaMap in 2.9.x - basically the direct conversion methods are different between 2.8.x and 2.9.x. That's why I'm doing it indirectly here. - Joel Koshy On March 18, 2014, 1:37 a.m., joel koshy wrote

Re: Review Request 19338: Fix cross-compilation issue

2014-03-17 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19338/#review37526 --- On March 18, 2014, 1:37 a.m., joel koshy wrote: --- This is an automatically generated e-mail

Re: Review Request 19338: Patch for KAFKA-1309

2014-03-18 Thread joel koshy
--- Thanks, joel koshy

Re: Review Request 19379: Patch for KAFKA-1311

2014-03-18 Thread Joel Koshy
is disabled. Nevertheless, could we also check if delete topic is enabled before trying to start the deletetopicmanager (and the associated delete topic thread)? core/src/main/scala/kafka/controller/TopicDeletionManager.scala https://reviews.apache.org/r/19379/#comment69287 Should be true - Joel

Re: Review Request 19379: Patch for KAFKA-1311

2014-03-18 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19379/#review37667 --- Ship it! Ship It! - Joel Koshy On March 19, 2014, 12:14 a.m

Re: Review Request 19828: Patch for KAFKA-1350

2014-03-31 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19828/#review39107 --- Ship it! Ship It! - Joel Koshy On March 30, 2014, 6:29 a.m

Re: Review Request 19873: Add log cleaner metrics

2014-04-02 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19873/#review39299 --- Ship it! Ship It! - Joel Koshy On April 1, 2014, 5:41 p.m., Jay

Re: Review Request 19957: Patch for KAFKA-1356

2014-04-02 Thread Joel Koshy
/main/scala/kafka/server/KafkaApis.scala https://reviews.apache.org/r/19957/#comment71773 I think this really should have been isr.map(aliveBrokers.get).filter(_.isEmpty) - Joel Koshy On April 2, 2014, 8:44 p.m., Timothy Chen wrote

Re: Review Request 19957: Patch for KAFKA-1356

2014-04-02 Thread Joel Koshy
On April 3, 2014, 1:13 a.m., Joel Koshy wrote: core/src/main/scala/kafka/api/TopicMetadata.scala, line 35 https://reviews.apache.org/r/19957/diff/1/?file=546093#file546093line35 Nitpick, but I think this would be a little neater: (0 to numPartitions).map( loop body ).toArray

Re: Review Request 19957: Patch for KAFKA-1356

2014-04-02 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19957/#review39387 --- Ship it! Ship It! - Joel Koshy On April 3, 2014, 1:39 a.m

Re: Review Request 19957: Patch for KAFKA-1356

2014-04-03 Thread Joel Koshy
On April 3, 2014, 5:12 a.m., Guozhang Wang wrote: Just curious: which part of the code is the main contribution to the handling overhead? Tim can correct me if I'm wrong but I think the overhead was largely in the sort. Thanks again for the patch. I'll get this checked in. - Joel

Review Request 20038: Patch for KAFKA-1355

2014-04-04 Thread Joel Koshy
/KafkaApis.scala c068ef69207c351eec413a595f1747c59f8b3983 Diff: https://reviews.apache.org/r/20038/diff/ Testing --- Thanks, Joel Koshy

Re: Review Request 20038: Patch for KAFKA-1355

2014-04-04 Thread Joel Koshy
really do the above for this specific issue because the slow-down due to logging happened a while ago. We can fix forward though - once this is checked in we can modify the request schema and then implement the better fix. - Joel Koshy On April 4, 2014, 6:22 p.m., Joel Koshy

Re: Review Request 20038: Patch for KAFKA-1355

2014-04-04 Thread Joel Koshy
core/src/main/scala/kafka/server/KafkaApis.scala c068ef69207c351eec413a595f1747c59f8b3983 Diff: https://reviews.apache.org/r/20038/diff/ Testing --- Thanks, Joel Koshy

Re: Review Request 20038: Patch for KAFKA-1355

2014-04-04 Thread Joel Koshy
core/src/main/scala/kafka/server/KafkaApis.scala c068ef69207c351eec413a595f1747c59f8b3983 Diff: https://reviews.apache.org/r/20038/diff/ Testing --- Thanks, Joel Koshy

Review Request 20130: Patch for KAFKA-1373

2014-04-08 Thread Joel Koshy
://reviews.apache.org/r/20130/diff/ Testing --- Thanks, Joel Koshy

Re: Review Request 20130: Patch for KAFKA-1373

2014-04-08 Thread Joel Koshy
89a88a7e4055f804429b64e85b2f65312d1e2155 core/src/test/scala/unit/kafka/log/LogCleanerIntegrationTest.scala 9aeb69d4934b9aa94e0899af14fc27e7c20f039f Diff: https://reviews.apache.org/r/20130/diff/ Testing --- Thanks, Joel Koshy

Re: Review Request 20181: Patch for KAFKA-1376

2014-04-09 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20181/#review39941 --- Ship it! Ship It! - Joel Koshy On April 9, 2014, 9:44 p.m., Jun

Re: 0.8.1.1 - rough ETA?

2014-04-09 Thread Joel Koshy
You can watch https://issues.apache.org/jira/browse/KAFKA-1380 for the release candidate. Thanks, Joel On Tue, Mar 25, 2014 at 09:42:33AM -0700, Neha Narkhede wrote: There are currently 3 outstanding

Review Request 20227: Set first dirty (uncompacted) offset to first offset of the log if no checkpoint exists.

2014-04-10 Thread Joel Koshy
://reviews.apache.org/r/20227/diff/ Testing --- Thanks, Joel Koshy

Review Request 20232: Avoid sending all topic metadata on state changes.

2014-04-10 Thread Joel Koshy
/KafkaApis.scala 0f137c5136e2320ca27c285d6ab013f6559314c4 Diff: https://reviews.apache.org/r/20232/diff/ Testing --- Thanks, Joel Koshy

Review Request 20376: Publish source jars and javadoc

2014-04-15 Thread Joel Koshy
/20376/diff/ Testing --- Thanks, Joel Koshy

Re: Review Request 20376: Publish source jars and javadoc

2014-04-15 Thread Joel Koshy
, 7:39 p.m., Joel Koshy wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20376/ --- (Updated April 15, 2014, 7:39 p.m

Re: Review Request 20272: Patch for KAFKA-1356

2014-04-16 Thread Joel Koshy
been closed. - Joel Koshy On April 11, 2014, 9:03 p.m., Jun Rao wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20272

Re: [DISCUSS] 0.8.1.1 vs 0.8.2

2014-04-16 Thread Joel Koshy
The 0.8.1 tag came back because some committers had the tag locally and did a push before updating their local checkouts. The tag + branch combination is confusing. E.g., if you have a local 0.8.1 branch, git log 0.8.1 will show changes on the tag, not the local branch. Committers will need to

Re: Review Request 20393: Fix KAFKA-1323: rebase on 0.8.1

2014-04-16 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20393/#review40590 --- Ship it! Ship It! - Joel Koshy On April 16, 2014, 6:53 p.m

Re: Review Request 20393: Fix KAFKA-1323: rebase on 0.8.1

2014-04-16 Thread Joel Koshy
On April 16, 2014, 6:57 p.m., Joel Koshy wrote: Ship It! Actually, I ran into this: ReplicaManagerTest.scala:51: value tempRelativeDir is not a member of object kafka.utils.TestUtils props.put(log.dir, TestUtils.tempRelativeDir(data).getAbsolutePath) - Joel

Re: Review Request 20393: Fix KAFKA-1323: rebase on 0.8.1

2014-04-16 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20393/#review40600 --- Ship it! Ship It! - Joel Koshy On April 16, 2014, 7:05 p.m

Re: Review Request 20272: Patch for KAFKA-1356

2014-04-16 Thread Joel Koshy
://reviews.apache.org/r/20272/#comment73672 We can call it addOrUpdatePartitionInfo (I think it needs to be called from updateCache as well) - Joel Koshy On April 11, 2014, 9:03 p.m., Jun Rao wrote: --- This is an automatically

Re: Review Request 20252: Patch for KAFKA-1356

2014-04-16 Thread Joel Koshy
is different from the number of requested topics, proceed to do a set difference and auto-create the missing topics. - Joel Koshy On April 11, 2014, 7:42 a.m., Timothy Chen wrote: --- This is an automatically generated e-mail

Re: Review Request 20424: Fix KAFKA-1365 on 0.8.1

2014-04-17 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20424/#review40713 --- Ship it! Ship It! - Joel Koshy On April 16, 2014, 6:23 p.m

  1   2   3   4   5   6   7   8   9   10   >