Re: [DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-29 Thread Ewen Cheslack-Postava
Seems like discussion has mostly quieted down on this. Any more questions, comments, or discussion? If nobody brings up any other issues, I'll start a vote thread in a day or two. -Ewen On Thu, Jun 25, 2015 at 3:36 PM, Jay Kreps j...@confluent.io wrote: We were talking on the call about a

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-06-29 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606043#comment-14606043 ] Allen Wang commented on KAFKA-1215: --- [~junrao] AWS region (for example us-east-1) can be

[jira] [Updated] (KAFKA-2304) Support enabling JMX in Kafka Vagrantfile

2015-06-29 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Slavic updated KAFKA-2304: Status: Patch Available (was: Open) Support enabling JMX in Kafka Vagrantfile

[jira] [Created] (KAFKA-2304) Support enabling JMX in Kafka Vagrantfile

2015-06-29 Thread Stevo Slavic (JIRA)
Stevo Slavic created KAFKA-2304: --- Summary: Support enabling JMX in Kafka Vagrantfile Key: KAFKA-2304 URL: https://issues.apache.org/jira/browse/KAFKA-2304 Project: Kafka Issue Type: Bug

Mirror maker: New Producer error callback

2015-06-29 Thread Chittaranjan Hota
Hi Contributors, Not sure if any enhancement has been thought in this area. File: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/producer/BaseProducer.scala (Line 44) Currently, in the mirror maker process all async Producer send calls have ErrorLoggingCallback registered.

[jira] [Updated] (KAFKA-2304) Support enabling JMX in Kafka Vagrantfile

2015-06-29 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Slavic updated KAFKA-2304: Attachment: KAFKA-2304-JMX.patch Attached [^KAFKA-2304-JMX.patch] Support enabling JMX in Kafka

[jira] [Commented] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-06-29 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606548#comment-14606548 ] Jun Rao commented on KAFKA-2210: [~parthbhave], are you still working on this jira?

[jira] [Updated] (KAFKA-2191) Measured rate should not be infinite

2015-06-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2191: Resolution: Fixed Status: Resolved (was: Patch Available) Merged into KAFKA-2084. Measured rate

[jira] [Commented] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-06-29 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606580#comment-14606580 ] Parth Brahmbhatt commented on KAFKA-2210: - [~junrao] Hey sorry for the delay, I

Re: Review Request 35231: Rebased

2015-06-29 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35231/ --- (Updated June 30, 2015, 1:21 a.m.) Review request for kafka. Summary

[jira] [Updated] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1740: - Attachment: KAFKA-1740_2015-06-29_18:21:42.patch Merge Offset manager into Coordinator

[jira] [Commented] (KAFKA-2281) org.apache.kafka.clients.producer.internals.ErrorLoggingCallback holds unnecessary byte[] value

2015-06-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606822#comment-14606822 ] Guozhang Wang commented on KAFKA-2281: -- Thanks for the patch. +1 and committed to

[jira] [Updated] (KAFKA-2291) Documentation Error

2015-06-29 Thread Anatoli Fomenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Fomenko updated KAFKA-2291: --- Attachment: KAFKA-2291.patch Documentation Error --- Key:

Build failed in Jenkins: Kafka-trunk #522

2015-06-29 Thread Apache Jenkins Server
See https://builds.apache.org/job/Kafka-trunk/522/changes Changes: [wangguoz] KAFKA-2281: avoid unnecessary value copying if logAsString is false; reviewed by Guozhang Wang -- [...truncated 1410 lines...] kafka.log.BrokerCompressionTest

Jenkins build is back to normal : KafkaPreCommit #133

2015-06-29 Thread Apache Jenkins Server
See https://builds.apache.org/job/KafkaPreCommit/133/changes

Re: Review Request 33049: Patch for KAFKA-2084

2015-06-29 Thread Aditya Auradkar
On June 17, 2015, 4:40 p.m., Joel Koshy wrote: core/src/main/scala/kafka/server/ClientQuotaMetrics.scala, line 1 https://reviews.apache.org/r/33049/diff/15/?file=983845#file983845line1 Why was MockTime moved from test to main? Because I need to depend on MockTime from clients in

[jira] [Commented] (KAFKA-2084) byte rate metrics per client ID (producer and consumer)

2015-06-29 Thread Aditya A Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606760#comment-14606760 ] Aditya A Auradkar commented on KAFKA-2084: -- Updated reviewboard

Re: Review Request 33049: Patch for KAFKA-2084

2015-06-29 Thread Aditya Auradkar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33049/ --- (Updated June 30, 2015, 12:54 a.m.) Review request for kafka, Joel Koshy and

[jira] [Updated] (KAFKA-2084) byte rate metrics per client ID (producer and consumer)

2015-06-29 Thread Aditya A Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya A Auradkar updated KAFKA-2084: - Attachment: KAFKA-2084_2015-06-29_17:53:44.patch byte rate metrics per client ID

Re: Review Request 35231: Address Onur and Jason's comments

2015-06-29 Thread Guozhang Wang
On June 18, 2015, 12:50 a.m., Jason Gustafson wrote: core/src/main/scala/kafka/coordinator/ConsumerCoordinator.scala, lines 229-236 https://reviews.apache.org/r/35231/diff/1/?file=980918#file980918line229 In manual group management, would we expect consumerId and generationId

[jira] [Updated] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1740: - Attachment: KAFKA-1740_2015-06-29_18:44:54.patch Merge Offset manager into Coordinator

Re: Review Request 35231: Address Onur and Jason's comments

2015-06-29 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35231/ --- (Updated June 30, 2015, 1:44 a.m.) Review request for kafka. Summary

Review Request 36030: Patch for KAFKA-972

2015-06-29 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36030/ --- Review request for kafka. Bugs: KAFKA-972

[jira] [Commented] (KAFKA-972) MetadataRequest returns stale list of brokers

2015-06-29 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606755#comment-14606755 ] Ashish K Singh commented on KAFKA-972: -- Created reviewboard

[jira] [Updated] (KAFKA-972) MetadataRequest returns stale list of brokers

2015-06-29 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-972: - Status: Patch Available (was: Open) MetadataRequest returns stale list of brokers

[jira] [Updated] (KAFKA-972) MetadataRequest returns stale list of brokers

2015-06-29 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-972: - Attachment: KAFKA-972.patch MetadataRequest returns stale list of brokers

[jira] [Updated] (KAFKA-2291) Documentation Error

2015-06-29 Thread UTKARSH BHATNAGAR (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] UTKARSH BHATNAGAR updated KAFKA-2291: - Resolution: Fixed Status: Resolved (was: Patch Available) Documentation Error

[jira] [Commented] (KAFKA-2291) Documentation Error

2015-06-29 Thread UTKARSH BHATNAGAR (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606898#comment-14606898 ] UTKARSH BHATNAGAR commented on KAFKA-2291: -- LGTM. Documentation Error

Re: Review Request 33049: Patch for KAFKA-2084

2015-06-29 Thread Aditya Auradkar
On June 17, 2015, 4:40 p.m., Joel Koshy wrote: core/src/test/scala/integration/kafka/api/QuotasTest.scala, line 142 https://reviews.apache.org/r/33049/diff/15/?file=983852#file983852line142 This is an important test, but this is a bit non-deterministic no? i.e., the replicas

Re: Review Request 35850: Patch for KAFKA-2301

2015-06-29 Thread Ashish Singh
On June 25, 2015, 1:06 a.m., Ewen Cheslack-Postava wrote: Is this what was intended by deprecate? I'm not sure there's been serious discussion about this yet, but this doesn't really deprecate the command in a compatible way -- just changing to ConsumerGroupCommand requires changing

[jira] [Commented] (KAFKA-2129) Consumer could make multiple concurrent metadata requests

2015-06-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606862#comment-14606862 ] Guozhang Wang commented on KAFKA-2129: -- [~timbrooks], sorry for the long-late reply

[jira] [Commented] (KAFKA-2291) Documentation Error

2015-06-29 Thread Anatoli Fomenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606860#comment-14606860 ] Anatoli Fomenko commented on KAFKA-2291: Please review the patch. Thank you.

Re: Review Request 35231: Address Onur and Jason's comments

2015-06-29 Thread Guozhang Wang
On June 11, 2015, 5:40 p.m., Onur Karaman wrote: core/src/main/scala/kafka/coordinator/ConsumerCoordinator.scala, lines 229-236 https://reviews.apache.org/r/35231/diff/1/?file=980918#file980918line229 This can happen in two ways: 1. An automatic group management (subscribes

[jira] [Commented] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606820#comment-14606820 ] Guozhang Wang commented on KAFKA-1740: -- Updated reviewboard

[jira] [Created] (KAFKA-2305) Cluster Monitoring and Management UI

2015-06-29 Thread Soumyajit Sahu (JIRA)
Soumyajit Sahu created KAFKA-2305: - Summary: Cluster Monitoring and Management UI Key: KAFKA-2305 URL: https://issues.apache.org/jira/browse/KAFKA-2305 Project: Kafka Issue Type: Wish

[jira] [Commented] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606795#comment-14606795 ] Guozhang Wang commented on KAFKA-1740: -- Updated reviewboard

[jira] [Updated] (KAFKA-2281) org.apache.kafka.clients.producer.internals.ErrorLoggingCallback holds unnecessary byte[] value

2015-06-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2281: - Resolution: Fixed Status: Resolved (was: Patch Available)

Review Request 36034: Patch for KAFKA-2306

2015-06-29 Thread Dong Lin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36034/ --- Review request for kafka. Bugs: KAFKA-2306

[jira] [Updated] (KAFKA-2306) New producer should emit metrics for buffer exhaustion

2015-06-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2306: Attachment: KAFKA-2306.patch New producer should emit metrics for buffer exhaustion

[jira] [Commented] (KAFKA-2306) New producer should emit metrics for buffer exhaustion

2015-06-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606954#comment-14606954 ] Dong Lin commented on KAFKA-2306: - Created reviewboard

[jira] [Updated] (KAFKA-2306) New producer should emit metrics for buffer exhaustion

2015-06-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2306: Status: Patch Available (was: Open) New producer should emit metrics for buffer exhaustion

Re: Review Request 35231: Address Onur and Jason's comments

2015-06-29 Thread Jason Gustafson
On June 18, 2015, 12:50 a.m., Jason Gustafson wrote: core/src/main/scala/kafka/coordinator/ConsumerCoordinator.scala, lines 229-236 https://reviews.apache.org/r/35231/diff/1/?file=980918#file980918line229 In manual group management, would we expect consumerId and generationId

[jira] [Commented] (KAFKA-2291) Documentation Error

2015-06-29 Thread Anatoli Fomenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607541#comment-14607541 ] Anatoli Fomenko commented on KAFKA-2291: Thanks, UTKARSH. Documentation Error

[jira] [Commented] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607548#comment-14607548 ] Ewen Cheslack-Postava commented on KAFKA-2168: -- This version was committed to

[jira] [Assigned] (KAFKA-2306) New producer should emit metrics for buffer exhaustion

2015-06-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-2306: --- Assignee: Dong Lin New producer should emit metrics for buffer exhaustion

[jira] [Created] (KAFKA-2306) New producer should emit metrics for buffer exhaustion

2015-06-29 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-2306: --- Summary: New producer should emit metrics for buffer exhaustion Key: KAFKA-2306 URL: https://issues.apache.org/jira/browse/KAFKA-2306 Project: Kafka Issue Type: Bug