Re: Review Request 36871: Patch for KAFKA-2381

2015-07-27 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36871/ --- (Updated July 28, 2015, 4:59 a.m.) Review request for kafka. Bugs:

[jira] [Updated] (KAFKA-2381) Possible ConcurrentModificationException while unsubscribing from a topic in new consumer

2015-07-27 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2381: -- Attachment: KAFKA-2381_2015-07-27_21:56:06.patch Possible ConcurrentModificationException

[jira] [Commented] (KAFKA-2381) Possible ConcurrentModificationException while unsubscribing from a topic in new consumer

2015-07-27 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643847#comment-14643847 ] Ashish K Singh commented on KAFKA-2381: --- Updated reviewboard

Re: Review Request 36871: Patch for KAFKA-2381

2015-07-27 Thread Ashish Singh
On July 28, 2015, 1:15 a.m., Aditya Auradkar wrote: core/src/test/scala/integration/kafka/api/ConsumerTest.scala, line 233 https://reviews.apache.org/r/36871/diff/2/?file=1023276#file1023276line233 consider closing this in a finally. A failing test can cause incorrect tear down

Re: Review Request 36871: Patch for KAFKA-2381

2015-07-27 Thread Ashish Singh
On July 28, 2015, 1:11 a.m., Jason Gustafson wrote: Ouch. Hard to believe this wasn't caught yet. It is. Thanks for the review. Addressed your concern. - Ashish --- This is an automatically generated e-mail. To reply, visit:

[jira] [Updated] (KAFKA-2381) Possible ConcurrentModificationException while unsubscribing from a topic in new consumer

2015-07-27 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2381: -- Attachment: KAFKA-2381_2015-07-27_21:59:41.patch Possible ConcurrentModificationException

[jira] [Commented] (KAFKA-2026) Logging of unused options always shows null for the value and is misleading if the option is used by serializers

2015-07-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643820#comment-14643820 ] Xuan Gong commented on KAFKA-2026: -- I think that the warning messages here are used to

Re: [DISCUSS] KIP-28 - Add a transform client for data processing

2015-07-27 Thread Gwen Shapira
Hi, Since we will be discussing KIP-28 in the call tomorrow, can you update the KIP with the feature-comparison with existing solutions? I admit that I do not see a need for single-event-producer-consumer pair (AKA Flume Interceptor). I've seen tons of people implement such apps in the last

[jira] [Created] (KAFKA-2371) Add distributed coordinator implementation for Copycat

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2371: Summary: Add distributed coordinator implementation for Copycat Key: KAFKA-2371 URL: https://issues.apache.org/jira/browse/KAFKA-2371 Project: Kafka

[jira] [Created] (KAFKA-2372) Copycat distributed config storage

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2372: Summary: Copycat distributed config storage Key: KAFKA-2372 URL: https://issues.apache.org/jira/browse/KAFKA-2372 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-2373) Copycat distributed offset storage

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2373: Summary: Copycat distributed offset storage Key: KAFKA-2373 URL: https://issues.apache.org/jira/browse/KAFKA-2373 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-2374) Implement Copycat log/file connector

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2374: Summary: Implement Copycat log/file connector Key: KAFKA-2374 URL: https://issues.apache.org/jira/browse/KAFKA-2374 Project: Kafka Issue

[jira] [Created] (KAFKA-2375) Implement elasticsearch Copycat sink connector

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2375: Summary: Implement elasticsearch Copycat sink connector Key: KAFKA-2375 URL: https://issues.apache.org/jira/browse/KAFKA-2375 Project: Kafka

[jira] [Created] (KAFKA-2377) Add copycat system tests

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2377: Summary: Add copycat system tests Key: KAFKA-2377 URL: https://issues.apache.org/jira/browse/KAFKA-2377 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-2376) Add Copycat metrics

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2376: Summary: Add Copycat metrics Key: KAFKA-2376 URL: https://issues.apache.org/jira/browse/KAFKA-2376 Project: Kafka Issue Type: Sub-task

[jira] [Issue Comment Deleted] (KAFKA-2365) Copycat checklist

2015-07-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2365: Comment: was deleted (was: I keep waiting for [~ewencp] to create the log connector jira so I can

[jira] [Created] (KAFKA-2379) Add Copycat documentation

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2379: Summary: Add Copycat documentation Key: KAFKA-2379 URL: https://issues.apache.org/jira/browse/KAFKA-2379 Project: Kafka Issue Type: Sub-task

[jira] [Commented] (KAFKA-2377) Add copycat system tests

2015-07-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642336#comment-14642336 ] Gwen Shapira commented on KAFKA-2377: - Two connectors that are not useful for anything

[GitHub] kafka pull request: KAFKA-2366 [WIP]; Copycat

2015-07-27 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/99 KAFKA-2366 [WIP]; Copycat This is an initial patch implementing the basics of Copycat for KIP-26. The intent here is to start a review of the key pieces of the core API and get a reasonably

[jira] [Commented] (KAFKA-2366) Initial patch for Copycat

2015-07-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642362#comment-14642362 ] ASF GitHub Bot commented on KAFKA-2366: --- GitHub user ewencp opened a pull request:

[jira] [Created] (KAFKA-2368) Add Copycat standalone CLI

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2368: Summary: Add Copycat standalone CLI Key: KAFKA-2368 URL: https://issues.apache.org/jira/browse/KAFKA-2368 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-2369) Add Copycat REST API

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2369: Summary: Add Copycat REST API Key: KAFKA-2369 URL: https://issues.apache.org/jira/browse/KAFKA-2369 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-2370) Add pause/unpause connector support

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2370: Summary: Add pause/unpause connector support Key: KAFKA-2370 URL: https://issues.apache.org/jira/browse/KAFKA-2370 Project: Kafka Issue

[jira] [Commented] (KAFKA-2365) Copycat checklist

2015-07-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642318#comment-14642318 ] Gwen Shapira commented on KAFKA-2365: - I see the release is 0.8.3 - is the intent to

[jira] [Updated] (KAFKA-2374) Implement Copycat log/file connector

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2374: - Description: This is a good baseline connector that has zero dependencies and

[jira] [Created] (KAFKA-2378) Add Copycat embedded API

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2378: Summary: Add Copycat embedded API Key: KAFKA-2378 URL: https://issues.apache.org/jira/browse/KAFKA-2378 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-28 - Add a transform client for data processing

2015-07-27 Thread Yi Pan
Hi, Jay and all, Thanks for all your quick responses. I tried to summarize my thoughts here: - ConsumerRecord as stream processor API: * This KafkaProcessor API is targeted to receive the message from Kafka. So, to Yasuhiro's join/transformation example, any join/transformation results that

[jira] [Commented] (KAFKA-2377) Add copycat system tests

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642367#comment-14642367 ] Ewen Cheslack-Postava commented on KAFKA-2377: -- Good point -- I think this is

[jira] [Commented] (KAFKA-2100) Client Error doesn't preserve or display original server error code when it is an unknown code

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642400#comment-14642400 ] Ewen Cheslack-Postava commented on KAFKA-2100: -- LGTM. wrt inconsistency: the

[jira] [Commented] (KAFKA-2365) Copycat checklist

2015-07-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642381#comment-14642381 ] Ewen Cheslack-Postava commented on KAFKA-2365: -- I tagged it given my current

[jira] [Commented] (KAFKA-2092) New partitioning for better load balancing

2015-07-27 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642427#comment-14642427 ] Gianmarco De Francisci Morales commented on KAFKA-2092: ---

<    1   2