Re: [DISCUSSION] adding the serializer api back to the new java producer

2014-12-15 Thread Joel Koshy
(sorry about the late follow-up late - I'm traveling most of this month) I'm likely missing something obvious, but I find the following to be a somewhat vague point that has been mentioned more than once in this thread without a clear explanation. i.e., why is it hard to share a

[jira] [Commented] (KAFKA-1804) Kafka network thread lacks top exception handler

2014-12-15 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246599#comment-14246599 ] Oleg Golovin commented on KAFKA-1804: - `kafka-socket-acceptor` has the same problem.

[jira] [Created] (KAFKA-1820) Kafka Leader not found for Topic and Partition

2014-12-15 Thread Ashendra Bansal (JIRA)
Ashendra Bansal created KAFKA-1820: -- Summary: Kafka Leader not found for Topic and Partition Key: KAFKA-1820 URL: https://issues.apache.org/jira/browse/KAFKA-1820 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-15 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246883#comment-14246883 ] Gwen Shapira commented on KAFKA-742: I think we need to print the full path to the

[jira] [Created] (KAFKA-1821) Example shell scripts broken

2014-12-15 Thread Yong Fu (JIRA)
Yong Fu created KAFKA-1821: -- Summary: Example shell scripts broken Key: KAFKA-1821 URL: https://issues.apache.org/jira/browse/KAFKA-1821 Project: Kafka Issue Type: Bug Components:

[jira] [Updated] (KAFKA-1821) Example shell scripts broken

2014-12-15 Thread Yong Fu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Fu updated KAFKA-1821: --- Environment: Ubuntu 14.04, Linux 75477193b766 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014

Re: Review Request 29029: Patch for KAFKA-1512

2014-12-15 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29029/#review65114 --- Jeff, There's some strange things going on there, I think we need

Re: [DISCUSSION] adding the serializer api back to the new java producer

2014-12-15 Thread Jun Rao
Joel, It's just that if the serializer/deserializer is not part of the API, you can only encourage people to use it through documentation. However, not everyone will read the documentation if it's not directly used in the API. Thanks, Jun On Mon, Dec 15, 2014 at 2:11 AM, Joel Koshy

[jira] [Updated] (KAFKA-1819) Cleaner gets confused about deleted and re-created topics

2014-12-15 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1819: - Fix Version/s: 0.8.2 Cleaner gets confused about deleted and re-created topics

[jira] [Updated] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-15 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1512: - Reviewer: Jay Kreps Limit the maximum number of connections per ip address

[jira] [Commented] (KAFKA-1820) Kafka Leader not found for Topic and Partition

2014-12-15 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247179#comment-14247179 ] Neha Narkhede commented on KAFKA-1820: -- It is best to discuss these kind of questions

Re: spark kafka batch integration

2014-12-15 Thread Koert Kuipers
gwen, i thought about it a little more and i feel pretty confident i can make it so that it's deterministic in case of node failure. will push that change out after holidays. On Mon, Dec 15, 2014 at 12:03 AM, Koert Kuipers ko...@tresata.com wrote: hey gwen, no immediate plans to contribute it

Re: Review Request 29029: Patch for KAFKA-1512

2014-12-15 Thread Jeff Holoman
On Dec. 15, 2014, 7:58 p.m., Gwen Shapira wrote: Jeff, There's some strange things going on there, I think we need a bit more testing and maybe more implementation :) 1. Please make sure the test fails without the override fix. When I tried, it passed on trunk... this means we

Re: Review Request 28423: Patch for kafka-1797

2014-12-15 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28423/ --- (Updated Dec. 15, 2014, 11:36 p.m.) Review request for kafka. Bugs:

[jira] [Commented] (KAFKA-1797) add the serializer/deserializer api to the new java client

2014-12-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247433#comment-14247433 ] Jun Rao commented on KAFKA-1797: Updated reviewboard

[jira] [Updated] (KAFKA-1797) add the serializer/deserializer api to the new java client

2014-12-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1797: --- Attachment: kafka-1797_2014-12-15_15:36:24.patch add the serializer/deserializer api to the new java client

Re: Review Request 28423: Patch for kafka-1797

2014-12-15 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28423/#review65153 --- Ship it! Ship It! - Neha Narkhede On Dec. 15, 2014, 11:36 p.m.,

Review Request 29072: rebased for 0.8.2 branch

2014-12-15 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29072/ --- Review request for kafka. Bugs: kafka-1797

[jira] [Updated] (KAFKA-1797) add the serializer/deserializer api to the new java client

2014-12-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1797: --- Attachment: kafka-1797.patch add the serializer/deserializer api to the new java client

[jira] [Commented] (KAFKA-1806) broker can still expose uncommitted data to a consumer

2014-12-15 Thread lokesh Birla (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247607#comment-14247607 ] lokesh Birla commented on KAFKA-1806: - Neha, I can see this problem quite often.

[jira] [Commented] (KAFKA-1819) Cleaner gets confused about deleted and re-created topics

2014-12-15 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247661#comment-14247661 ] Gwen Shapira commented on KAFKA-1819: - Yep, looks like a bug. When we delete a topic

[jira] [Commented] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2014-12-15 Thread Bob Potter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247766#comment-14247766 ] Bob Potter commented on KAFKA-1788: --- I've been digging into this a little bit and in

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247842#comment-14247842 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch Improve consumer read performance for Windows

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) Improve consumer read performance for Windows

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247843#comment-14247843 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch Improve consumer read performance for Windows

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) Improve consumer read

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) Improve consumer read performance for Windows

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247852#comment-14247852 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch Improve consumer read performance for Windows

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247862#comment-14247862 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch Improve consumer read performance for Windows

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch Improve consumer read performance for Windows

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247865#comment-14247865 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) Improve consumer read performance for Windows

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) Improve consumer read

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) Improve consumer read performance for Windows

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) Improve consumer read

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) Improve consumer read

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) Improve consumer read

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Comment: was deleted (was: Created reviewboard against branch origin/0.8.1) Improve consumer read

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247879#comment-14247879 ] Qianlin Xia commented on KAFKA-1646: Created reviewboard against branch origin/0.8.1

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) Improve consumer read performance for Windows

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch Improve consumer read performance for Windows

[jira] [Updated] (KAFKA-1720) [Renaming / Comments] Delayed Operations

2014-12-15 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1720: -- Resolution: Fixed Status: Resolved (was: Patch Available) Guozhang committed this to trunk

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: KAFKA-1646.patch Improve consumer read performance for Windows

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-12-15 Thread Qianlin Xia (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianlin Xia updated KAFKA-1646: --- Attachment: (was: KAFKA-1646.patch) Improve consumer read performance for Windows

Review Request 29091: Patch for KAFKA-1646

2014-12-15 Thread Qianlin Xia
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29091/ --- Review request for kafka. Bugs: KAFKA-1646