[GitHub] [kafka] chia7712 commented on pull request #9501: MINOR: move the test cases which don't need brokers from TopicCommand…

2020-11-18 Thread GitBox
chia7712 commented on pull request #9501: URL: https://github.com/apache/kafka/pull/9501#issuecomment-729521905 @omkreddy Thanks for your reviews! will merge it to trunk This is an automated message from the Apache Git

[GitHub] [kafka] chia7712 merged pull request #9501: MINOR: move the test cases which don't need brokers from TopicCommand…

2020-11-18 Thread GitBox
chia7712 merged pull request #9501: URL: https://github.com/apache/kafka/pull/9501 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] showuon commented on pull request #9507: KAFKA-10628: remove all the unnecessary parameters from the tests which are using TopologyTestDriver

2020-11-18 Thread GitBox
showuon commented on pull request #9507: URL: https://github.com/apache/kafka/pull/9507#issuecomment-729536852 @chia7712 , the test results are: **tests/Build/JDK 11** : pass **tests/Build/JDK 15**: pass **tests/Build/JDK 8**: failed with a unrelated test

[GitHub] [kafka] chia7712 commented on pull request #9507: KAFKA-10628: remove all the unnecessary parameters from the tests which are using TopologyTestDriver

2020-11-18 Thread GitBox
chia7712 commented on pull request #9507: URL: https://github.com/apache/kafka/pull/9507#issuecomment-729542152 @vvcephei I will merge this PR tomorrow. Would be helpful if you could take one more look before merge. This is

[GitHub] [kafka] fml2 commented on a change in pull request #9606: [KAFKA-10722] doc: Improve JavaDoc for KGroupedStream.aggregate

2020-11-18 Thread GitBox
fml2 commented on a change in pull request #9606: URL: https://github.com/apache/kafka/pull/9606#discussion_r525882399 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/KGroupedStream.java ## @@ -438,7 +439,8 @@ * query the value of the key on a

[jira] [Commented] (KAFKA-10728) Mirroring data without decompressing with MirrorMaker 2.0

2020-11-18 Thread Eazhilan Nagarajan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234491#comment-17234491 ] Eazhilan Nagarajan commented on KAFKA-10728: Well similarly is there an option to tell the

[GitHub] [kafka] chia7712 commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526039872 ## File path: clients/src/main/resources/common/message/ProduceRequest.json ## @@ -33,21 +33,21 @@ "validVersions": "0-8", "flexibleVersions":

[GitHub] [kafka] twobeeb commented on pull request #9589: KAFKA-10710 - Mirror Maker 2 - Create herders only if source->target.enabled=true

2020-11-18 Thread GitBox
twobeeb commented on pull request #9589: URL: https://github.com/apache/kafka/pull/9589#issuecomment-729529865 @hachikuji ready for review, I believe failed CI is unrelated This is an automated message from the Apache Git

[GitHub] [kafka] chia7712 commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526029843 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java ## @@ -560,13 +562,24 @@ private void

[GitHub] [kafka] dajac commented on a change in pull request #9386: KAFKA-10024: Add dynamic configuration and enforce quota for per-IP connection rate limits (KIP-612, part 2)

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9386: URL: https://github.com/apache/kafka/pull/9386#discussion_r525888208 ## File path: core/src/main/scala/kafka/network/SocketServer.scala ## @@ -538,14 +542,20 @@ private[kafka] class Acceptor(val endPoint: EndPoint,

[GitHub] [kafka] dajac commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r525965065 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java ## @@ -560,13 +562,24 @@ private void

[GitHub] [kafka] chia7712 commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526032716 ## File path: clients/src/test/java/org/apache/kafka/clients/NetworkClientTest.java ## @@ -154,8 +155,11 @@ public void testClose() {

[GitHub] [kafka] ijuma merged pull request #9566: KAFKA-10618: Update to Uuid class

2020-11-18 Thread GitBox
ijuma merged pull request #9566: URL: https://github.com/apache/kafka/pull/9566 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] dajac commented on a change in pull request #9386: KAFKA-10024: Add dynamic configuration and enforce quota for per-IP connection rate limits (KIP-612, part 2)

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9386: URL: https://github.com/apache/kafka/pull/9386#discussion_r525953666 ## File path: core/src/main/scala/kafka/network/SocketServer.scala ## @@ -1476,33 +1650,36 @@ class ConnectionQuotas(config: KafkaConfig, time: Time,

[GitHub] [kafka] chia7712 opened a new pull request #9611: KAFKA-10736 Convert transaction coordinator metadata schemas to use g…

2020-11-18 Thread GitBox
chia7712 opened a new pull request #9611: URL: https://github.com/apache/kafka/pull/9611 issue: https://issues.apache.org/jira/browse/KAFKA-10736 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI

[GitHub] [kafka] chia7712 commented on pull request #9516: MINOR: make Send and Receive work with TransportLayer rather than Gat…

2020-11-18 Thread GitBox
chia7712 commented on pull request #9516: URL: https://github.com/apache/kafka/pull/9516#issuecomment-729589011 @ijuma Could you take a look? This PR is according to your comment in

[GitHub] [kafka] chia7712 commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526280042 ## File path: clients/src/main/resources/common/message/ProduceRequest.json ## @@ -33,21 +33,21 @@ "validVersions": "0-8", "flexibleVersions":

[GitHub] [kafka] hachikuji commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526287129 ## File path: clients/src/main/java/org/apache/kafka/common/requests/OffsetsForLeaderEpochRequest.java ## @@ -51,169 +47,120 @@ */ public

[GitHub] [kafka] chia7712 commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526301121 ## File path: clients/src/main/java/org/apache/kafka/common/requests/OffsetsForLeaderEpochRequest.java ## @@ -51,169 +47,120 @@ */ public

[GitHub] [kafka] hachikuji commented on pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji commented on pull request #9401: URL: https://github.com/apache/kafka/pull/9401#issuecomment-729870471 Great work @chia7712 ! With this and #9547, we have converted all of the protocols, which was a huge community effort!

[GitHub] [kafka] wcarlson5 commented on pull request #9581: KAFKA-10500: Add thread

2020-11-18 Thread GitBox
wcarlson5 commented on pull request #9581: URL: https://github.com/apache/kafka/pull/9581#issuecomment-729885913 Moved to https://github.com/apache/kafka/pull/9615 This is an automated message from the Apache Git Service. To

[GitHub] [kafka] wcarlson5 closed pull request #9581: KAFKA-10500: Add thread

2020-11-18 Thread GitBox
wcarlson5 closed pull request #9581: URL: https://github.com/apache/kafka/pull/9581 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Created] (KAFKA-10738) kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or corretto 11

2020-11-18 Thread Duke Pham (Jira)
Duke Pham created KAFKA-10738: - Summary: kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or corretto 11 Key: KAFKA-10738 URL: https://issues.apache.org/jira/browse/KAFKA-10738

[jira] [Updated] (KAFKA-10738) kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or corretto 11

2020-11-18 Thread Duke Pham (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duke Pham updated KAFKA-10738: -- Description: h5. kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or

[GitHub] [kafka] lct45 commented on a change in pull request #9614: KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads

2020-11-18 Thread GitBox
lct45 commented on a change in pull request #9614: URL: https://github.com/apache/kafka/pull/9614#discussion_r526331025 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/MetricsIntegrationTest.java ## @@ -377,7 +378,7 @@ private void

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9614: KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads

2020-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #9614: URL: https://github.com/apache/kafka/pull/9614#discussion_r526352796 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/MetricsIntegrationTest.java ## @@ -377,7 +378,7 @@ private void

[GitHub] [kafka] lct45 commented on a change in pull request #9614: KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads

2020-11-18 Thread GitBox
lct45 commented on a change in pull request #9614: URL: https://github.com/apache/kafka/pull/9614#discussion_r526355838 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -1070,6 +1070,10 @@ private Thread shutdownHelper(final boolean error) {

[GitHub] [kafka] apovzner commented on a change in pull request #9386: KAFKA-10024: Add dynamic configuration and enforce quota for per-IP connection rate limits (KIP-612, part 2)

2020-11-18 Thread GitBox
apovzner commented on a change in pull request #9386: URL: https://github.com/apache/kafka/pull/9386#discussion_r526361289 ## File path: core/src/main/scala/kafka/network/SocketServer.scala ## @@ -1324,7 +1401,59 @@ class ConnectionQuotas(config: KafkaConfig, time: Time,

[GitHub] [kafka] lbradstreet commented on a change in pull request #9526: KAFKA-10525: Emit JSONs with new auto-generated schema

2020-11-18 Thread GitBox
lbradstreet commented on a change in pull request #9526: URL: https://github.com/apache/kafka/pull/9526#discussion_r526255450 ## File path: core/src/main/scala/kafka/network/RequestConvertToJson.scala ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] lbradstreet commented on a change in pull request #9526: KAFKA-10525: Emit JSONs with new auto-generated schema

2020-11-18 Thread GitBox
lbradstreet commented on a change in pull request #9526: URL: https://github.com/apache/kafka/pull/9526#discussion_r526265466 ## File path: core/src/main/scala/kafka/network/RequestConvertToJson.scala ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] vamossagar12 commented on a change in pull request #9539: KAFKA-10634: Adding LeaderId to Voters list in LeaderChangeMessage

2020-11-18 Thread GitBox
vamossagar12 commented on a change in pull request #9539: URL: https://github.com/apache/kafka/pull/9539#discussion_r526264880 ## File path: raft/src/test/java/org/apache/kafka/raft/RaftClientTestContext.java ## @@ -709,6 +709,9 @@ static void verifyLeaderChangeMessage(

[GitHub] [kafka] hachikuji commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526309208 ## File path: clients/src/main/resources/common/message/ProduceRequest.json ## @@ -33,21 +33,21 @@ "validVersions": "0-8", "flexibleVersions":

[GitHub] [kafka] chia7712 commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526314648 ## File path: clients/src/main/resources/common/message/ProduceRequest.json ## @@ -33,21 +33,21 @@ "validVersions": "0-8", "flexibleVersions":

[GitHub] [kafka] dajac commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526373121 ## File path: clients/src/main/java/org/apache/kafka/common/requests/OffsetsForLeaderEpochRequest.java ## @@ -51,169 +47,120 @@ */ public static

[GitHub] [kafka] chia7712 opened a new pull request #9612: MINOR: add sudo to travis.yml to run ducktape

2020-11-18 Thread GitBox
chia7712 opened a new pull request #9612: URL: https://github.com/apache/kafka/pull/9612 ``` Traceback (most recent call last): 3157 File "/usr/local/bin/ducktape", line 8, in 3158sys.exit(main()) 3159 File

[GitHub] [kafka] hachikuji commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526252595 ## File path: clients/src/main/resources/common/message/ProduceRequest.json ## @@ -33,21 +33,21 @@ "validVersions": "0-8", "flexibleVersions":

[GitHub] [kafka] hachikuji commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526260184 ## File path: clients/src/main/resources/common/message/ProduceRequest.json ## @@ -33,21 +33,21 @@ "validVersions": "0-8", "flexibleVersions":

[GitHub] [kafka] vamossagar12 commented on pull request #9539: KAFKA-10634: Adding LeaderId to Voters list in LeaderChangeMessage

2020-11-18 Thread GitBox
vamossagar12 commented on pull request #9539: URL: https://github.com/apache/kafka/pull/9539#issuecomment-729826627 > Thanks for the patch. Left a few minor comments. Thanks @hachikuji , i have replied on the comments..

[GitHub] [kafka] chia7712 commented on a change in pull request #9516: MINOR: make Send and Receive work with TransportLayer rather than Gat…

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9516: URL: https://github.com/apache/kafka/pull/9516#discussion_r526282918 ## File path: clients/src/test/java/org/apache/kafka/common/network/TransportLayerUtils.java ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] hachikuji commented on a change in pull request #9539: KAFKA-10634: Adding LeaderId to Voters list in LeaderChangeMessage

2020-11-18 Thread GitBox
hachikuji commented on a change in pull request #9539: URL: https://github.com/apache/kafka/pull/9539#discussion_r526283540 ## File path: raft/src/test/java/org/apache/kafka/raft/RaftClientTestContext.java ## @@ -709,6 +709,9 @@ static void verifyLeaderChangeMessage(

[jira] [Updated] (KAFKA-10738) kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or corretto 11

2020-11-18 Thread Duke Pham (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duke Pham updated KAFKA-10738: -- Description: h5. kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or

[GitHub] [kafka] wcarlson5 opened a new pull request #9615: KAFKA-10500: Add thread option

2020-11-18 Thread GitBox
wcarlson5 opened a new pull request #9615: URL: https://github.com/apache/kafka/pull/9615 Can add stream threads now replace https://github.com/apache/kafka/pull/9581 after rebase ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation

[GitHub] [kafka] gardnervickers removed a comment on pull request #9601: KAFKA-10729: Bump remaining RPC's to use tagged fields.

2020-11-18 Thread GitBox
gardnervickers removed a comment on pull request #9601: URL: https://github.com/apache/kafka/pull/9601#issuecomment-729796082 I realize now that we have several requests which have not been converted to use the generated RPC's. It appears we need to do that to support tagged fields.

[GitHub] [kafka] gardnervickers commented on pull request #9601: KAFKA-10729: Bump remaining RPC's to use tagged fields.

2020-11-18 Thread GitBox
gardnervickers commented on pull request #9601: URL: https://github.com/apache/kafka/pull/9601#issuecomment-729887376 OffsetForLeaderEpoch and Produce are not yet versioned RPCs, but will be once #9401 and #9547 are merged. I've removed the taggedFields bump for these RPC's. We can bump

[GitHub] [kafka] gardnervickers edited a comment on pull request #9601: KAFKA-10729: Bump remaining RPC's to use tagged fields.

2020-11-18 Thread GitBox
gardnervickers edited a comment on pull request #9601: URL: https://github.com/apache/kafka/pull/9601#issuecomment-729887376 OffsetForLeaderEpoch and Produce are not yet generated RPCs, but will be once #9401 and #9547 are merged. I've removed the taggedFields bump for these RPC's. We can

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9614: KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads

2020-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #9614: URL: https://github.com/apache/kafka/pull/9614#discussion_r526347359 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -1070,6 +1070,10 @@ private Thread shutdownHelper(final boolean

[GitHub] [kafka] dajac commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526368983 ## File path: clients/src/main/resources/common/message/ProduceRequest.json ## @@ -33,21 +33,21 @@ "validVersions": "0-8", "flexibleVersions": "none",

[jira] [Commented] (KAFKA-10091) Improve task idling

2020-11-18 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234967#comment-17234967 ] John Roesler commented on KAFKA-10091: -- FYI to all watchers, I've begun to draft a KIP:

[GitHub] [kafka] abbccdda opened a new pull request #9613: Cherry-pick KAFKA-10687 to 2.7

2020-11-18 Thread GitBox
abbccdda opened a new pull request #9613: URL: https://github.com/apache/kafka/pull/9613 …(#9569) Ensures INVALID_PRODUCER_EPOCH recognizable from client side, and ensure the ProduceResponse always uses the old error code as INVALID_PRODUCER_EPOCH. Reviewers: Guozhang Wang

[GitHub] [kafka] hachikuji commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526281357 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetsForLeaderEpochClient.java ## @@ -61,67 +77,76 @@ protected

[GitHub] [kafka] lct45 opened a new pull request #9614: KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads

2020-11-18 Thread GitBox
lct45 opened a new pull request #9614: URL: https://github.com/apache/kafka/pull/9614 Per [KIP-663](https://cwiki.apache.org/confluence/display/KAFKA/KIP-663%3A+API+to+Start+and+Shut+Down+Stream+Threads), adding a metric to record the failed streams threads over the life of a client.

[jira] [Commented] (KAFKA-10734) Speedup the processing of LeaderAndIsr request

2020-11-18 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234891#comment-17234891 ] Jun Rao commented on KAFKA-10734: - [~luwang], thanks for the jira. In practice, if n is large, m could

[GitHub] [kafka] gardnervickers commented on pull request #9601: KAFKA-10729: Bump remaining RPC's to use tagged fields.

2020-11-18 Thread GitBox
gardnervickers commented on pull request #9601: URL: https://github.com/apache/kafka/pull/9601#issuecomment-729796082 I realize now that we have several requests which have not been converted to use the generated RPC's. It appears we need to do that to support tagged fields.

[GitHub] [kafka] chia7712 commented on a change in pull request #9516: MINOR: make Send and Receive work with TransportLayer rather than Gat…

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9516: URL: https://github.com/apache/kafka/pull/9516#discussion_r526233758 ## File path: clients/src/test/java/org/apache/kafka/common/network/TransportLayerUtils.java ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] dajac commented on a change in pull request #9526: KAFKA-10525: Emit JSONs with new auto-generated schema

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9526: URL: https://github.com/apache/kafka/pull/9526#discussion_r526258381 ## File path: core/src/main/scala/kafka/network/RequestConvertToJson.scala ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] lct45 commented on pull request #9614: KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads

2020-11-18 Thread GitBox
lct45 commented on pull request #9614: URL: https://github.com/apache/kafka/pull/9614#issuecomment-729864151 @wcarlson5 @cadonna for initial review This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (KAFKA-10738) kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or corretto 11

2020-11-18 Thread Duke Pham (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duke Pham updated KAFKA-10738: -- Description: h5. kafka version 2.5.0 on Windows Cygwin could not started when using openjdk or

[jira] [Commented] (KAFKA-10114) Kafka producer stuck after broker crash

2020-11-18 Thread Kshitij Wadhwa (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234954#comment-17234954 ] Kshitij Wadhwa commented on KAFKA-10114: We are still seeing this issue with version 2.6.0. Our

[GitHub] [kafka] vvcephei opened a new pull request #9616: POC: fix task idling

2020-11-18 Thread GitBox
vvcephei opened a new pull request #9616: URL: https://github.com/apache/kafka/pull/9616 POC for: https://issues.apache.org/jira/browse/KAFKA-10091 https://cwiki.apache.org/confluence/x/JSXZCQ Please don't bother reviewing this. I did enough of the implementation to

[GitHub] [kafka] dajac commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526373445 ## File path: clients/src/main/java/org/apache/kafka/common/requests/OffsetsForLeaderEpochResponse.java ## @@ -51,133 +41,82 @@ * - {@link

[GitHub] [kafka] dajac commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526074777 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java ## @@ -560,13 +562,24 @@ private void

[GitHub] [kafka] dajac commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526204179 ## File path: clients/src/main/java/org/apache/kafka/common/requests/OffsetsForLeaderEpochRequest.java ## @@ -51,169 +47,120 @@ */ public static

[GitHub] [kafka] dajac commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526179984 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java ## @@ -580,7 +580,6 @@ synchronized void

[GitHub] [kafka] chia7712 merged pull request #9610: MINOR: remove "gradle wrapper" from travis.yml

2020-11-18 Thread GitBox
chia7712 merged pull request #9610: URL: https://github.com/apache/kafka/pull/9610 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] chia7712 merged pull request #6319: MINOR: Unifies implementations for commitSync in Kafka Consumer

2020-11-18 Thread GitBox
chia7712 merged pull request #6319: URL: https://github.com/apache/kafka/pull/6319 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] dajac commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526178616 ## File path: clients/src/test/java/org/apache/kafka/common/requests/RequestResponseTest.java ## @@ -1730,7 +1768,6 @@ private DeleteTopicsResponse

[GitHub] [kafka] ijuma commented on a change in pull request #9516: MINOR: make Send and Receive work with TransportLayer rather than Gat…

2020-11-18 Thread GitBox
ijuma commented on a change in pull request #9516: URL: https://github.com/apache/kafka/pull/9516#discussion_r526178614 ## File path: clients/src/test/java/org/apache/kafka/common/network/TransportLayerUtils.java ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] chia7712 commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526187166 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java ## @@ -580,7 +580,6 @@ synchronized void

[GitHub] [kafka] dajac commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526207135 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetsForLeaderEpochClient.java ## @@ -61,67 +77,76 @@ protected

[GitHub] [kafka] chia7712 commented on a change in pull request #9516: MINOR: make Send and Receive work with TransportLayer rather than Gat…

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9516: URL: https://github.com/apache/kafka/pull/9516#discussion_r526195831 ## File path: clients/src/test/java/org/apache/kafka/common/network/TransportLayerUtils.java ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] lbradstreet commented on pull request #9519: KAFKA-10650: Use Murmur3 instead of MD5 in SkimpyOffsetMap

2020-11-18 Thread GitBox
lbradstreet commented on pull request #9519: URL: https://github.com/apache/kafka/pull/9519#issuecomment-729745702 @viktorsomogyi I think a hash collision for the full sized hash will mean that a message is incorrectly cleaned. Are you measuring the collision rate in the probes? I am less

[GitHub] [kafka] chia7712 commented on a change in pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
chia7712 commented on a change in pull request #9401: URL: https://github.com/apache/kafka/pull/9401#discussion_r526190510 ## File path: clients/src/test/java/org/apache/kafka/common/requests/RequestResponseTest.java ## @@ -1730,7 +1768,6 @@ private DeleteTopicsResponse

[GitHub] [kafka] chia7712 commented on pull request #9610: MINOR: remove "gradle wrapper" from travis.yml

2020-11-18 Thread GitBox
chia7712 commented on pull request #9610: URL: https://github.com/apache/kafka/pull/9610#issuecomment-729778814 @ijuma Thanks for approving! Merge it to trunk. Will file another PR to handle travis error. This is an

[GitHub] [kafka] C0urante commented on pull request #9599: MINOR: Include connector name in error message

2020-11-18 Thread GitBox
C0urante commented on pull request #9599: URL: https://github.com/apache/kafka/pull/9599#issuecomment-729759979 Thanks @chia7712! This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] ijuma commented on a change in pull request #9516: MINOR: make Send and Receive work with TransportLayer rather than Gat…

2020-11-18 Thread GitBox
ijuma commented on a change in pull request #9516: URL: https://github.com/apache/kafka/pull/9516#discussion_r526203586 ## File path: clients/src/test/java/org/apache/kafka/common/network/TransportLayerUtils.java ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] dajac commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526207135 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetsForLeaderEpochClient.java ## @@ -61,67 +77,76 @@ protected

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9487: KAFKA-9331: Add a streams specific uncaught exception handler

2020-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #9487: URL: https://github.com/apache/kafka/pull/9487#discussion_r526211409 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -932,56 +1028,62 @@ public synchronized boolean close(final long

[jira] [Commented] (KAFKA-10741) Kafka ConsumerProperties.addDeserializerToConfig breaks hirarchical property resolution.

2020-11-18 Thread Michael (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234996#comment-17234996 ] Michael commented on KAFKA-10741: - I think, since in the transition from _ConsumerConfig_ to 

[jira] [Commented] (KAFKA-10114) Kafka producer stuck after broker crash

2020-11-18 Thread Tim Fox (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234997#comment-17234997 ] Tim Fox commented on KAFKA-10114: - Hi Kshitij - can you get a stack dump for when this occurs with

[GitHub] [kafka] hachikuji opened a new pull request #9619: MINOR: Reduce sends created by `SendBuilder`

2020-11-18 Thread GitBox
hachikuji opened a new pull request #9619: URL: https://github.com/apache/kafka/pull/9619 In #9401, I observed some strange latency behavior when testing locally (on macos). The behavior seemed to be caused by slightly different write behavior as a result of the new `SendBuilder` class.

[GitHub] [kafka] ableegoldman commented on a change in pull request #9487: KAFKA-9331: Add a streams specific uncaught exception handler

2020-11-18 Thread GitBox
ableegoldman commented on a change in pull request #9487: URL: https://github.com/apache/kafka/pull/9487#discussion_r526477258 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -932,56 +1028,62 @@ public synchronized boolean close(final long

[jira] [Updated] (KAFKA-10015) React Smartly to Unexpected Errors on Stream Threads

2020-11-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-10015: Labels: kip (was: needs-kip) > React Smartly to Unexpected Errors on Stream Threads >

[jira] [Updated] (KAFKA-10015) React Smartly to Unexpected Errors on Stream Threads

2020-11-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-10015: Description: Currently, if an unexpected error occurs on a stream thread, the stream

[jira] [Created] (KAFKA-10740) ReplicaFetcherThread should use OffsetForLeaderPartitionResult directly

2020-11-18 Thread David Jacot (Jira)
David Jacot created KAFKA-10740: --- Summary: ReplicaFetcherThread should use OffsetForLeaderPartitionResult directly Key: KAFKA-10740 URL: https://issues.apache.org/jira/browse/KAFKA-10740 Project: Kafka

[jira] [Created] (KAFKA-10741) Kafka ConsumerProperties.addDeserializerToConfig breaks hirarchical property resolution.

2020-11-18 Thread Michael (Jira)
Michael created KAFKA-10741: --- Summary: Kafka ConsumerProperties.addDeserializerToConfig breaks hirarchical property resolution. Key: KAFKA-10741 URL: https://issues.apache.org/jira/browse/KAFKA-10741

[GitHub] [kafka] hachikuji opened a new pull request #9617: MINOR: Factor out common response parsing logic

2020-11-18 Thread GitBox
hachikuji opened a new pull request #9617: URL: https://github.com/apache/kafka/pull/9617 This patch factors out some common parsing logic from `NetworkClient.parseResponse` and `AbstractResponse.parseResponse`. As a result of this refactor, we are now verifying the correlationId in

[GitHub] [kafka] bbejeck merged pull request #9613: Cherry-pick KAFKA-10687 to 2.7

2020-11-18 Thread GitBox
bbejeck merged pull request #9613: URL: https://github.com/apache/kafka/pull/9613 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] hachikuji commented on pull request #9619: MINOR: Reduce sends created by `SendBuilder`

2020-11-18 Thread GitBox
hachikuji commented on pull request #9619: URL: https://github.com/apache/kafka/pull/9619#issuecomment-730001511 cc @chia7712 @dajac This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (KAFKA-10500) Add API to Start and Stop Stream Threads

2020-11-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-10500: Description: Currently, there is no possibility in Kafka Streams to increase or decrease

[GitHub] [kafka] hachikuji commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526509285 ## File path: clients/src/main/java/org/apache/kafka/common/requests/OffsetsForLeaderEpochRequest.java ## @@ -51,169 +47,120 @@ */ public

[GitHub] [kafka] mjsax merged pull request #9570: KAFKA-9274: Handle TimeoutException on commit

2020-11-18 Thread GitBox
mjsax merged pull request #9570: URL: https://github.com/apache/kafka/pull/9570 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] dajac commented on a change in pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on a change in pull request #9547: URL: https://github.com/apache/kafka/pull/9547#discussion_r526383138 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetsForLeaderEpochClient.java ## @@ -61,67 +77,76 @@ protected

[GitHub] [kafka] dajac commented on pull request #9547: KAFKA-9630; Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-11-18 Thread GitBox
dajac commented on pull request #9547: URL: https://github.com/apache/kafka/pull/9547#issuecomment-729926766 @chia7712 @hachikuji Thanks for your comments. I have addressed them. Could you have another quick look? This is

[GitHub] [kafka] hachikuji commented on pull request #9617: MINOR: Factor out common response parsing logic

2020-11-18 Thread GitBox
hachikuji commented on pull request #9617: URL: https://github.com/apache/kafka/pull/9617#issuecomment-729947146 This is a follow-up from #9563. cc @chia7712 @abbccdda While I was working on this patch, I noticed this: https://issues.apache.org/jira/browse/KAFKA-10743. In this

[GitHub] [kafka] hachikuji merged pull request #9401: KAFKA-9628 Replace Produce request/response with automated protocol

2020-11-18 Thread GitBox
hachikuji merged pull request #9401: URL: https://github.com/apache/kafka/pull/9401 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] mjsax opened a new pull request #9618: MINOR: change default TX timeout only if EOS is enabled

2020-11-18 Thread GitBox
mjsax opened a new pull request #9618: URL: https://github.com/apache/kafka/pull/9618 Call for review @abbccdda This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] rajinisivaram merged pull request #9473: KAFKA-10545: Create topic IDs in ZooKeeper and Controller

2020-11-18 Thread GitBox
rajinisivaram merged pull request #9473: URL: https://github.com/apache/kafka/pull/9473 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (KAFKA-6943) Have option to shutdown KS cleanly if any threads crashes, or if all threads crash

2020-11-18 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-6943: -- Fix Version/s: 2.8.0 > Have option to shutdown KS cleanly if any threads

[jira] [Resolved] (KAFKA-6943) Have option to shutdown KS cleanly if any threads crashes, or if all threads crash

2020-11-18 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-6943. --- Resolution: Fixed > Have option to shutdown KS cleanly if any threads

[jira] [Created] (KAFKA-10739) KafkaApis#handleOffsetForLeaderEpochRequest should use OffsetForLeaderPartition directly

2020-11-18 Thread David Jacot (Jira)
David Jacot created KAFKA-10739: --- Summary: KafkaApis#handleOffsetForLeaderEpochRequest should use OffsetForLeaderPartition directly Key: KAFKA-10739 URL: https://issues.apache.org/jira/browse/KAFKA-10739

  1   2   >