[GitHub] [kafka] kkonstantine commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
kkonstantine commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570747258 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/util/SharedTopicAdminTest.java ## @@ -0,0 +1,118 @@ +/* + * Licensed to the

[GitHub] [kafka] kkonstantine commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
kkonstantine commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570728906 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/util/SharedTopicAdmin.java ## @@ -0,0 +1,145 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] wcarlson5 commented on pull request #10060: KAFKA-10716: persist UUID in state directory for stable processId across restarts - 2.7

2021-02-04 Thread GitBox
wcarlson5 commented on pull request #10060: URL: https://github.com/apache/kafka/pull/10060#issuecomment-773820050 +1 from me. Thanks for the pr This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] hachikuji commented on a change in pull request #10045: MINOR: Allow KafkaApis to be configured for Raft controller quorums

2021-02-04 Thread GitBox
hachikuji commented on a change in pull request #10045: URL: https://github.com/apache/kafka/pull/10045#discussion_r570730096 ## File path: core/src/main/scala/kafka/server/MetadataSupport.scala ## @@ -0,0 +1,109 @@ +/** + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] kkonstantine commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
kkonstantine commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570732565 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/distributed/DistributedHerder.java ## @@ -185,16 +188,33 @@

[GitHub] [kafka] hachikuji commented on a change in pull request #10045: MINOR: Allow KafkaApis to be configured for Raft controller quorums

2021-02-04 Thread GitBox
hachikuji commented on a change in pull request #10045: URL: https://github.com/apache/kafka/pull/10045#discussion_r570727037 ## File path: core/src/main/scala/kafka/server/MetadataSupport.scala ## @@ -0,0 +1,109 @@ +/** + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] bob-barrett commented on pull request #10065: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-02-04 Thread GitBox
bob-barrett commented on pull request #10065: URL: https://github.com/apache/kafka/pull/10065#issuecomment-773800777 This is a backport of 131d475 to 2.4. As with #10061, the conflicts were due to the missing connection timeout config, which was added in 2.7, and didn't meaningfully

[GitHub] [kafka] bob-barrett commented on pull request #10067: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-02-04 Thread GitBox
bob-barrett commented on pull request #10067: URL: https://github.com/apache/kafka/pull/10067#issuecomment-773800834 This is a backport of 131d475 to 2.3. As with #10061, the conflicts were due to the missing connection timeout config, which was added in 2.7, and didn't meaningfully

[GitHub] [kafka] bob-barrett opened a new pull request #10067: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-02-04 Thread GitBox
bob-barrett opened a new pull request #10067: URL: https://github.com/apache/kafka/pull/10067 This patch changes the NetworkClient behavior to resolve the target node's hostname after disconnecting from an established connection, rather than waiting until the previously-resolved addresses

[GitHub] [kafka] mjsax commented on a change in pull request #9744: KAFKA-10062: Add a method to retrieve the current timestamp as known by the Streams app

2021-02-04 Thread GitBox
mjsax commented on a change in pull request #9744: URL: https://github.com/apache/kafka/pull/9744#discussion_r570716520 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractProcessorContext.java ## @@ -45,7 +45,6 @@ private boolean

[GitHub] [kafka] mjsax commented on a change in pull request #9744: KAFKA-10062: Add a method to retrieve the current timestamp as known by the Streams app

2021-02-04 Thread GitBox
mjsax commented on a change in pull request #9744: URL: https://github.com/apache/kafka/pull/9744#discussion_r570716520 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractProcessorContext.java ## @@ -45,7 +45,6 @@ private boolean

[GitHub] [kafka] hachikuji opened a new pull request #10066: KAFKA-12278; Ensure exposed api versions are consistent within listener scopes

2021-02-04 Thread GitBox
hachikuji opened a new pull request #10066: URL: https://github.com/apache/kafka/pull/10066 With KIP-500, we have more complex requirements on API accessibility. Previously all APIs were accessible on every listener exposed by the broker, but now that is no longer true. For example:

[GitHub] [kafka] mjsax merged pull request #10048: MINOR: add docs for KIP-680

2021-02-04 Thread GitBox
mjsax merged pull request #10048: URL: https://github.com/apache/kafka/pull/10048 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] mjsax commented on pull request #10000: KAFKA-9274: handle TimeoutException on task reset

2021-02-04 Thread GitBox
mjsax commented on pull request #1: URL: https://github.com/apache/kafka/pull/1#issuecomment-773774753 Updated this PR. This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] mjsax commented on a change in pull request #10048: MINOR: add docs for KIP-680

2021-02-04 Thread GitBox
mjsax commented on a change in pull request #10048: URL: https://github.com/apache/kafka/pull/10048#discussion_r570698424 ## File path: docs/streams/upgrade-guide.html ## @@ -121,6 +121,12 @@ Streams API the constructor, such as when using the console consumer.

[GitHub] [kafka] mjsax commented on a change in pull request #10048: MINOR: add docs for KIP-680

2021-02-04 Thread GitBox
mjsax commented on a change in pull request #10048: URL: https://github.com/apache/kafka/pull/10048#discussion_r570698397 ## File path: docs/streams/upgrade-guide.html ## @@ -121,6 +121,12 @@ Streams API the constructor, such as when using the console consumer.

[GitHub] [kafka] JimGalasyn commented on a change in pull request #10048: MINOR: add docs for KIP-680

2021-02-04 Thread GitBox
JimGalasyn commented on a change in pull request #10048: URL: https://github.com/apache/kafka/pull/10048#discussion_r570687920 ## File path: docs/streams/upgrade-guide.html ## @@ -121,6 +121,12 @@ Streams API the constructor, such as when using the console consumer.

[GitHub] [kafka] mjsax commented on a change in pull request #10000: KAFKA-9274: handle TimeoutException on task reset

2021-02-04 Thread GitBox
mjsax commented on a change in pull request #1: URL: https://github.com/apache/kafka/pull/1#discussion_r570695899 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -227,6 +230,27 @@ public void initializeIfNeeded()

[GitHub] [kafka] mjsax commented on a change in pull request #10000: KAFKA-9274: handle TimeoutException on task reset

2021-02-04 Thread GitBox
mjsax commented on a change in pull request #1: URL: https://github.com/apache/kafka/pull/1#discussion_r570691793 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -227,6 +230,27 @@ public void initializeIfNeeded()

[GitHub] [kafka] mjsax merged pull request #9997: KAFKA-9274: Add timeout handling for `StreamPartitioner`

2021-02-04 Thread GitBox
mjsax merged pull request #9997: URL: https://github.com/apache/kafka/pull/9997 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (KAFKA-7540) Flaky Test ConsumerBounceTest#testClose

2021-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279291#comment-17279291 ] Matthias J. Sax commented on KAFKA-7540:

[GitHub] [kafka] JimGalasyn commented on a change in pull request #10048: MINOR: add docs for KIP-680

2021-02-04 Thread GitBox
JimGalasyn commented on a change in pull request #10048: URL: https://github.com/apache/kafka/pull/10048#discussion_r570687920 ## File path: docs/streams/upgrade-guide.html ## @@ -121,6 +121,12 @@ Streams API the constructor, such as when using the console consumer.

[GitHub] [kafka] JimGalasyn commented on a change in pull request #10048: MINOR: add docs for KIP-680

2021-02-04 Thread GitBox
JimGalasyn commented on a change in pull request #10048: URL: https://github.com/apache/kafka/pull/10048#discussion_r570687710 ## File path: docs/streams/upgrade-guide.html ## @@ -121,6 +121,12 @@ Streams API the constructor, such as when using the console consumer.

[GitHub] [kafka] mjsax merged pull request #10044: MINOR: Word count should account for extra whitespaces between words

2021-02-04 Thread GitBox
mjsax merged pull request #10044: URL: https://github.com/apache/kafka/pull/10044 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (KAFKA-12283) Flaky Test RebalanceSourceConnectorsIntegrationTest#testMultipleWorkersRejoining

2021-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279288#comment-17279288 ] Matthias J. Sax commented on KAFKA-12283: - Failed again: 

[GitHub] [kafka] mjsax merged pull request #10046: MINOR: Extends RocksDB docs

2021-02-04 Thread GitBox
mjsax merged pull request #10046: URL: https://github.com/apache/kafka/pull/10046 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] mjsax commented on a change in pull request #10046: MINOR: Extends RocksDB docs

2021-02-04 Thread GitBox
mjsax commented on a change in pull request #10046: URL: https://github.com/apache/kafka/pull/10046#discussion_r570683354 ## File path: docs/streams/developer-guide/memory-mgmt.html ## @@ -168,7 +168,15 @@ RocksDB Each instance of RocksDB allocates off-heap

[GitHub] [kafka] bob-barrett opened a new pull request #10065: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-02-04 Thread GitBox
bob-barrett opened a new pull request #10065: URL: https://github.com/apache/kafka/pull/10065 This patch changes the NetworkClient behavior to resolve the target node's hostname after disconnecting from an established connection, rather than waiting until the previously-resolved addresses

[GitHub] [kafka] bob-barrett commented on pull request #10064: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-02-04 Thread GitBox
bob-barrett commented on pull request #10064: URL: https://github.com/apache/kafka/pull/10064#issuecomment-773736235 This is a backport of 131d4753cfed65ed6dee0a8c754765c97c3d513f to 2.5. As with https://github.com/apache/kafka/pull/10061, the conflicts were due to the missing connection

[GitHub] [kafka] bob-barrett opened a new pull request #10064: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-02-04 Thread GitBox
bob-barrett opened a new pull request #10064: URL: https://github.com/apache/kafka/pull/10064 This patch changes the NetworkClient behavior to resolve the target node's hostname after disconnecting from an established connection, rather than waiting until the previously-resolved addresses

[GitHub] [kafka] jsancio opened a new pull request #10063: KAFKA-12258: Add support for splitting appending records

2021-02-04 Thread GitBox
jsancio opened a new pull request #10063: URL: https://github.com/apache/kafka/pull/10063 1. Type `BatchAccumulator`. Add support for appending records into one or more batches. 2. Type `RaftClient`. Rename `scheduleAppend` to `scheduleAtomicAppend`. 3. Type `RaftClient`. Add a new

[GitHub] [kafka] rhauch commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
rhauch commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570657028 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/util/SharedTopicAdmin.java ## @@ -0,0 +1,145 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] rhauch commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
rhauch commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570655008 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/util/SharedTopicAdminTest.java ## @@ -0,0 +1,118 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-02-04 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r570654953 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1370,55 +1345,164 @@ class KafkaApis(val requestChannel: RequestChannel,

[jira] [Created] (KAFKA-12295) Shallow Mirroring

2021-02-04 Thread Henry Cai (Jira)
Henry Cai created KAFKA-12295: - Summary: Shallow Mirroring Key: KAFKA-12295 URL: https://issues.apache.org/jira/browse/KAFKA-12295 Project: Kafka Issue Type: Improvement Components:

[GitHub] [kafka] rhauch commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
rhauch commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570652791 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/util/TopicAdminTest.java ## @@ -457,17 +465,273 @@ public void

[GitHub] [kafka] kkonstantine merged pull request #10053: KAFKA-10834: Remove redundant type casts in Connect

2021-02-04 Thread GitBox
kkonstantine merged pull request #10053: URL: https://github.com/apache/kafka/pull/10053 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] kkonstantine merged pull request #9726: KAFKA-10833: Expose task configurations in Connect REST API (KIP-661)

2021-02-04 Thread GitBox
kkonstantine merged pull request #9726: URL: https://github.com/apache/kafka/pull/9726 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] kkonstantine commented on pull request #9726: KAFKA-10833: Expose task configurations in Connect REST API

2021-02-04 Thread GitBox
kkonstantine commented on pull request #9726: URL: https://github.com/apache/kafka/pull/9726#issuecomment-773706451 One failure on an unrelated flaky test Merging to coordinate merge with another PR. Thanks @mimaison !

[GitHub] [kafka] rhauch commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
rhauch commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570648556 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/distributed/DistributedHerder.java ## @@ -185,16 +188,33 @@ private

[GitHub] [kafka] mjsax commented on pull request #9107: KAFKA-5488: Add type-safe split() operator

2021-02-04 Thread GitBox
mjsax commented on pull request #9107: URL: https://github.com/apache/kafka/pull/9107#issuecomment-773692994 Merged to `trunk`. Congrats for getting this into the 2.8.0 release @inponomarev -- great work! This is an

[GitHub] [kafka] mjsax merged pull request #9107: KAFKA-5488: Add type-safe split() operator

2021-02-04 Thread GitBox
mjsax merged pull request #9107: URL: https://github.com/apache/kafka/pull/9107 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] rodesai commented on a change in pull request #10046: MINOR: Extends RocksDB docs

2021-02-04 Thread GitBox
rodesai commented on a change in pull request #10046: URL: https://github.com/apache/kafka/pull/10046#discussion_r570627385 ## File path: docs/streams/developer-guide/memory-mgmt.html ## @@ -168,7 +168,15 @@ RocksDB Each instance of RocksDB allocates off-heap

[GitHub] [kafka] gardnervickers closed pull request #10058: [2.5] Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
gardnervickers closed pull request #10058: URL: https://github.com/apache/kafka/pull/10058 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] gardnervickers closed pull request #10057: [2.4] Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
gardnervickers closed pull request #10057: URL: https://github.com/apache/kafka/pull/10057 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] gardnervickers closed pull request #10055: [2.3] Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
gardnervickers closed pull request #10055: URL: https://github.com/apache/kafka/pull/10055 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] bob-barrett commented on pull request #10055: [2.3] Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
bob-barrett commented on pull request #10055: URL: https://github.com/apache/kafka/pull/10055#issuecomment-773678966 @ableegoldman the 2.6 backport is https://github.com/apache/kafka/pull/10061. This is an automated

[GitHub] [kafka] szpak opened a new pull request #10062: MINOR: Add performAndClose default method in KeyValueIterator

2021-02-04 Thread GitBox
szpak opened a new pull request #10062: URL: https://github.com/apache/kafka/pull/10062 That method intends to increase a chance to have KeyValueIterator closed after usage, by providing a convenient performAndClose() default method which executes a given operation and guarantee to

[GitHub] [kafka] bob-barrett commented on pull request #10061: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-02-04 Thread GitBox
bob-barrett commented on pull request #10061: URL: https://github.com/apache/kafka/pull/10061#issuecomment-773678032 @dajac This is the backport of https://github.com/apache/kafka/commit/131d4753cfed65ed6dee0a8c754765c97c3d513f. The conflicts were because the connection timeout settings

[GitHub] [kafka] bob-barrett opened a new pull request #10061: KAFKA-12193: Re-resolve IPs after a client disconnects (#9902)

2021-02-04 Thread GitBox
bob-barrett opened a new pull request #10061: URL: https://github.com/apache/kafka/pull/10061 This patch changes the NetworkClient behavior to resolve the target node's hostname after disconnecting from an established connection, rather than waiting until the previously-resolved addresses

[GitHub] [kafka] gardnervickers commented on pull request #10055: [2.3] Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
gardnervickers commented on pull request #10055: URL: https://github.com/apache/kafka/pull/10055#issuecomment-773675865 @ableegoldman I believe @bob-barrett was working on a PR against 2.6. This is an automated message from

[GitHub] [kafka] ableegoldman commented on pull request #10055: [2.3] Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
ableegoldman commented on pull request #10055: URL: https://github.com/apache/kafka/pull/10055#issuecomment-773675180 Hey @gardnervickers , do you have plans to open a PR against 2.6 as well? Just checking in since it seems this fix has been ported to everything except 2.6 so far and I

[GitHub] [kafka] ableegoldman opened a new pull request #10060: KAFKA-10716: persist UUID in state directory for stable processId across restarts - 2.7

2021-02-04 Thread GitBox
ableegoldman opened a new pull request #10060: URL: https://github.com/apache/kafka/pull/10060 Port of https://github.com/apache/kafka/pull/9978 to the 2.7 branch This is an automated message from the Apache Git Service. To

[GitHub] [kafka] dpoldrugo commented on pull request #10059: KAFKA-8562: SaslChannelBuilder - avoid (reverse) DNS lookup while building underlying SslTransportLayer

2021-02-04 Thread GitBox
dpoldrugo commented on pull request #10059: URL: https://github.com/apache/kafka/pull/10059#issuecomment-773663807 @ijuma, @omkreddy, @rajinisivaram could you take a look? This is an automated message from the Apache Git

[GitHub] [kafka] rohitrmd commented on a change in pull request #9744: KAFKA-10062: Add a method to retrieve the current timestamp as known by the Streams app

2021-02-04 Thread GitBox
rohitrmd commented on a change in pull request #9744: URL: https://github.com/apache/kafka/pull/9744#discussion_r570605728 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractProcessorContext.java ## @@ -45,7 +45,6 @@ private boolean

[GitHub] [kafka] kkonstantine commented on a change in pull request #9780: KAFKA-10021: Changed Kafka backing stores to use shared admin client to get end offsets and create topics

2021-02-04 Thread GitBox
kkonstantine commented on a change in pull request #9780: URL: https://github.com/apache/kafka/pull/9780#discussion_r570584036 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/distributed/DistributedHerder.java ## @@ -209,7 +229,8 @@ public

[GitHub] [kafka] cmccabe merged pull request #10030: MINOR: Add KafkaEventQueue

2021-02-04 Thread GitBox
cmccabe merged pull request #10030: URL: https://github.com/apache/kafka/pull/10030 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] cmccabe commented on pull request #10030: MINOR: Add KafkaEventQueue

2021-02-04 Thread GitBox
cmccabe commented on pull request #10030: URL: https://github.com/apache/kafka/pull/10030#issuecomment-773648975 Test failure is `org.apache.kafka.connect.mirror.integration.MirrorConnectorsIntegrationSSLTest` which is not related.

[GitHub] [kafka] C0urante commented on pull request #9726: KAFKA-10833: Expose task configurations in Connect REST API

2021-02-04 Thread GitBox
C0urante commented on pull request #9726: URL: https://github.com/apache/kafka/pull/9726#issuecomment-773648389 Just ran into a situation last night where this would have been super helpful. Thanks for adding this @mimaison!

[GitHub] [kafka] kkonstantine commented on a change in pull request #9726: KAFKA-10833: Expose task configurations in Connect REST API

2021-02-04 Thread GitBox
kkonstantine commented on a change in pull request #9726: URL: https://github.com/apache/kafka/pull/9726#discussion_r570577845 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/resources/ConnectorsResource.java ## @@ -188,6 +188,16 @@ public

[GitHub] [kafka] dpoldrugo opened a new pull request #10059: KAFKA-8562: SaslChannelBuilder - avoid (reverse) DNS lookup while building underlying SslTransportLayer

2021-02-04 Thread GitBox
dpoldrugo opened a new pull request #10059: URL: https://github.com/apache/kafka/pull/10059 Description: As suggested by @omkreddy in this

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-02-04 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r570568151 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1084,24 +1087,9 @@ class KafkaApis(val requestChannel: RequestChannel,

[jira] [Updated] (KAFKA-12294) Consider using the forwarding mechanism for metadata auto topic creation

2021-02-04 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-12294: Component/s: core > Consider using the forwarding mechanism for metadata auto topic creation >

[jira] [Updated] (KAFKA-12294) Consider using the forwarding mechanism for metadata auto topic creation

2021-02-04 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-12294: Parent: (was: KAFKA-9705) Issue Type: Improvement (was: Sub-task) > Consider using

[jira] [Created] (KAFKA-12294) Consider using the forwarding mechanism for metadata auto topic creation

2021-02-04 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12294: --- Summary: Consider using the forwarding mechanism for metadata auto topic creation Key: KAFKA-12294 URL: https://issues.apache.org/jira/browse/KAFKA-12294 Project:

[GitHub] [kafka] gardnervickers opened a new pull request #10058: [2.5] Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
gardnervickers opened a new pull request #10058: URL: https://github.com/apache/kafka/pull/10058 The original PR was #9902 The reason for back-porting this improved test infrastructure is to address some flakes which we have seen when kafka.apache.org DNS changes, specifically in

[GitHub] [kafka] mimaison commented on a change in pull request #9726: KAFKA-10833: Expose task configurations in Connect REST API

2021-02-04 Thread GitBox
mimaison commented on a change in pull request #9726: URL: https://github.com/apache/kafka/pull/9726#discussion_r570545828 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/resources/ConnectorsResource.java ## @@ -188,6 +188,16 @@ public

[GitHub] [kafka] gardnervickers opened a new pull request #10057: Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
gardnervickers opened a new pull request #10057: URL: https://github.com/apache/kafka/pull/10057 The original PR was #9902 The reason for back-porting this improved test infrastructure is to address some flakes which we have seen when kafka.apache.org DNS changes, specifically in

[jira] [Commented] (KAFKA-12293) Remove JCenter and Bintray repositories mentions out of Gradle build (sunset is announced for those repositories)

2021-02-04 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279162#comment-17279162 ] Dejan Stojadinović commented on KAFKA-12293: Note: at the moment I am not sure about Kafka

[GitHub] [kafka] hachikuji merged pull request #10005: MINOR: Add ConfigRepository, use in Partition and KafkaApis

2021-02-04 Thread GitBox
hachikuji merged pull request #10005: URL: https://github.com/apache/kafka/pull/10005 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] dejan2609 opened a new pull request #10056: KAFKA-12293: remove JCenter and Bintray repositories mentions out of build gradle scripts (sunset is announced for those repositories)

2021-02-04 Thread GitBox
dejan2609 opened a new pull request #10056: URL: https://github.com/apache/kafka/pull/10056 Related jira ticket: https://issues.apache.org/jira/browse/KAFKA-12293 **_Remove JCenter and Bintray repositories mentions out of Gradle build (sunset is announced for those repositories)_**

[GitHub] [kafka] gardnervickers opened a new pull request #10055: Backport mocked HostResolver from KAFKA-12193 to avoid relying on kafka.apache.org for specific DNS behavior

2021-02-04 Thread GitBox
gardnervickers opened a new pull request #10055: URL: https://github.com/apache/kafka/pull/10055 The original PR was #9902 The reason for back-porting this improved test infrastructure is to address some flakes which we have seen when kafka.apache.org DNS changes, specifically in

[GitHub] [kafka] ableegoldman commented on a change in pull request #10000: KAFKA-9274: handle TimeoutException on task reset

2021-02-04 Thread GitBox
ableegoldman commented on a change in pull request #1: URL: https://github.com/apache/kafka/pull/1#discussion_r570535029 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -227,6 +230,27 @@ public void

[jira] [Created] (KAFKA-12293) Remove JCenter and Bintray repositories mentions out of Gradle build (sunset is announced for those repositories)

2021-02-04 Thread Jira
Dejan Stojadinović created KAFKA-12293: -- Summary: Remove JCenter and Bintray repositories mentions out of Gradle build (sunset is announced for those repositories) Key: KAFKA-12293 URL:

[GitHub] [kafka] chia7712 commented on pull request #10054: KAFKA-12283 Flaky Test RebalanceSourceConnectorsIntegrationTest#testM…

2021-02-04 Thread GitBox
chia7712 commented on pull request #10054: URL: https://github.com/apache/kafka/pull/10054#issuecomment-773582456 @ramesh-muthusamy Could you take a look? thanks! This is an automated message from the Apache Git Service. To

[GitHub] [kafka] chia7712 opened a new pull request #10054: KAFKA-12283 Flaky Test RebalanceSourceConnectorsIntegrationTest#testM…

2021-02-04 Thread GitBox
chia7712 opened a new pull request #10054: URL: https://github.com/apache/kafka/pull/10054 issue: https://issues.apache.org/jira/browse/KAFKA-12283 It seems to me the new tasks distribution (8, 4, 4) is valid if following conditions are true. 1. all tasks are assigned to (single)

[jira] [Assigned] (KAFKA-12284) Flaky Test MirrorConnectorsIntegrationSSLTest#testOneWayReplicationWithAutoOffsetSync

2021-02-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-12284: -- Assignee: (was: Chia-Ping Tsai) > Flaky Test >

[jira] [Assigned] (KAFKA-12283) Flaky Test RebalanceSourceConnectorsIntegrationTest#testMultipleWorkersRejoining

2021-02-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-12283: -- Assignee: Chia-Ping Tsai > Flaky Test >

[jira] [Assigned] (KAFKA-12284) Flaky Test MirrorConnectorsIntegrationSSLTest#testOneWayReplicationWithAutoOffsetSync

2021-02-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-12284: -- Assignee: Chia-Ping Tsai > Flaky Test >

[GitHub] [kafka] kkonstantine commented on a change in pull request #9726: KAFKA-10833: Expose task configurations in Connect REST API

2021-02-04 Thread GitBox
kkonstantine commented on a change in pull request #9726: URL: https://github.com/apache/kafka/pull/9726#discussion_r570505650 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/resources/ConnectorsResource.java ## @@ -188,6 +188,16 @@ public

[GitHub] [kafka] jsancio commented on a change in pull request #10045: MINOR: Allow KafkaApis to be configured for Raft controller quorums

2021-02-04 Thread GitBox
jsancio commented on a change in pull request #10045: URL: https://github.com/apache/kafka/pull/10045#discussion_r570507065 ## File path: core/src/main/scala/kafka/server/MetadataSupport.scala ## @@ -0,0 +1,109 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] mimaison commented on pull request #9726: KAFKA-10833: Expose task configurations in Connect REST API

2021-02-04 Thread GitBox
mimaison commented on pull request #9726: URL: https://github.com/apache/kafka/pull/9726#issuecomment-773567218 Thanks @kkonstantine for the feedback. I've pushed an update This is an automated message from the Apache Git

[GitHub] [kafka] ableegoldman commented on a change in pull request #10000: KAFKA-9274: handle TimeoutException on task reset

2021-02-04 Thread GitBox
ableegoldman commented on a change in pull request #1: URL: https://github.com/apache/kafka/pull/1#discussion_r570495244 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -227,6 +230,27 @@ public void

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-02-04 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r570492431 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1234,19 +1171,28 @@ class KafkaApis(val requestChannel: RequestChannel, // In

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-02-04 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r570492221 ## File path: core/src/main/scala/kafka/server/AutoTopicCreationManager.scala ## @@ -0,0 +1,139 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Commented] (KAFKA-12279) Kafka 2.7 stream app issue

2021-02-04 Thread prabhu biradar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279097#comment-17279097 ] prabhu biradar commented on KAFKA-12279: Hi Sophie Blee-Goldman,  1) This error occurs on every

[GitHub] [kafka] vvcephei commented on pull request #9107: KAFKA-5488: Add type-safe split() operator

2021-02-04 Thread GitBox
vvcephei commented on pull request #9107: URL: https://github.com/apache/kafka/pull/9107#issuecomment-773549603 Thanks, all, that Scala fix looks perfect to me. This is an automated message from the Apache Git Service. To

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-02-04 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r570480399 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1234,19 +1171,28 @@ class KafkaApis(val requestChannel: RequestChannel, // In

[GitHub] [kafka] mumrah commented on a change in pull request #10049: Refactor MetadataCache for Raft metadata

2021-02-04 Thread GitBox
mumrah commented on a change in pull request #10049: URL: https://github.com/apache/kafka/pull/10049#discussion_r570474971 ## File path: core/src/test/scala/unit/kafka/server/MetadataCacheTest.scala ## @@ -483,61 +475,4 @@ class MetadataCacheTest {

[GitHub] [kafka] mumrah commented on a change in pull request #10049: Refactor MetadataCache for Raft metadata

2021-02-04 Thread GitBox
mumrah commented on a change in pull request #10049: URL: https://github.com/apache/kafka/pull/10049#discussion_r570474971 ## File path: core/src/test/scala/unit/kafka/server/MetadataCacheTest.scala ## @@ -483,61 +475,4 @@ class MetadataCacheTest {

[GitHub] [kafka] kkonstantine commented on a change in pull request #10053: KAFKA-10834: Remove redundant type casts in Connect

2021-02-04 Thread GitBox
kkonstantine commented on a change in pull request #10053: URL: https://github.com/apache/kafka/pull/10053#discussion_r570464187 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/distributed/DistributedHerder.java ## @@ -236,7 +236,7 @@ public

[GitHub] [kafka] cmccabe merged pull request #10019: MINOR: Introduce KafkaBroker trait for use in dynamic reconfiguration

2021-02-04 Thread GitBox
cmccabe merged pull request #10019: URL: https://github.com/apache/kafka/pull/10019 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] jsancio commented on a change in pull request #10030: MINOR: Add KafkaEventQueue

2021-02-04 Thread GitBox
jsancio commented on a change in pull request #10030: URL: https://github.com/apache/kafka/pull/10030#discussion_r570367570 ## File path: metadata/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java ## @@ -0,0 +1,420 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] jsancio commented on a change in pull request #10030: MINOR: Add KafkaEventQueue

2021-02-04 Thread GitBox
jsancio commented on a change in pull request #10030: URL: https://github.com/apache/kafka/pull/10030#discussion_r570462338 ## File path: metadata/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java ## @@ -0,0 +1,420 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] junrao commented on a change in pull request #10030: MINOR: Add KafkaEventQueue

2021-02-04 Thread GitBox
junrao commented on a change in pull request #10030: URL: https://github.com/apache/kafka/pull/10030#discussion_r570453181 ## File path: metadata/src/main/java/org/apache/kafka/queue/EventQueue.java ## @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] cmccabe commented on pull request #10047: MINOR: Add ClusterTool as specified in KIP-631

2021-02-04 Thread GitBox
cmccabe commented on pull request #10047: URL: https://github.com/apache/kafka/pull/10047#issuecomment-773516371 Test failures are not related to the PR This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] mumrah commented on a change in pull request #10049: Refactor MetadataCache for Raft metadata

2021-02-04 Thread GitBox
mumrah commented on a change in pull request #10049: URL: https://github.com/apache/kafka/pull/10049#discussion_r570451366 ## File path: core/src/test/scala/unit/kafka/server/MetadataCacheTest.scala ## @@ -483,61 +475,4 @@ class MetadataCacheTest {

[GitHub] [kafka] cmccabe commented on a change in pull request #10030: MINOR: Add KafkaEventQueue

2021-02-04 Thread GitBox
cmccabe commented on a change in pull request #10030: URL: https://github.com/apache/kafka/pull/10030#discussion_r570450458 ## File path: metadata/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java ## @@ -0,0 +1,420 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] cmccabe commented on a change in pull request #10030: MINOR: Add KafkaEventQueue

2021-02-04 Thread GitBox
cmccabe commented on a change in pull request #10030: URL: https://github.com/apache/kafka/pull/10030#discussion_r570442555 ## File path: metadata/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java ## @@ -0,0 +1,420 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Resolved] (KAFKA-7271) Fix ignored test in streams_upgrade_test.py: test_upgrade_downgrade_brokers

2021-02-04 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-7271. -- Resolution: Duplicate > Fix ignored test in streams_upgrade_test.py:

  1   2   >