[GitHub] [kafka] stan-confluent commented on pull request #9933: MINOR: Upgrade ducktape to version 0.8.1

2021-01-22 Thread GitBox
stan-confluent commented on pull request #9933: URL: https://github.com/apache/kafka/pull/9933#issuecomment-765879109 Thanks for review and backport! Changes to ducktape were simply a bugfix to move a bunch of code into the `finally` block to make sure it executes, so they shouldn't

[GitHub] [kafka] stan-confluent commented on pull request #9932: MINOR: Upgrade ducktape to version 0.7.11

2021-01-22 Thread GitBox
stan-confluent commented on pull request #9932: URL: https://github.com/apache/kafka/pull/9932#issuecomment-765879093 Thanks for review and backport! Changes to ducktape were simply a bugfix to move a bunch of code into the `finally` block to make sure it executes, so they shouldn't

[GitHub] [kafka] kkonstantine commented on pull request #9932: MINOR: Upgrade ducktape to version 0.7.11

2021-01-22 Thread GitBox
kkonstantine commented on pull request #9932: URL: https://github.com/apache/kafka/pull/9932#issuecomment-765865709 Merged to 2.6 and backported up to 2.0. This is an automated message from the Apache Git Service. To

[GitHub] [kafka] kkonstantine merged pull request #9932: MINOR: Upgrade ducktape to version 0.7.11

2021-01-22 Thread GitBox
kkonstantine merged pull request #9932: URL: https://github.com/apache/kafka/pull/9932 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] kkonstantine commented on pull request #9932: MINOR: Upgrade ducktape to version 0.7.11

2021-01-22 Thread GitBox
kkonstantine commented on pull request #9932: URL: https://github.com/apache/kafka/pull/9932#issuecomment-765864346 Few flaky failures. Green builds otherwise on jdk8 and jdk11 This is an automated message from the Apache

[GitHub] [kafka] kkonstantine merged pull request #9933: MINOR: Upgrade ducktape to version 0.8.1

2021-01-22 Thread GitBox
kkonstantine merged pull request #9933: URL: https://github.com/apache/kafka/pull/9933 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] kkonstantine commented on pull request #9933: MINOR: Upgrade ducktape to version 0.8.1

2021-01-22 Thread GitBox
kkonstantine commented on pull request #9933: URL: https://github.com/apache/kafka/pull/9933#issuecomment-765864083 A few flaky test failures are not relevant to the changes. Merging to `trunk` and `2.7` This is an

[GitHub] [kafka] hachikuji opened a new pull request #9952: MINOR: A few small group coordinator cleanups

2021-01-22 Thread GitBox
hachikuji opened a new pull request #9952: URL: https://github.com/apache/kafka/pull/9952 A few small cleanups in `GroupCoordinator` and related classes. - Remove redundant `groupId` field from `MemberMetadata` - Remove redundant val `isStaticMember` from `MemberMetadata` - Fix

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-01-22 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r563003389 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1110,82 +1098,39 @@ class KafkaApis(val requestChannel: RequestChannel,

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-01-22 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r563002911 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1084,24 +1087,9 @@ class KafkaApis(val requestChannel: RequestChannel,

[GitHub] [kafka] mjsax commented on pull request #9948: MINOR: fix record time in shouldWipeOutStandbyStateDirectoryIfCheckpointIsMissing

2021-01-22 Thread GitBox
mjsax commented on pull request #9948: URL: https://github.com/apache/kafka/pull/9948#issuecomment-765801515 Merged to `trunk` and cherry-picked to `2.7` and `2.6` branches. This is an automated message from the Apache Git

[GitHub] [kafka] mjsax commented on pull request #9948: MINOR: fix record time in shouldWipeOutStandbyStateDirectoryIfCheckpointIsMissing

2021-01-22 Thread GitBox
mjsax commented on pull request #9948: URL: https://github.com/apache/kafka/pull/9948#issuecomment-765788406 @showuon -- I just see you comment now after merging. Did not add you as reviewer in the commit message. Sorry about that.

[GitHub] [kafka] mjsax merged pull request #9948: MINOR: fix record time in shouldWipeOutStandbyStateDirectoryIfCheckpointIsMissing

2021-01-22 Thread GitBox
mjsax merged pull request #9948: URL: https://github.com/apache/kafka/pull/9948 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] guozhangwang commented on pull request #9836: KAFKA-10866: Add metadata to ConsumerRecords

2021-01-22 Thread GitBox
guozhangwang commented on pull request #9836: URL: https://github.com/apache/kafka/pull/9836#issuecomment-765738281 Yup, I think we are on the same page for: 1) `ConsumerRecords#isEmpty`: I was not pointing that it may not return true even if only metadata changed, I meant that if

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
wcarlson5 commented on a change in pull request #9863: URL: https://github.com/apache/kafka/pull/9863#discussion_r562929843 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java ## @@ -612,11 +612,22 @@ public void

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
wcarlson5 commented on a change in pull request #9863: URL: https://github.com/apache/kafka/pull/9863#discussion_r562929843 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java ## @@ -612,11 +612,22 @@ public void

[GitHub] [kafka] dajac commented on a change in pull request #9949: MINOR: replace FlattenedIterator by java stream

2021-01-22 Thread GitBox
dajac commented on a change in pull request #9949: URL: https://github.com/apache/kafka/pull/9949#discussion_r562897068 ## File path: clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java ## @@ -183,8 +182,7 @@ public long brokerEpoch() {

[GitHub] [kafka] ableegoldman merged pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
ableegoldman merged pull request #9863: URL: https://github.com/apache/kafka/pull/9863 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] ableegoldman edited a comment on pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
ableegoldman edited a comment on pull request #9863: URL: https://github.com/apache/kafka/pull/9863#issuecomment-765658341 Two unrelated fail tests: ``` org.apache.kafka.clients.consumer.internals.FetcherTest.testEarlierOffsetResetArrivesLate()

[GitHub] [kafka] ableegoldman commented on pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
ableegoldman commented on pull request #9863: URL: https://github.com/apache/kafka/pull/9863#issuecomment-765658341 Two unrelated fail tests: ``` org.apache.kafka.clients.consumer.internals.FetcherTest.testEarlierOffsetResetArrivesLate()

[GitHub] [kafka] ableegoldman commented on a change in pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
ableegoldman commented on a change in pull request #9863: URL: https://github.com/apache/kafka/pull/9863#discussion_r562882284 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java ## @@ -612,11 +612,22 @@ public void

[GitHub] [kafka] hachikuji edited a comment on pull request #9819: KAFKA-10694: Implement zero copy for FetchSnapshot

2021-01-22 Thread GitBox
hachikuji edited a comment on pull request #9819: URL: https://github.com/apache/kafka/pull/9819#issuecomment-765642062 @dengziming Thanks for the updates. I think we're on the right track. I thought of a few potential simplifications. Take a look here:

[GitHub] [kafka] hachikuji commented on pull request #9819: KAFKA-10694: Implement zero copy for FetchSnapshot

2021-01-22 Thread GitBox
hachikuji commented on pull request #9819: URL: https://github.com/apache/kafka/pull/9819#issuecomment-765642062 @dengziming Thanks for the updates. I think we're on the right track. I thought of a few potential potential simplifications. Take a look here:

[GitHub] [kafka] bbejeck commented on pull request #9738: KAFKA-8744: Update Scala API to give names to processors

2021-01-22 Thread GitBox
bbejeck commented on pull request #9738: URL: https://github.com/apache/kafka/pull/9738#issuecomment-765610892 @mdespriee Thanks for your patience; I'm taking a look today This is an automated message from the Apache Git

[GitHub] [kafka] vvcephei commented on pull request #9836: KAFKA-10866: Add metadata to ConsumerRecords

2021-01-22 Thread GitBox
vvcephei commented on pull request #9836: URL: https://github.com/apache/kafka/pull/9836#issuecomment-765602186 Thanks @guozhangwang . I share that concern. It's a little different than what you pointed out, but to call attention to it: I actually didn't change the definition of

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-22 Thread GitBox
wcarlson5 commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r562823698 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/TimeWindowedDeserializer.java ## @@ -33,22 +33,22 @@ */ public class

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
wcarlson5 commented on a change in pull request #9863: URL: https://github.com/apache/kafka/pull/9863#discussion_r562819243 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java ## @@ -612,11 +612,22 @@ public void

[GitHub] [kafka] ableegoldman commented on a change in pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
ableegoldman commented on a change in pull request #9863: URL: https://github.com/apache/kafka/pull/9863#discussion_r562815151 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java ## @@ -612,11 +612,22 @@ public void

[GitHub] [kafka] guozhangwang commented on pull request #9836: KAFKA-10866: Add metadata to ConsumerRecords

2021-01-22 Thread GitBox
guozhangwang commented on pull request #9836: URL: https://github.com/apache/kafka/pull/9836#issuecomment-765592268 Hey @vvcephei I was concerned about not the tests actually, it just rang to me if we should be paranoid about any side-effects for a tighter consumer loop in user code like:

[GitHub] [kafka] ableegoldman commented on a change in pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
ableegoldman commented on a change in pull request #9863: URL: https://github.com/apache/kafka/pull/9863#discussion_r562813288 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -249,20 +249,31 @@ public boolean isValidTransition(final State

[GitHub] [kafka] ableegoldman commented on pull request #9848: KAFKA-10357: Extract setup of repartition topics from Streams partition assignor

2021-01-22 Thread GitBox
ableegoldman commented on pull request #9848: URL: https://github.com/apache/kafka/pull/9848#issuecomment-765590053 Merged to trunk This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] ableegoldman merged pull request #9848: KAFKA-10357: Extract setup of repartition topics from Streams partition assignor

2021-01-22 Thread GitBox
ableegoldman merged pull request #9848: URL: https://github.com/apache/kafka/pull/9848 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] ableegoldman commented on pull request #9848: KAFKA-10357: Extract setup of repartition topics from Streams partition assignor

2021-01-22 Thread GitBox
ableegoldman commented on pull request #9848: URL: https://github.com/apache/kafka/pull/9848#issuecomment-765588975 One unrelated test failure in `SocketServerTest.testConnectionRatePerIp` This is an automated message from

[GitHub] [kafka] vvcephei commented on pull request #9836: KAFKA-10866: Add metadata to ConsumerRecords

2021-01-22 Thread GitBox
vvcephei commented on pull request #9836: URL: https://github.com/apache/kafka/pull/9836#issuecomment-765574234 Thanks @guozhangwang , I considered that, but I think for this work, we actually do want to return the metadata if we have fetched some. Since the semantics of

[GitHub] [kafka] abbccdda commented on a change in pull request #9579: KAFKA-9751: Forward CreateTopicsRequest for FindCoordinator/Metadata when topic creation is needed

2021-01-22 Thread GitBox
abbccdda commented on a change in pull request #9579: URL: https://github.com/apache/kafka/pull/9579#discussion_r562792214 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1370,55 +1345,164 @@ class KafkaApis(val requestChannel: RequestChannel,

[GitHub] [kafka] cadonna commented on a change in pull request #9863: MINOR: Restore interrupt status when closing

2021-01-22 Thread GitBox
cadonna commented on a change in pull request #9863: URL: https://github.com/apache/kafka/pull/9863#discussion_r562774792 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -249,20 +249,31 @@ public boolean isValidTransition(final State

[GitHub] [kafka] guozhangwang commented on pull request #9836: KAFKA-10866: Add metadata to ConsumerRecords

2021-01-22 Thread GitBox
guozhangwang commented on pull request #9836: URL: https://github.com/apache/kafka/pull/9836#issuecomment-765552356 > I ran the PlaintextConsumerTest a bunch more times, and also searched through the trunk build logs. I think this PR did make the test more flaky, and I suspect the reason

[jira] [Commented] (KAFKA-10762) alter the backoff in `KafkaConsumer.pollForFetches`

2021-01-22 Thread shiqihao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270267#comment-17270267 ] shiqihao commented on KAFKA-10762: -- The key is whether this edge use case is worth solving. Maybe

[jira] [Commented] (KAFKA-12228) Invalid value javax.net.ssl.SSLHandshakeException: no cipher suites in common for configuration

2021-01-22 Thread shiqihao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270261#comment-17270261 ] shiqihao commented on KAFKA-12228: -- I hava encountered similar SSL problems when using openjdk.

[GitHub] [kafka] vvcephei commented on pull request #9836: KAFKA-10866: Add metadata to ConsumerRecords

2021-01-22 Thread GitBox
vvcephei commented on pull request #9836: URL: https://github.com/apache/kafka/pull/9836#issuecomment-765507001 Thanks, @guozhangwang ! I ran the PlaintextConsumerTest a bunch more times, and also searched through the trunk build logs. I think this PR did make the test more flaky,

[GitHub] [kafka] lct45 edited a comment on pull request #9951: KAFKA-9126: Add docs for stream joined logging configs

2021-01-22 Thread GitBox
lct45 edited a comment on pull request #9951: URL: https://github.com/apache/kafka/pull/9951#issuecomment-765498392 @mjsax @wcarlson5 @JimGalasyn for review This is an automated message from the Apache Git Service. To

[GitHub] [kafka] lct45 commented on pull request #9951: KAFKA-9126: Add docs for stream joined logging configs

2021-01-22 Thread GitBox
lct45 commented on pull request #9951: URL: https://github.com/apache/kafka/pull/9951#issuecomment-765498392 @mjsax @wcarlson5 for review This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] lct45 opened a new pull request #9951: KAFKA-9126: Add docs for stream joined logging configs

2021-01-22 Thread GitBox
lct45 opened a new pull request #9951: URL: https://github.com/apache/kafka/pull/9951 Adding docs for KIP-689 / KAFKA-9126 which added `withLoggingEnabled()` and `withLoggingDisabled()` to `StreamJoined` ### Committer Checklist (excluded from commit message) - [ ] Verify design

[GitHub] [kafka] ijuma commented on pull request #9689: KAFKA-10740; Replace OffsetsForLeaderEpochRequest.PartitionData with automated protocol

2021-01-22 Thread GitBox
ijuma commented on pull request #9689: URL: https://github.com/apache/kafka/pull/9689#issuecomment-765497872 It definitely requires analysis on a case by case basis. However, having helpers that do conversion lazily also have performance issues if the method gets called repeatedly, unless

[jira] [Commented] (KAFKA-8930) MM2 documentation

2021-01-22 Thread Michael G. Noll (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270228#comment-17270228 ] Michael G. Noll commented on KAFKA-8930: I submitted a PR for the user-facing documentation

[GitHub] [kafka] chia7712 commented on pull request #9689: KAFKA-10740; Replace OffsetsForLeaderEpochRequest.PartitionData with automated protocol

2021-01-22 Thread GitBox
chia7712 commented on pull request #9689: URL: https://github.com/apache/kafka/pull/9689#issuecomment-765494602 > You don't know how things will change over time ahead of time. You are right. However, it seems to me it is hard to apply “single” solution to all auto-generated data.

[jira] [Commented] (KAFKA-8930) MM2 documentation

2021-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270225#comment-17270225 ] ASF GitHub Bot commented on KAFKA-8930: --- miguno opened a new pull request #324: URL:

[GitHub] [kafka] lct45 commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-22 Thread GitBox
lct45 commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r562709184 ## File path: streams/src/test/java/org/apache/kafka/streams/kstream/TimeWindowedDeserializerTest.java ## @@ -56,4 +57,23 @@ public void

[GitHub] [kafka] ijuma commented on pull request #9689: KAFKA-10740; Replace OffsetsForLeaderEpochRequest.PartitionData with automated protocol

2021-01-22 Thread GitBox
ijuma commented on pull request #9689: URL: https://github.com/apache/kafka/pull/9689#issuecomment-765474499 It's the nature of protocol evolution. You don't know how things will change over time ahead of time. This is an

[GitHub] [kafka] lct45 commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-22 Thread GitBox
lct45 commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r562699939 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/KStreamAggregationIntegrationTest.java ## @@ -235,25 +235,27 @@ public void

[GitHub] [kafka] lct45 commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-22 Thread GitBox
lct45 commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r562698730 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/KStreamAggregationIntegrationTest.java ## @@ -327,7 +329,7 @@ public void

[jira] [Updated] (KAFKA-10762) alter the backoff in `KafkaConsumer.pollForFetches`

2021-01-22 Thread shiqihao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shiqihao updated KAFKA-10762: - Attachment: (was: image-2021-01-22-18-12-52-323.png) > alter the backoff in

[GitHub] [kafka] sknop opened a new pull request #9950: KAFKA-12170: Fix for Connect Cast SMT to correctly transform a Byte array into a string

2021-01-22 Thread GitBox
sknop opened a new pull request #9950: URL: https://github.com/apache/kafka/pull/9950 Cast SMT transformation for bytes -> string. Without this fix, the conversion becomes ByteBuffer.toString(), which always gives one of these useless results: "java.nio.HeapByteBuffer[pos=0

[GitHub] [kafka] cadonna commented on pull request #9848: KAFKA-10357: Extract setup of repartition topics from Streams partition assignor

2021-01-22 Thread GitBox
cadonna commented on pull request #9848: URL: https://github.com/apache/kafka/pull/9848#issuecomment-765306203 @ableegoldman @guozhangwang, could someone of you merge this PR since it seems there are no further open question.

[GitHub] [kafka] cadonna commented on a change in pull request #9848: KAFKA-10357: Extract setup of repartition topics from Streams partition assignor

2021-01-22 Thread GitBox
cadonna commented on a change in pull request #9848: URL: https://github.com/apache/kafka/pull/9848#discussion_r562531849 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/RepartitionTopics.java ## @@ -0,0 +1,212 @@ +/* + * Licensed to the

[jira] [Updated] (KAFKA-10762) alter the backoff in `KafkaConsumer.pollForFetches`

2021-01-22 Thread shiqihao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shiqihao updated KAFKA-10762: - Attachment: image-2021-01-22-18-12-52-323.png > alter the backoff in `KafkaConsumer.pollForFetches` >

[GitHub] [kafka] dengziming commented on a change in pull request #9819: KAFKA-10694: Implement zero copy for FetchSnapshot

2021-01-22 Thread GitBox
dengziming commented on a change in pull request #9819: URL: https://github.com/apache/kafka/pull/9819#discussion_r562516704 ## File path: raft/src/main/java/org/apache/kafka/snapshot/FileRawSnapshotWriter.java ## @@ -53,13 +54,13 @@ public long sizeInBytes() throws

[GitHub] [kafka] rajinisivaram commented on a change in pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-22 Thread GitBox
rajinisivaram commented on a change in pull request #9769: URL: https://github.com/apache/kafka/pull/9769#discussion_r562511974 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -1190,8 +1192,31 @@ class KafkaApis(val requestChannel: RequestChannel, val

[GitHub] [kafka] g1geordie commented on a change in pull request #9906: KAFKA-10885 Refactor MemoryRecordsBuilderTest/MemoryRecordsTest to avoid a lot of…

2021-01-22 Thread GitBox
g1geordie commented on a change in pull request #9906: URL: https://github.com/apache/kafka/pull/9906#discussion_r562502128 ## File path: clients/src/test/java/org/apache/kafka/common/record/MemoryRecordsBuilderTest.java ## @@ -66,25 +65,38 @@ public String toString() {

[GitHub] [kafka] chia7712 opened a new pull request #9949: MINOR: replace FlattenedIterator by java stream

2021-01-22 Thread GitBox
chia7712 opened a new pull request #9949: URL: https://github.com/apache/kafka/pull/9949 as title ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation

[GitHub] [kafka] wilkinsona commented on pull request #9947: KAFKA-12190: Fix setting of file permissions on non-POSIX filesystems

2021-01-22 Thread GitBox
wilkinsona commented on pull request #9947: URL: https://github.com/apache/kafka/pull/9947#issuecomment-765256033 Thanks for the reviews. I've addressed the comments other than possibly passing the `File` into the `configurePermissions` and `assertPermissions` methods. Let me know which

[GitHub] [kafka] wilkinsona commented on a change in pull request #9947: KAFKA-12190: Fix setting of file permissions on non-POSIX filesystems

2021-01-22 Thread GitBox
wilkinsona commented on a change in pull request #9947: URL: https://github.com/apache/kafka/pull/9947#discussion_r562482975 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateDirectory.java ## @@ -109,16 +109,27 @@ public

[GitHub] [kafka] chia7712 commented on pull request #9689: KAFKA-10740; Replace OffsetsForLeaderEpochRequest.PartitionData with automated protocol

2021-01-22 Thread GitBox
chia7712 commented on pull request #9689: URL: https://github.com/apache/kafka/pull/9689#issuecomment-765246731 It look like a bad pattern if we have to "contort" a bunch of data from auto-generated protocol when processing.

[GitHub] [kafka] ijuma commented on pull request #9925: MINOR: Tag `RaftEventSimulationTest` as `integration` and tweak it

2021-01-22 Thread GitBox
ijuma commented on pull request #9925: URL: https://github.com/apache/kafka/pull/9925#issuecomment-765241792 I removed the @FunctionalInterface annotation from `Invariant`. I don't think this interfaces are used as functional interfaces and they make the system more strongly typed.

[GitHub] [kafka] chia7712 commented on pull request #9925: MINOR: Tag `RaftEventSimulationTest` as `integration` and tweak it

2021-01-22 Thread GitBox
chia7712 commented on pull request #9925: URL: https://github.com/apache/kafka/pull/9925#issuecomment-765241389 > What are you suggesting instead of Validation and Invariant? Runnable? Runnable This is an automated

[GitHub] [kafka] ijuma commented on a change in pull request #9925: MINOR: Tag `RaftEventSimulationTest` as `integration` and tweak it

2021-01-22 Thread GitBox
ijuma commented on a change in pull request #9925: URL: https://github.com/apache/kafka/pull/9925#discussion_r562472766 ## File path: raft/src/test/java/org/apache/kafka/raft/RaftEventSimulationTest.java ## @@ -59,6 +60,7 @@ import static

[GitHub] [kafka] ijuma edited a comment on pull request #9925: MINOR: Tag `RaftEventSimulationTest` as `integration` and tweak it

2021-01-22 Thread GitBox
ijuma edited a comment on pull request #9925: URL: https://github.com/apache/kafka/pull/9925#issuecomment-765239810 @chia7712 What are you suggesting instead of `Validation` and `Invariant`? `Runnable`? This is an automated

[GitHub] [kafka] ijuma commented on pull request #9925: MINOR: Tag `RaftEventSimulationTest` as `integration` and tweak it

2021-01-22 Thread GitBox
ijuma commented on pull request #9925: URL: https://github.com/apache/kafka/pull/9925#issuecomment-765239810 @chia7712 What are you suggesting instead of `Validation` and `Invariant`? This is an automated message from the

[GitHub] [kafka] wilkinsona commented on a change in pull request #9947: KAFKA-12190: Fix setting of file permissions on non-POSIX filesystems

2021-01-22 Thread GitBox
wilkinsona commented on a change in pull request #9947: URL: https://github.com/apache/kafka/pull/9947#discussion_r562467953 ## File path: streams/src/test/java/org/apache/kafka/streams/processor/internals/StateDirectoryTest.java ## @@ -115,22 +115,29 @@ public void

[GitHub] [kafka] wilkinsona commented on a change in pull request #9947: KAFKA-12190: Fix setting of file permissions on non-POSIX filesystems

2021-01-22 Thread GitBox
wilkinsona commented on a change in pull request #9947: URL: https://github.com/apache/kafka/pull/9947#discussion_r562467278 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateDirectory.java ## @@ -109,16 +109,27 @@ public

[GitHub] [kafka] wilkinsona commented on a change in pull request #9947: KAFKA-12190: Fix setting of file permissions on non-POSIX filesystems

2021-01-22 Thread GitBox
wilkinsona commented on a change in pull request #9947: URL: https://github.com/apache/kafka/pull/9947#discussion_r562466134 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateDirectory.java ## @@ -109,16 +109,27 @@ public

[GitHub] [kafka] ijuma commented on pull request #9689: KAFKA-10740; Replace OffsetsForLeaderEpochRequest.PartitionData with automated protocol

2021-01-22 Thread GitBox
ijuma commented on pull request #9689: URL: https://github.com/apache/kafka/pull/9689#issuecomment-765233789 Like Jason said, I think the main challenge is how to deal with protocol evolution. It's typically possible to deal with, but it can require quite a lot of contortion.

[GitHub] [kafka] wilkinsona commented on a change in pull request #9947: KAFKA-12190: Fix setting of file permissions on non-POSIX filesystems

2021-01-22 Thread GitBox
wilkinsona commented on a change in pull request #9947: URL: https://github.com/apache/kafka/pull/9947#discussion_r562464755 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateDirectory.java ## @@ -109,16 +109,27 @@ public

[jira] [Resolved] (KAFKA-10740) Replace OffsetsForLeaderEpochRequest.PartitionData with automated protocol

2021-01-22 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-10740. - Fix Version/s: 2.8.0 Resolution: Fixed > Replace

[jira] [Resolved] (KAFKA-10851) Add Cluster Describe API

2021-01-22 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-10851. - Fix Version/s: 2.8.0 Resolution: Fixed > Add Cluster Describe API >

[jira] [Resolved] (KAFKA-12212) Bump Metadata API version to remove `ClusterAuthorizedOperations` fields

2021-01-22 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-12212. - Fix Version/s: 2.8.0 Resolution: Fixed > Bump Metadata API version to remove

[GitHub] [kafka] dajac merged pull request #9945: KAFKA-12212; Bump Metadata API version to remove `ClusterAuthorizedOperations` fields

2021-01-22 Thread GitBox
dajac merged pull request #9945: URL: https://github.com/apache/kafka/pull/9945 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] dajac commented on pull request #9945: KAFKA-12212; Bump Metadata API version to remove `ClusterAuthorizedOperations` fields

2021-01-22 Thread GitBox
dajac commented on pull request #9945: URL: https://github.com/apache/kafka/pull/9945#issuecomment-765218202 Failed tests are not related: * Build / JDK 8 / org.apache.kafka.clients.consumer.KafkaConsumerTest.testCloseWithTimeUnit() * Build / JDK 8 /