[jira] [Commented] (KAFKA-4279) REST endpoint to list converter plugins

2020-08-27 Thread Rupesh Kumar Patel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186268#comment-17186268 ] Rupesh Kumar Patel commented on KAFKA-4279: --- Hi Gwen, I am pretty new to Kafka community, can

[jira] [Commented] (KAFKA-10366) TimeWindowedDeserializer doesn't allow users to set a custom window size

2020-08-27 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186265#comment-17186265 ] Matthias J. Sax commented on KAFKA-10366: - Following [~ableegoldman] last comment on the discuss

[GitHub] [kafka] ableegoldman commented on a change in pull request #9138: KAFKA-9929: Support backward iterator on WindowStore

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9138: URL: https://github.com/apache/kafka/pull/9138#discussion_r478774195 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/InMemoryWindowStore.java ## @@ -419,13 +504,13 @@ Long minTime() {

[GitHub] [kafka] ableegoldman commented on a change in pull request #9138: KAFKA-9929: Support backward iterator on WindowStore

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9138: URL: https://github.com/apache/kafka/pull/9138#discussion_r478770009 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/CachingWindowStore.java ## @@ -416,26 +552,43 @@ private long

[GitHub] [kafka] ableegoldman commented on a change in pull request #9138: KAFKA-9929: Support backward iterator on WindowStore

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9138: URL: https://github.com/apache/kafka/pull/9138#discussion_r478769493 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/AbstractWindowBytesStoreTest.java ## @@ -287,17 +308,43 @@ public void

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478769004 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,386 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478768625 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,386 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478768335 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,386 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478766196 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -232,40 +239,54 @@ private

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478763071 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -189,8 +195,8 @@ public void

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478762667 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -174,12 +181,11 @@ public

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478762151 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,386 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478761540 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,380 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478759996 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478759996 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478758779 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478758482 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478756346 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,303 @@ +/* + *

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478753568 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,303 @@ +/* + * Licensed to

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478751787 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,303 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478751787 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,303 @@ +/* + *

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478744162 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public void

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478743528 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public void

[GitHub] [kafka] vvcephei commented on pull request #9177: KAFKA-9924: Add RocksDB metric num-entries-active-mem-table

2020-08-27 Thread GitBox
vvcephei commented on pull request #9177: URL: https://github.com/apache/kafka/pull/9177#issuecomment-682235389 Hey @cadonna , after checking out your branch and merging with trunk, I discovered some minor conflicts with 22bcd9fac3c988c15862d0b6c01930814b676253, so I pushed a quick fix

[GitHub] [kafka] vvcephei merged pull request #9177: KAFKA-9924: Add RocksDB metric num-entries-active-mem-table

2020-08-27 Thread GitBox
vvcephei merged pull request #9177: URL: https://github.com/apache/kafka/pull/9177 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478730796 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,303 @@ +/* + * Licensed to

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478730765 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478730258 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public

[GitHub] [kafka] ableegoldman commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478730258 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478728829 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,303 @@ +/* + * Licensed to

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478726427 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,303 @@ +/* + * Licensed to

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478717127 ## File path: streams/src/test/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregateTest.java ## @@ -0,0 +1,466 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478716769 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,391 @@ +/* + *

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478715664 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,391 @@ +/* + *

[GitHub] [kafka] vvcephei commented on pull request #9177: KAFKA-9924: Add RocksDB metric num-entries-active-mem-table

2020-08-27 Thread GitBox
vvcephei commented on pull request #9177: URL: https://github.com/apache/kafka/pull/9177#issuecomment-682208742 Since the PR builds aren't running, I'm merging with trunk on my machine and running the tests. This is an

[GitHub] [kafka] vvcephei commented on a change in pull request #9177: KAFKA-9924: Add RocksDB metric num-entries-active-mem-table

2020-08-27 Thread GitBox
vvcephei commented on a change in pull request #9177: URL: https://github.com/apache/kafka/pull/9177#discussion_r478709525 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/StreamsMetricsImpl.java ## @@ -396,34 +398,65 @@ private String

[GitHub] [kafka] vvcephei commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-27 Thread GitBox
vvcephei commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r478588602 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/SlidingWindows.java ## @@ -0,0 +1,140 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (KAFKA-10410) OnRestoreStart disappeared from StateRestoreCallback in 2.6.0 and reappeared in a useless place

2020-08-27 Thread Mark Shelton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186092#comment-17186092 ] Mark Shelton commented on KAFKA-10410: -- Yes using a Singleton would work, like I said in my first

[GitHub] [kafka] cmccabe commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-27 Thread GitBox
cmccabe commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r478657275 ## File path: core/src/test/scala/unit/kafka/utils/JaasTestUtils.scala ## @@ -169,6 +169,18 @@ object JaasTestUtils { jaasFile } + // Returns a

[GitHub] [kafka] cmccabe commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-27 Thread GitBox
cmccabe commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r478656313 ## File path: tests/kafkatest/version.py ## @@ -63,8 +63,13 @@ def reassign_partitions_command_supports_bootstrap_server(self): return self >=

[GitHub] [kafka] rondagostino commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-27 Thread GitBox
rondagostino commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r478653535 ## File path: tests/kafkatest/services/security/security_config.py ## @@ -350,6 +362,14 @@ def kafka_opts(self): else: return ""

[jira] [Created] (KAFKA-10443) Consider providing standard set of users in system tests

2020-08-27 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-10443: - Summary: Consider providing standard set of users in system tests Key: KAFKA-10443 URL: https://issues.apache.org/jira/browse/KAFKA-10443 Project: Kafka

[GitHub] [kafka] cmccabe commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-27 Thread GitBox
cmccabe commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r478652254 ## File path: tests/kafkatest/services/kafka/kafka.py ## @@ -575,10 +577,21 @@ def set_unclean_leader_election(self, topic, value=True, node=None):

[GitHub] [kafka] cmccabe commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-27 Thread GitBox
cmccabe commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r478652254 ## File path: tests/kafkatest/services/kafka/kafka.py ## @@ -575,10 +577,21 @@ def set_unclean_leader_election(self, topic, value=True, node=None):

[GitHub] [kafka] cmccabe commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-27 Thread GitBox
cmccabe commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r478646950 ## File path: tests/kafkatest/services/security/security_config.py ## @@ -350,6 +362,14 @@ def kafka_opts(self): else: return "" +

[GitHub] [kafka] cmccabe commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-27 Thread GitBox
cmccabe commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r478646271 ## File path: tests/kafkatest/services/security/security_config.py ## @@ -276,18 +287,19 @@ def setup_node(self, node): if java_version(node) <=

[GitHub] [kafka] avocader opened a new pull request #9227: KAFKA-10439: Connect's Values to parse BigInteger as Decimal with zero scale.

2020-08-27 Thread GitBox
avocader opened a new pull request #9227: URL: https://github.com/apache/kafka/pull/9227 The `org.apache.kafka.connect.data.Values#parse` method parses integers, which are larger than `Long.MAX_VALUE` as `double` with `Schema.FLOAT64_SCHEMA`. That means we are losing precision for

[GitHub] [kafka] ijuma commented on a change in pull request #9129: MINOR: Update jmh to 1.25 for async profiler support

2020-08-27 Thread GitBox
ijuma commented on a change in pull request #9129: URL: https://github.com/apache/kafka/pull/9129#discussion_r478640519 ## File path: jmh-benchmarks/README.md ## @@ -34,7 +34,18 @@ the jmh.sh script from the jmh-benchmarks module. * By default all JMH output goes to stdout.

[GitHub] [kafka] ijuma commented on a change in pull request #9129: MINOR: Update jmh to 1.25 for async profiler support

2020-08-27 Thread GitBox
ijuma commented on a change in pull request #9129: URL: https://github.com/apache/kafka/pull/9129#discussion_r478639981 ## File path: jmh-benchmarks/README.md ## @@ -34,7 +34,18 @@ the jmh.sh script from the jmh-benchmarks module. * By default all JMH output goes to stdout.

[GitHub] [kafka] ijuma commented on a change in pull request #9129: MINOR: Update jmh to 1.25 for async profiler support

2020-08-27 Thread GitBox
ijuma commented on a change in pull request #9129: URL: https://github.com/apache/kafka/pull/9129#discussion_r478639377 ## File path: README.md ## @@ -199,6 +199,27 @@ You can run spotbugs using: The spotbugs warnings will be found in `reports/spotbugs/main.html` and

[GitHub] [kafka] lbradstreet commented on a change in pull request #9129: MINOR: Update jmh to 1.25 for async profiler support

2020-08-27 Thread GitBox
lbradstreet commented on a change in pull request #9129: URL: https://github.com/apache/kafka/pull/9129#discussion_r478637097 ## File path: README.md ## @@ -199,6 +199,27 @@ You can run spotbugs using: The spotbugs warnings will be found in `reports/spotbugs/main.html` and

[GitHub] [kafka] lbradstreet commented on a change in pull request #9129: MINOR: Update jmh to 1.25 for async profiler support

2020-08-27 Thread GitBox
lbradstreet commented on a change in pull request #9129: URL: https://github.com/apache/kafka/pull/9129#discussion_r478636719 ## File path: jmh-benchmarks/README.md ## @@ -34,7 +34,18 @@ the jmh.sh script from the jmh-benchmarks module. * By default all JMH output goes to

[GitHub] [kafka] lbradstreet commented on a change in pull request #9129: MINOR: Update jmh to 1.25 for async profiler support

2020-08-27 Thread GitBox
lbradstreet commented on a change in pull request #9129: URL: https://github.com/apache/kafka/pull/9129#discussion_r478635770 ## File path: jmh-benchmarks/README.md ## @@ -34,7 +34,18 @@ the jmh.sh script from the jmh-benchmarks module. * By default all JMH output goes to

[GitHub] [kafka] guozhangwang commented on a change in pull request #8988: KAFKA-10199: Separate restore threads [WIP]

2020-08-27 Thread GitBox
guozhangwang commented on a change in pull request #8988: URL: https://github.com/apache/kafka/pull/8988#discussion_r478608933 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -411,7 +411,10 @@ boolean

[GitHub] [kafka] guozhangwang commented on pull request #8988: KAFKA-10199: Separate restore threads [WIP]

2020-08-27 Thread GitBox
guozhangwang commented on pull request #8988: URL: https://github.com/apache/kafka/pull/8988#issuecomment-68204 > Is this planned for a follow-up PR or were you just waiting to get a review of the basics before diving deeper into this work? Yes that's the plan. More concreted

[GitHub] [kafka] junrao commented on a change in pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-08-27 Thread GitBox
junrao commented on a change in pull request #8657: URL: https://github.com/apache/kafka/pull/8657#discussion_r478604292 ## File path: core/src/main/scala/kafka/log/Log.scala ## @@ -100,7 +100,8 @@ case class LogAppendInfo(var firstOffset: Option[Long],

[GitHub] [kafka] guozhangwang commented on a change in pull request #9156: KAFKA-10077: Filter downstream of state-store results in spurious tombstones

2020-08-27 Thread GitBox
guozhangwang commented on a change in pull request #9156: URL: https://github.com/apache/kafka/pull/9156#discussion_r478605835 ## File path: streams/src/test/java/org/apache/kafka/streams/StreamsBuilderTest.java ## @@ -123,7 +123,7 @@ public void

[GitHub] [kafka] mumrah opened a new pull request #9226: [DO NOT MERGE] Jenkinsfile testing

2020-08-27 Thread GitBox
mumrah opened a new pull request #9226: URL: https://github.com/apache/kafka/pull/9226 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (KAFKA-10410) OnRestoreStart disappeared from StateRestoreCallback in 2.6.0 and reappeared in a useless place

2020-08-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186019#comment-17186019 ] Guozhang Wang commented on KAFKA-10410: --- Thanks Mark for your explanation. I think for metrics

[GitHub] [kafka] vvcephei commented on a change in pull request #9222: KAFKA-10437: Implement test-utils and StateStore changes for KIP-478

2020-08-27 Thread GitBox
vvcephei commented on a change in pull request #9222: URL: https://github.com/apache/kafka/pull/9222#discussion_r478586348 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/StateStoreContext.java ## @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] ning2008wisc commented on pull request #9215: KAFKA-10133: MM2 readme update on config

2020-08-27 Thread GitBox
ning2008wisc commented on pull request #9215: URL: https://github.com/apache/kafka/pull/9215#issuecomment-682090080 @mimaison thanks for your review. Regarding to your general comment about moving MM2 Readme to the Kafka documentation, I think it is a good idea to promote MM2 in the

[GitHub] [kafka] ning2008wisc commented on a change in pull request #9215: KAFKA-10133: MM2 readme update on config

2020-08-27 Thread GitBox
ning2008wisc commented on a change in pull request #9215: URL: https://github.com/apache/kafka/pull/9215#discussion_r478583076 ## File path: connect/mirror/README.md ## @@ -141,7 +141,38 @@ nearby clusters. N.B. that the `--clusters` parameter is not technically required

[jira] [Assigned] (KAFKA-10442) Tooling to detect and abort hanging transactions (KIP-664)

2020-08-27 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-10442: --- Assignee: Jason Gustafson > Tooling to detect and abort hanging transactions

[jira] [Created] (KAFKA-10442) Tooling to detect and abort hanging transactions (KIP-664)

2020-08-27 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10442: --- Summary: Tooling to detect and abort hanging transactions (KIP-664) Key: KAFKA-10442 URL: https://issues.apache.org/jira/browse/KAFKA-10442 Project: Kafka

[GitHub] [kafka] brbrown25 commented on pull request #9057: KAFKA-10299: Implementing Kafka Connect Hash SMT to allow for hashing…

2020-08-27 Thread GitBox
brbrown25 commented on pull request #9057: URL: https://github.com/apache/kafka/pull/9057#issuecomment-682058178 @mimaison Thank You, I'll review and submit a KIP this afternoon! This is an automated message from the Apache

[GitHub] [kafka] mimaison commented on pull request #8798: KAFKA-10098: Remove unnecessary escaping in regular expression.

2020-08-27 Thread GitBox
mimaison commented on pull request #8798: URL: https://github.com/apache/kafka/pull/8798#issuecomment-682051575 Ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Assigned] (KAFKA-10272) kafka-server-stop.sh fails on IBM i

2020-08-27 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reassigned KAFKA-10272: -- Assignee: Jesse Gorzinski > kafka-server-stop.sh fails on IBM i >

[GitHub] [kafka] mimaison commented on pull request #9023: KAFKA-10272: Add IBM i support to "stop" scripts

2020-08-27 Thread GitBox
mimaison commented on pull request #9023: URL: https://github.com/apache/kafka/pull/9023#issuecomment-682027790 Ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] cadonna commented on a change in pull request #9177: KAFKA-9924: Add RocksDB metric num-entries-active-mem-table

2020-08-27 Thread GitBox
cadonna commented on a change in pull request #9177: URL: https://github.com/apache/kafka/pull/9177#discussion_r478504532 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/StreamsMetricsImpl.java ## @@ -396,34 +398,65 @@ private String

[GitHub] [kafka] mimaison commented on pull request #9057: KAFKA-10299: Implementing Kafka Connect Hash SMT to allow for hashing…

2020-08-27 Thread GitBox
mimaison commented on pull request #9057: URL: https://github.com/apache/kafka/pull/9057#issuecomment-682013531 Thanks for the contribution. As this is adding new public classes, this change requires a KIP: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

[jira] [Comment Edited] (KAFKA-10441) Connect consumers are missing the fetch metrics

2020-08-27 Thread Pradyumna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185907#comment-17185907 ] Pradyumna edited comment on KAFKA-10441 at 8/27/20, 3:12 PM: - Do we need to

[jira] [Commented] (KAFKA-10441) Connect consumers are missing the fetch metrics

2020-08-27 Thread Pradyumna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185907#comment-17185907 ] Pradyumna commented on KAFKA-10441: --- Do we need to copy the

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478490860 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -232,40 +239,54 @@ private void

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478489438 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -232,40 +239,54 @@ private void

[GitHub] [kafka] mimaison commented on pull request #9122: KAFKA-10314: KafkaStorageException on reassignment when offline log d…

2020-08-27 Thread GitBox
mimaison commented on pull request #9122: URL: https://github.com/apache/kafka/pull/9122#issuecomment-682006762 Ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Comment Edited] (KAFKA-10441) Connect consumers are missing the fetch metrics

2020-08-27 Thread Pradyumna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185897#comment-17185897 ] Pradyumna edited comment on KAFKA-10441 at 8/27/20, 2:56 PM: - Interestingly,

[jira] [Commented] (KAFKA-10441) Connect consumers are missing the fetch metrics

2020-08-27 Thread Pradyumna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185897#comment-17185897 ] Pradyumna commented on KAFKA-10441: --- Interestingly, the MBean is available for these metrics, and it

[jira] [Comment Edited] (KAFKA-7421) Deadlock in Kafka Connect

2020-08-27 Thread Goltseva Taisiia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185890#comment-17185890 ] Goltseva Taisiia edited comment on KAFKA-7421 at 8/27/20, 2:43 PM: --- Hi,

[jira] [Comment Edited] (KAFKA-7421) Deadlock in Kafka Connect

2020-08-27 Thread Goltseva Taisiia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185890#comment-17185890 ] Goltseva Taisiia edited comment on KAFKA-7421 at 8/27/20, 2:42 PM: --- Hi,

[jira] [Commented] (KAFKA-7421) Deadlock in Kafka Connect

2020-08-27 Thread Goltseva Taisiia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185891#comment-17185891 ] Goltseva Taisiia commented on KAFKA-7421: - And I agree with [~ivanyu], I do not understand why

[jira] [Comment Edited] (KAFKA-7421) Deadlock in Kafka Connect

2020-08-27 Thread Goltseva Taisiia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185891#comment-17185891 ] Goltseva Taisiia edited comment on KAFKA-7421 at 8/27/20, 2:38 PM: --- And

[jira] [Commented] (KAFKA-7421) Deadlock in Kafka Connect

2020-08-27 Thread Goltseva Taisiia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185890#comment-17185890 ] Goltseva Taisiia commented on KAFKA-7421: - Hi, guys! We faced the similar deadlock (not equal

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478462394 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -232,40 +239,54 @@ private void

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478459405 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -189,8 +195,8 @@ public void

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478454716 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,380 @@ +/* + * Licensed to

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478445137 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public void

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478442739 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -174,12 +181,11 @@ public void

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478437596 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,380 @@ +/* + * Licensed to

[GitHub] [kafka] lct45 commented on a change in pull request #9157: Update for KIP-450 to handle early records

2020-08-27 Thread GitBox
lct45 commented on a change in pull request #9157: URL: https://github.com/apache/kafka/pull/9157#discussion_r478435832 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -160,11 +160,18 @@ public void

[GitHub] [kafka] mimaison commented on a change in pull request #9215: KAFKA-10133: MM2 readme update on config

2020-08-27 Thread GitBox
mimaison commented on a change in pull request #9215: URL: https://github.com/apache/kafka/pull/9215#discussion_r478425022 ## File path: connect/mirror/README.md ## @@ -141,7 +141,38 @@ nearby clusters. N.B. that the `--clusters` parameter is not technically required here.

[jira] [Created] (KAFKA-10441) Connect consumers are missing the fetch metrics

2020-08-27 Thread Pradyumna (Jira)
Pradyumna created KAFKA-10441: - Summary: Connect consumers are missing the fetch metrics Key: KAFKA-10441 URL: https://issues.apache.org/jira/browse/KAFKA-10441 Project: Kafka Issue Type: Bug

[GitHub] [kafka] jeqo commented on a change in pull request #9138: KAFKA-9929: Support backward iterator on WindowStore

2020-08-27 Thread GitBox
jeqo commented on a change in pull request #9138: URL: https://github.com/apache/kafka/pull/9138#discussion_r478349804 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/AbstractWindowBytesStoreTest.java ## @@ -287,17 +308,43 @@ public void

[GitHub] [kafka] jeqo commented on a change in pull request #9138: KAFKA-9929: Support backward iterator on WindowStore

2020-08-27 Thread GitBox
jeqo commented on a change in pull request #9138: URL: https://github.com/apache/kafka/pull/9138#discussion_r478340031 ## File path: streams/src/main/java/org/apache/kafka/streams/state/WindowStore.java ## @@ -119,15 +118,16 @@ * * This iterator must be closed

[GitHub] [kafka] xakassi commented on a change in pull request #9211: KAFKA-10426: Deadlock on session key update.

2020-08-27 Thread GitBox
xakassi commented on a change in pull request #9211: URL: https://github.com/apache/kafka/pull/9211#discussion_r478325832 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java ## @@ -733,10 +734,11 @@ public void

[GitHub] [kafka] xakassi commented on a change in pull request #9211: KAFKA-10426: Deadlock on session key update.

2020-08-27 Thread GitBox
xakassi commented on a change in pull request #9211: URL: https://github.com/apache/kafka/pull/9211#discussion_r478325832 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java ## @@ -733,10 +734,11 @@ public void

[GitHub] [kafka] kkonstantine commented on pull request #9211: KAFKA-10426: Deadlock on session key update.

2020-08-27 Thread GitBox
kkonstantine commented on pull request #9211: URL: https://github.com/apache/kafka/pull/9211#issuecomment-681830490 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] kkonstantine commented on a change in pull request #9211: KAFKA-10426: Deadlock on session key update.

2020-08-27 Thread GitBox
kkonstantine commented on a change in pull request #9211: URL: https://github.com/apache/kafka/pull/9211#discussion_r478275661 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java ## @@ -733,10 +734,11 @@ public void

[jira] [Updated] (KAFKA-10440) MM2 using Kconnect Framework Creates topics recursively on source cluster

2020-08-27 Thread Nandini Anagondi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandini Anagondi updated KAFKA-10440: - Description: I found an issue while running MM2 using Kconnect Framework. Based on the

[GitHub] [kafka] huxihx commented on pull request #9225: KAFKA-10431: Sequential selection of payload in ProducerPerformance

2020-08-27 Thread GitBox
huxihx commented on pull request #9225: URL: https://github.com/apache/kafka/pull/9225#issuecomment-681778195 @ijuma Please review this patch. Thanks. This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] huxihx opened a new pull request #9225: KAFKA-10431: Sequential selection of payload in ProducerPerformance

2020-08-27 Thread GitBox
huxihx opened a new pull request #9225: URL: https://github.com/apache/kafka/pull/9225 https://issues.apache.org/jira/browse/KAFKA-10431 Currently, ProducerPerformance randomly selects a payload from the payload file when sending message. This might cause the some payloads being

  1   2   >