Jenkins build is back to normal : kafka-trunk-jdk14 #3

2020-04-20 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-9897) Flaky Test StoreQueryIntegrationTest#shouldQuerySpecificActivePartitionStores

2020-04-20 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-9897: -- Summary: Flaky Test StoreQueryIntegrationTest#shouldQuerySpecificActivePartitionStores Key: KAFKA-9897 URL: https://issues.apache.org/jira/browse/KAFKA-9897

[jira] [Created] (KAFKA-9896) Flaky Test StandbyTaskEOSIntegrationTest#surviveWithOneTaskAsStandby[exactly_once_beta]

2020-04-20 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-9896: -- Summary: Flaky Test StandbyTaskEOSIntegrationTest#surviveWithOneTaskAsStandby[exactly_once_beta] Key: KAFKA-9896 URL: https://issues.apache.org/jira/browse/KAFKA-9896

[jira] [Created] (KAFKA-9895) Truncation request on broker start up may cause OffsetOutOfRangeException

2020-04-20 Thread Boquan Tang (Jira)
Boquan Tang created KAFKA-9895: -- Summary: Truncation request on broker start up may cause OffsetOutOfRangeException Key: KAFKA-9895 URL: https://issues.apache.org/jira/browse/KAFKA-9895 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk14 #2

2020-04-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Adding github whitelist (#8523) -- [...truncated 3.03 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Build failed in Jenkins: kafka-trunk-jdk11 #1371

2020-04-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Adding github whitelist (#8523) -- [...truncated 3.04 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSSION] KIP-418: A method-chaining way to branch KStream

2020-04-20 Thread Matthias J. Sax
Ivan, no worries about getting side tracked. Glad to have you back! The DSL improved further in the meantime and we already have a `Named` config object to name operators. It seems reasonable to me to build on this. Furthermore, John did a writeup about "DSL design principles" that we want to

Build failed in Jenkins: kafka-trunk-jdk11 #1370

2020-04-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Upgrade gradle plugins and test libraries for Java 14 support -- [...truncated 3.03 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Build failed in Jenkins: kafka-trunk-jdk14 #1

2020-04-20 Thread Apache Jenkins Server
See Changes: -- [...truncated 3.03 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldPunctuateOnStreamsTime[Eos enabled = false] STARTED

Jenkins build is back to normal : kafka-trunk-jdk8 #4450

2020-04-20 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-9894) Support Java 14

2020-04-20 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-9894. Resolution: Fixed Fixed via [https://github.com/apache/kafka/pull/8519. 

[jira] [Created] (KAFKA-9894) Support Java 14

2020-04-20 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-9894: -- Summary: Support Java 14 Key: KAFKA-9894 URL: https://issues.apache.org/jira/browse/KAFKA-9894 Project: Kafka Issue Type: Improvement Reporter:

JDK 14 builds and Gradle 6.3 upgrade implications

2020-04-20 Thread Ismael Juma
Hi all, There have been 3 releases since Java 11, so we are halfway to the next long-term support release (Java 17). It's a good time for Apache Kafka to start testing with post Java 11 JDKs. In order to do that, we need to upgrade to Gradle 6.3 which requires some changes to how we run build

[jira] [Created] (KAFKA-9893) Configurable TCP connection timeout for AdminClient

2020-04-20 Thread Cheng Tan (Jira)
Cheng Tan created KAFKA-9893: Summary: Configurable TCP connection timeout for AdminClient Key: KAFKA-9893 URL: https://issues.apache.org/jira/browse/KAFKA-9893 Project: Kafka Issue Type: New

Re: Build failed in Jenkins: kafka-trunk-jdk11 #1369

2020-04-20 Thread Shafaq
unsubscribe On Mon, Apr 20, 2020 at 1:12 PM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/kafka-trunk-jdk11/1369/display/redirect?page=changes > > > > Changes: > > [github] MINOR: Further reduce runtime for metrics integration tests > (#8514) >

Build failed in Jenkins: kafka-trunk-jdk11 #1369

2020-04-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Further reduce runtime for metrics integration tests (#8514) -- [...truncated 3.04 MB...] org.apache.kafka.streams.TestTopicsTest >

Build failed in Jenkins: kafka-trunk-jdk8 #4449

2020-04-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing -- [...truncated 6.05 MB...]

[jira] [Created] (KAFKA-9892) Producer state snapshot needs to be forced to disk

2020-04-20 Thread Jun Rao (Jira)
Jun Rao created KAFKA-9892: -- Summary: Producer state snapshot needs to be forced to disk Key: KAFKA-9892 URL: https://issues.apache.org/jira/browse/KAFKA-9892 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-2.4-jdk8 #189

2020-04-20 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-9854 Re-authenticating causes mismatched parse of response (#8471) -- [...truncated 7.04 MB...]

Re: Need permission to update Ecosystem wiki page

2020-04-20 Thread Matthias J. Sax
Did you create an account? What is your account name/id? -Matthias On 4/20/20 10:14 AM, Otis Gospodnetić wrote: > Hi, > > I'd like to update > https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem > I see we have one sort of outdated link there, and I'd like to add > Logagent, which has

Re: [DISCUSS] KIP-578: Add configuration to limit number of partitions

2020-04-20 Thread Gokul Ramanan Subramanian
This is good reference Tom. I did not consider this approach at all. I am happy to learn about it now. However, I think that partition limits are not "yet another" policy configuration. Instead, they are fundamental to partition assignment. i.e. the partition assignment algorithm needs to be

Re: [DISCUSS] KIP-595: A Raft Protocol for the Metadata Quorum

2020-04-20 Thread Jason Gustafson
Hi Deng, Thanks for the question. I mentioned this in the rejected alternatives section. The current proposal is only for metadata, but I am definitely in favor of using Raft for partition replication in the long term as well. There are some interesting tradeoffs in terms of fault tolerance,

Build failed in Jenkins: kafka-trunk-jdk11 #1368

2020-04-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing -- [...truncated 3.04 MB...]

Need permission to update Ecosystem wiki page

2020-04-20 Thread Otis Gospodnetić
Hi, I'd like to update https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem I see we have one sort of outdated link there, and I'd like to add Logagent, which has inputs/outputs for Kafka. I'm an ASF member, though not a Kafka developer. From

Re: Permission to self-assign tickets

2020-04-20 Thread Bill Bejeck
Hi Leonard, You should be all set now. -Bill On Mon, Apr 20, 2020 at 11:09 AM Wang (Leonard) Ge wrote: > Hi Kafka dev team, > > > I am wondering if you can grant me the permission to self-assign tickets? > > My user name is: gw524119574 and email is w...@confluent.io > > Thanks in advance for

Re: [DISCUSS] KIP-594: Expose output topic names from TopologyTestDriver

2020-04-20 Thread Andy Coates
Hey all, > One other point, I’m actually mildly concerned about what you say regarding the outputs to the repartition and changelog topics being captured and verified later. I would consider the data in these topics to be a private interface, and would strongly discourage user code to depend on

Permission to self-assign tickets

2020-04-20 Thread Wang (Leonard) Ge
Hi Kafka dev team, I am wondering if you can grant me the permission to self-assign tickets? My user name is: gw524119574 and email is w...@confluent.io Thanks in advance for your help. Best wishes, Leonard -- Leonard Ge Software Engineer Intern - Confluent

Re: [DISCUSS] KIP-578: Add configuration to limit number of partitions

2020-04-20 Thread Tom Bentley
Hi Gokul, Leaving aside the question of how Kafka scales, I think the proposed solution, limiting the number of partitions in a cluster or per-broker, is a policy which ought to be addressable via the pluggable policies (e.g. create.topic.policy.class.name). Unfortunately although there's a

[GitHub] [kafka] omkreddy commented on issue #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
omkreddy commented on issue #8521: URL: https://github.com/apache/kafka/pull/8521#issuecomment-616604860 @ijuma Thanks for the review. Merging to trunk. This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] WanderingStar commented on issue #8184: KAKFA-9612 CLI Dynamic Configuration with file input

2020-04-20 Thread GitBox
WanderingStar commented on issue #8184: URL: https://github.com/apache/kafka/pull/8184#issuecomment-616585615 @rajinisivaram, @cmccabe, @gwenshap would you mind taking a look at this PR? This is an automated message from the

[GitHub] [kafka] omkreddy commented on a change in pull request #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
omkreddy commented on a change in pull request #8521: URL: https://github.com/apache/kafka/pull/8521#discussion_r411406852 ## File path: .asf.yaml ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See

[GitHub] [kafka] ijuma commented on a change in pull request #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
ijuma commented on a change in pull request #8521: URL: https://github.com/apache/kafka/pull/8521#discussion_r411401447 ## File path: .asf.yaml ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the

[GitHub] [kafka] highluck commented on issue #8114: KAFKA-9290: Update IQ related JavaDocs

2020-04-20 Thread GitBox
highluck commented on issue #8114: URL: https://github.com/apache/kafka/pull/8114#issuecomment-616573641 @mjsax It was a hotfix! #8515 This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] ijuma commented on a change in pull request #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
ijuma commented on a change in pull request #8521: URL: https://github.com/apache/kafka/pull/8521#discussion_r411401447 ## File path: .asf.yaml ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the

[GitHub] [kafka] ijuma commented on a change in pull request #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
ijuma commented on a change in pull request #8521: URL: https://github.com/apache/kafka/pull/8521#discussion_r411400608 ## File path: .asf.yaml ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the

[GitHub] [kafka] omkreddy commented on a change in pull request #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
omkreddy commented on a change in pull request #8521: URL: https://github.com/apache/kafka/pull/8521#discussion_r411399680 ## File path: .asf.yaml ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See

[GitHub] [kafka] ijuma commented on issue #8490: MINOR: Fix compiler warnings and add @nowarn for the unfixed ones

2020-04-20 Thread GitBox
ijuma commented on issue #8490: URL: https://github.com/apache/kafka/pull/8490#issuecomment-616567152 Looks like this annotation is not present in the Scala 2.13 version of this library. So we need to wait for Scala 2.13.2 to be released before we can merge it.

[GitHub] [kafka] ijuma commented on a change in pull request #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
ijuma commented on a change in pull request #8521: URL: https://github.com/apache/kafka/pull/8521#discussion_r411389823 ## File path: .asf.yaml ## @@ -0,0 +1,22 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the

[GitHub] [kafka] omkreddy opened a new pull request #8521: MINOR: Use .asf.yaml to direct github notifications to JIRA and mailing lists

2020-04-20 Thread GitBox
omkreddy opened a new pull request #8521: URL: https://github.com/apache/kafka/pull/8521 Following the instructions from: https://cwiki.apache.org/confluence/display/INFRA/.asf.yaml+features+for+git+repositories#id-.asf.yamlfeaturesforgitrepositories-ImplementedFeatures This PR

[GitHub] [kafka] ijuma commented on a change in pull request #8417: KAFKA-8955: Add an AbstractResponse#errorCounts(Stream) and tidy

2020-04-20 Thread GitBox
ijuma commented on a change in pull request #8417: URL: https://github.com/apache/kafka/pull/8417#discussion_r411381287 ## File path: clients/src/main/java/org/apache/kafka/common/requests/AlterPartitionReassignmentsResponse.java ## @@ -66,14 +64,13 @@ public int

[GitHub] [kafka] ijuma commented on a change in pull request #8417: KAFKA-8955: Add an AbstractResponse#errorCounts(Stream) and tidy

2020-04-20 Thread GitBox
ijuma commented on a change in pull request #8417: URL: https://github.com/apache/kafka/pull/8417#discussion_r411379678 ## File path: clients/src/main/java/org/apache/kafka/common/requests/AbstractResponse.java ## @@ -57,6 +59,10 @@ public ByteBuffer serialize(ApiKeys apiKey,

[GitHub] [kafka] ijuma commented on a change in pull request #8417: KAFKA-8955: Add an AbstractResponse#errorCounts(Stream) and tidy

2020-04-20 Thread GitBox
ijuma commented on a change in pull request #8417: URL: https://github.com/apache/kafka/pull/8417#discussion_r411378332 ## File path: clients/src/main/java/org/apache/kafka/common/requests/AbstractResponse.java ## @@ -57,6 +59,10 @@ public ByteBuffer serialize(ApiKeys apiKey,

[GitHub] [kafka] ijuma commented on issue #8417: KAFKA-8955: Add an AbstractResponse#errorCounts(Stream) and tidy

2020-04-20 Thread GitBox
ijuma commented on issue #8417: URL: https://github.com/apache/kafka/pull/8417#issuecomment-616553082 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] ijuma commented on issue #8449: KAFKA-7613: Enable -Xlint:try, fixing warnings

2020-04-20 Thread GitBox
ijuma commented on issue #8449: URL: https://github.com/apache/kafka/pull/8449#issuecomment-616552849 Yes, I should be able to review this tomorrow. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] ijuma commented on issue #8450: KAFKA-7613: Enable -Xlint:rawtypes in clients, fixing warnings

2020-04-20 Thread GitBox
ijuma commented on issue #8450: URL: https://github.com/apache/kafka/pull/8450#issuecomment-616552532 Yes, I should be able to review this tomorrow. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] tombentley commented on issue #8450: KAFKA-7613: Enable -Xlint:rawtypes in clients, fixing warnings

2020-04-20 Thread GitBox
tombentley commented on issue #8450: URL: https://github.com/apache/kafka/pull/8450#issuecomment-616548913 @ijuma would you be able to take a look at this, since you opened the original issue? This is an automated message

[GitHub] [kafka] tombentley commented on issue #8449: KAFKA-7613: Enable -Xlint:try, fixing warnings

2020-04-20 Thread GitBox
tombentley commented on issue #8449: URL: https://github.com/apache/kafka/pull/8449#issuecomment-616548667 @ijuma would you be able to take a look at this, since you opened the original issue? This is an automated message

[GitHub] [kafka] ijuma commented on issue #8429: MINOR: Enable fatal warnings with scala 2.13

2020-04-20 Thread GitBox
ijuma commented on issue #8429: URL: https://github.com/apache/kafka/pull/8429#issuecomment-616542386 Will rebase after https://github.com/apache/kafka/pull/8490 is merged. Scala 2.13.2 should be released within 1 to 2 weeks and is a requirement for this PR.

[GitHub] [kafka] ijuma edited a comment on issue #8490: MINOR: Fix compiler warnings and add @nowarn for the unfixed ones

2020-04-20 Thread GitBox
ijuma edited a comment on issue #8490: URL: https://github.com/apache/kafka/pull/8490#issuecomment-614073786 Looks like the annotation is somehow not in the binary. I added a comment to the upstream ticket: https://github.com/scala/scala-collection-compat/pull/312#issuecomment-614073213

[GitHub] [kafka] tombentley commented on issue #8222: KAFKA-9650: include human readable units in ms and bytes configs

2020-04-20 Thread GitBox
tombentley commented on issue #8222: URL: https://github.com/apache/kafka/pull/8222#issuecomment-616538532 @mimaison I rewrote that code, which I think makes it clear enough and avoids the repeated constants. Rendered it looks like this: ![Screenshot from 2020-04-20

[GitHub] [kafka] chia7712 commented on a change in pull request #8506: Minor: avoid duplicate unwrapping when end of stream has been reached

2020-04-20 Thread GitBox
chia7712 commented on a change in pull request #8506: URL: https://github.com/apache/kafka/pull/8506#discussion_r411355668 ## File path: clients/src/main/java/org/apache/kafka/common/network/SslTransportLayer.java ## @@ -293,6 +293,11 @@ public void handshake() throws

[GitHub] [kafka] ijuma commented on issue #8519: MINOR: Upgrade gradle plugins and test libraries for Java 14 support

2020-04-20 Thread GitBox
ijuma commented on issue #8519: URL: https://github.com/apache/kafka/pull/8519#issuecomment-616531362 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Created] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

2020-04-20 Thread Mateusz Jadczyk (Jira)
Mateusz Jadczyk created KAFKA-9891: -- Summary: Invalid state store content after task migration with exactly_once and standby replicas Key: KAFKA-9891 URL: https://issues.apache.org/jira/browse/KAFKA-9891

[GitHub] [kafka] rajinisivaram commented on a change in pull request #8506: Minor: avoid duplicate unwrapping when end of stream has been reached

2020-04-20 Thread GitBox
rajinisivaram commented on a change in pull request #8506: URL: https://github.com/apache/kafka/pull/8506#discussion_r411331273 ## File path: clients/src/main/java/org/apache/kafka/common/network/SslTransportLayer.java ## @@ -293,6 +293,11 @@ public void handshake() throws

[GitHub] [kafka] highluck commented on issue #8114: KAFKA-9290: Update IQ related JavaDocs

2020-04-20 Thread GitBox
highluck commented on issue #8114: URL: https://github.com/apache/kafka/pull/8114#issuecomment-616510519 Thank you for reivew Yes ok! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] cadonna commented on a change in pull request #8514: MINOR: Further reduce runtime for metrics integration tests

2020-04-20 Thread GitBox
cadonna commented on a change in pull request #8514: URL: https://github.com/apache/kafka/pull/8514#discussion_r411304452 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/RocksDBMetricsIntegrationTest.java ## @@ -319,18 +266,6 @@ private void

[GitHub] [kafka] cadonna commented on a change in pull request #8514: MINOR: Further reduce runtime for metrics integration tests

2020-04-20 Thread GitBox
cadonna commented on a change in pull request #8514: URL: https://github.com/apache/kafka/pull/8514#discussion_r411304452 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/RocksDBMetricsIntegrationTest.java ## @@ -319,18 +266,6 @@ private void

[GitHub] [kafka] tombentley commented on a change in pull request #8222: KAFKA-9650: include human readable units in ms and bytes configs

2020-04-20 Thread GitBox
tombentley commented on a change in pull request #8222: URL: https://github.com/apache/kafka/pull/8222#discussion_r411295815 ## File path: clients/src/main/java/org/apache/kafka/common/config/ConfigDef.java ## @@ -1179,6 +1186,50 @@ protected String getConfigValue(ConfigKey

Build failed in Jenkins: kafka-trunk-jdk8 #4448

2020-04-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Update to Gradle 6.3 (#7677) -- [...truncated 6.04 MB...] org.apache.kafka.streams.MockTimeTest > shouldSetStartTime STARTED

[GitHub] [kafka] kkonstantine commented on a change in pull request #8445: KAFKA-9823: Remember the sent generation for the coordinator request

2020-04-20 Thread GitBox
kkonstantine commented on a change in pull request #8445: URL: https://github.com/apache/kafka/pull/8445#discussion_r411125481 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -737,16 +751,21 @@ public void

[GitHub] [kafka] kkonstantine commented on a change in pull request #8445: KAFKA-9823: Remember the sent generation for the coordinator request

2020-04-20 Thread GitBox
kkonstantine commented on a change in pull request #8445: URL: https://github.com/apache/kafka/pull/8445#discussion_r411123324 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -737,16 +751,21 @@ public void

[jira] [Created] (KAFKA-9890) Report Kafka topic configs as metrics

2020-04-20 Thread udaysagar (Jira)
udaysagar created KAFKA-9890: Summary: Report Kafka topic configs as metrics Key: KAFKA-9890 URL: https://issues.apache.org/jira/browse/KAFKA-9890 Project: Kafka Issue Type: Wish