Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #119

2020-09-28 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H48 (ubuntu) in workspace

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #123

2020-09-28 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H48 (ubuntu) in workspace

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #124

2020-09-28 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H48 (ubuntu) in workspace

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-09-28 Thread Tom Bentley
Hi Dongjin, Sorry for the late reply. 1. I think translating the name "root" to "" would work fine. 2. The second bullet in the Connect section of the KIP seems to need some translation between null and OFF, similar to the name translation. 3. The third bullet seems to be about logger

Re: Why should SASL principal be unchanged upon reauth

2020-09-28 Thread Gokul Ramanan Subramanian
Thanks Ron. Does this mean that it would be safe to remove the "KafkaPrincipal has not changed after reauth" check in a future version? Or do you think there are portions of the code that work under the assumption that this check exists? On Sun, Sep 27, 2020 at 12:07 AM Ron Dagostino wrote: >

[jira] [Created] (KAFKA-10530) kafka-streams-application-reset misses some internal topics

2020-09-28 Thread Oliver Weiler (Jira)
Oliver Weiler created KAFKA-10530: - Summary: kafka-streams-application-reset misses some internal topics Key: KAFKA-10530 URL: https://issues.apache.org/jira/browse/KAFKA-10530 Project: Kafka

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2020-09-28 Thread Colin McCabe
On Fri, Sep 25, 2020, at 17:35, Jun Rao wrote: > Hi, Colin, > > Thanks for the reply. > > 62. Thinking about this more, I am wondering what's our overall strategy > for configs shared between the broker and the controller. For example, both > the broker and the controller have to define

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-28 Thread Dongjin Lee
Hi John, I updated the KIP with the discussion above. The 'Public Interfaces' section describes the new API, and the 'Rejected Alternatives' section describes the reasoning about why we selected this API design and rejected the other alternatives. Please have a look when you are free. And please

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2020-09-28 Thread Satish Duggana
Hi Dhruvil, Thanks for looking into the KIP and sending your comments. Sorry for the late reply, missed it in the mail thread. 1. Could you describe how retention would work with this KIP and which threads are responsible for driving this work? I believe there are 3 kinds of retention processes

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-09-28 Thread Dongjin Lee
> 3. ... For the same reason I call that a bug, I think the description in the KIP is incorrect. Agree, the description in the KIP is written before you open a PR ( https://github.com/apache/kafka/pull/9266) - As you remember, I am participating the review. I think it is a bug and should be

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #92

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10502: Use Threadlocal.remote to avoid leak on TimestampRouter (#9304) -- [...truncated 6.65 MB...]

Re: [DISCUSS] KIP-673: Emit JSONs with new auto-generated schema

2020-09-28 Thread Tom Bentley
Hi Anastasia, Thanks for those changes. I eventually figured out that the XYZJsonDataConverter are the new classes from the factoring-out of the Jackson dependency (KAFKA-10384), after which the proposal made much more sense to me. Apologies for being slow on the uptake there. I can see now that

[jira] [Created] (KAFKA-10529) Controller should throttle partition reassignment

2020-09-28 Thread Badai Aqrandista (Jira)
Badai Aqrandista created KAFKA-10529: Summary: Controller should throttle partition reassignment Key: KAFKA-10529 URL: https://issues.apache.org/jira/browse/KAFKA-10529 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #120

2020-09-28 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H48 (ubuntu) in workspace

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #93

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] MINOR: Update the javadoc in GroupMetadataManager.scala (#9241) -- [...truncated 3.33 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #94

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] MINOR: Update the javadoc in GroupMetadataManager.scala (#9241) -- [...truncated 6.70 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #122

2020-09-28 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H48 (ubuntu) in workspace

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #121

2020-09-28 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H48 (ubuntu) in workspace

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #125

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] MINOR: standardize rebalance related logging for easy discovery & debugging (#9295) [github] MINOR: add docs for 2.7 TRACE-level e2e latency metrics (#9339) [github]

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-09-28 Thread Justine Olshan
Hello all, I just wanted to follow up on this discussion. Did we come to an understanding about the directory structure? I think the biggest question here is what is acceptable to leave out due to scope vs. what is considered to be too much tech debt. This KIP is already pretty large with the

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2020-09-28 Thread Jun Rao
Hi, Colin, Thanks for the reply. A few more comments below. 62. 62.1 controller.listener.names: So, is this used for the controller or the broker trying to connect to the controller? 62.2 If we want to take the approach to share the configs that are common between the broker and the controller,

[jira] [Created] (KAFKA-10531) KafkaBasedLog can sleep for negative values

2020-09-28 Thread Vikas Singh (Jira)
Vikas Singh created KAFKA-10531: --- Summary: KafkaBasedLog can sleep for negative values Key: KAFKA-10531 URL: https://issues.apache.org/jira/browse/KAFKA-10531 Project: Kafka Issue Type: Bug

Re: Why should SASL principal be unchanged upon reauth

2020-09-28 Thread Gokul Ramanan Subramanian
Thanks Ron. Makes sense. I'll pitch the idea of writing this KIP to my team. On Mon, Sep 28, 2020 at 11:01 PM Ron Dagostino wrote: > Hi Gokul. This would require a KIP to discuss. If you have a compelling > need to change this then I encourage you to create a KIP and start the > discussion.

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #126

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10509: Added throttle connection accept rate metric (KIP-612) (#9317) -- [...truncated 3.35 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #95

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10509: Added throttle connection accept rate metric (KIP-612) (#9317) -- [...truncated 6.70 MB...]

Re: Why should SASL principal be unchanged upon reauth

2020-09-28 Thread Ron Dagostino
Hi Gokul. This would require a KIP to discuss. If you have a compelling need to change this then I encourage you to create a KIP and start the discussion. I’m not aware of anything specific that would prevent the change, but I will say that my gut instinct says it wouldn’t be a good idea

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #94

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10509: Added throttle connection accept rate metric (KIP-612) (#9317) [github] KAFKA-9584: Fix Headers ConcurrentModificationException in Streams (#8181)

Re: ApacheCon Bug Bash

2020-09-28 Thread Tom DuBuisson
Kafka devs, The bug bash is tomorrow. If any core contributors would like to chime in we can still get the github app hooked up. If you aren't a core contributor then you can still join the ApacheCon bug bash and we'll be sure to share the analysis results so you can have some fun regardless.

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-09-28 Thread Jose Garcia Sancio
Thanks Jason. Some comments below. > > Generally the number of snapshots on disk will be one. I suspect that > users will want some control over this. We can add a configuration > option that doesn't delete, or advances the log begin offset past, the > N latest snapshots. We can set the default

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-28 Thread Walker Carlson
I think that Guozhang and Matthias make good points. https://cwiki.apache.org/confluence/display/KAFKA/KIP-671%3A+Introduce+Kafka+Streams+Specific+Uncaught+Exception+Handler I have updated the kip to include a StreamsUncaughtExceptionHandler On Sun, Sep 27, 2020 at 7:28 PM Guozhang Wang

[jira] [Created] (KAFKA-10532) Do not wipe state store under EOS when closing a RESTORING active or RUNNING standby task

2020-09-28 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10532: - Summary: Do not wipe state store under EOS when closing a RESTORING active or RUNNING standby task Key: KAFKA-10532 URL: https://issues.apache.org/jira/browse/KAFKA-10532

[jira] [Resolved] (KAFKA-10511) Fix minor behavior difference in `MockLog`

2020-09-28 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10511. - Resolution: Fixed > Fix minor behavior difference in `MockLog` >

Build failed in Jenkins: Kafka » kafka-2.4-jdk8 #6

2020-09-28 Thread Apache Jenkins Server
See Changes: [John Roesler] KAFKA-9584: Fix Headers ConcurrentModificationException in Streams (#8181) [John Roesler] MINOR: add task ':streams:testAll' (#9073)

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #96

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9584: Fix Headers ConcurrentModificationException in Streams (#8181) [github] KAFKA-10218: Stop reading config topic in every subsequent tick if catchup fails once

Build failed in Jenkins: Kafka » kafka-2.5-jdk8 #9

2020-09-28 Thread Apache Jenkins Server
See Changes: [John Roesler] KAFKA-9584: Fix Headers ConcurrentModificationException in Streams (#8181) [John Roesler] MINOR: add task ':streams:testAll' (#9073)

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-28 Thread John Roesler
Hi Dongjin, Thanks! Sorry, I missed your prior message. The proposed API looks good to me. I’m wondering if we should specify what kind of store view would be returned when querying the operation result. It seems like it must be a ReadOnlyKeyValueStore. Does that sound right? Thanks! John

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #127

2020-09-28 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-09-28 Thread Jose Garcia Sancio
Thanks for the reply Jun. Some comments below. Here are the changes: https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=158864763=27=26 > 20. Good point on metadata cache. I think we need to make a decision > consistently. For example, if we decide that dedicated voter

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #95

2020-09-28 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-09-28 Thread Jose Garcia Sancio
Hi Guozhang, Thanks for your feedback. It was very helpful. See my comments below. Changes to the KIP: https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=158864763=28=27 On Sun, Sep 27, 2020 at 9:02 PM Guozhang Wang wrote: > > Hello Jose, > > Thanks for the KIP. Overall

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #97

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10511; Ensure monotonic start epoch/offset updates in `MockLog` (#9332) -- [...truncated 3.35 MB...]

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-28 Thread Guozhang Wang
Hello Walker, Thanks for the updated KIP proposal. A few more comments below: 1. "The RocksDB metrics recording thread is not shutdown." Why it should not be shut down in either client or application shutdown cases? 2. Should we deprecate the existing overloaded function with the java

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #128

2020-09-28 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10218: Stop reading config topic in every subsequent tick if catchup fails once (#8973) [github] KAFKA-10511; Ensure monotonic start epoch/offset updates in `MockLog`

Build failed in Jenkins: Kafka » kafka-2.5-jdk8 #10

2020-09-28 Thread Apache Jenkins Server
See Changes: [Randall Hauch] KAFKA-10218: Stop reading config topic in every subsequent tick if catchup fails once (#8973) -- [...truncated 3.09 MB...]