[jira] [Resolved] (KAFKA-10090) Misleading warnings: The configuration was supplied but isn't a known config

2020-12-02 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10090. Fix Version/s: 2.8.0 Resolution: Fixed > Misleading warnings: The configuration

[jira] [Resolved] (KAFKA-10794) Replica leader election is too slow in the case of too many partitions

2020-12-02 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10794. Fix Version/s: 2.8.0 Resolution: Fixed > Replica leader election is too slow in

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-12-02 Thread Matthias J. Sax
One more follow up: do we need to update the Scala API, too? -Matthias On 12/2/20 7:51 AM, Leah Thomas wrote: > Thanks for the feedback! I'll go ahead and move it to vote now. > > Best, > Leah > > On Wed, Dec 2, 2020 at 6:58 AM Bruno Cadonna wrote: > >> Thanks for the KIP! >> >> LGTM, as

[jira] [Created] (KAFKA-10800) Validate the snapshot id when the state machine creates a snapshot

2020-12-02 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-10800: -- Summary: Validate the snapshot id when the state machine creates a snapshot Key: KAFKA-10800 URL: https://issues.apache.org/jira/browse/KAFKA-10800

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2020-12-02 Thread Jun Rao
Hi, Satish, Thanks for the updated KIP. A few more comments below. 605.2 It's rare for the follower to need the remote data. So, the current approach is fine too. Could you document the process of rebuilding the producer state since we can't simply trim the producerState to an offset in the

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2020-12-02 Thread Boyang Chen
Thanks Matthias, I think your proposal makes sense as well, on the pro side we could have a universally agreed exception type to be caught by the user, without having an extra layer on top of the actual exceptions. I could see some issue on downsides: 1. The exception hierarchy will be more

[jira] [Created] (KAFKA-10801) Docs on configuration have multiple places using the same HTML anchor tag

2020-12-02 Thread James Cheng (Jira)
James Cheng created KAFKA-10801: --- Summary: Docs on configuration have multiple places using the same HTML anchor tag Key: KAFKA-10801 URL: https://issues.apache.org/jira/browse/KAFKA-10801 Project:

Re: Can I get a review for a documentation update (KAFKA-10473)?

2020-12-02 Thread James Cheng
Hi, Can I get a review for this small documentation update? Thanks, -James > On Oct 9, 2020, at 5:23 PM, James Cheng wrote: > > Hi, > > Would someone be able to review this pull request for me? > > This is a small documentation change. > > Thanks, > -James > >> On Sep 24, 2020, at 11:53

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2020-12-02 Thread Colin McCabe
On Wed, Dec 2, 2020, at 14:07, Ron Dagostino wrote: > Hi Colin. Thanks for the updates. It's now clear to me that brokers > keep their broker epoch for the life of their JVM -- they register > once, get their broker epoch in the response, and then never > re-register again. Brokers may get

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2020-12-02 Thread Matthias J. Sax
Thanks for the KIP Boyang! Overall, categorizing exceptions makes a lot of sense. As I don't know the producer internals well enough, I cannot comment on the categorization in detail though. What I am wondering is, if we should introduce an exception interface that non-fatal exception would

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #299

2020-12-02 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #253

2020-12-02 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10090 Misleading warnings: The configuration was supplied but i… (#8826) [github] KAFKA-10794 Replica leader election is too slow in the case of too many partitions

[jira] [Created] (KAFKA-10795) Automated protocol should expose Map keyed by TopicPartition

2020-12-02 Thread David Jacot (Jira)
David Jacot created KAFKA-10795: --- Summary: Automated protocol should expose Map keyed by TopicPartition Key: KAFKA-10795 URL: https://issues.apache.org/jira/browse/KAFKA-10795 Project: Kafka

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-12-02 Thread Leah Thomas
Thanks for the feedback! I'll go ahead and move it to vote now. Best, Leah On Wed, Dec 2, 2020 at 6:58 AM Bruno Cadonna wrote: > Thanks for the KIP! > > LGTM, as well! > > Best, > Bruno > > On 02.12.20 00:41, Walker Carlson wrote: > > Thanks for making these changes. It makes more sense now to

Subscribe to kafka dev mailing list

2020-12-02 Thread ????
Subscribe to Kafka dev mailing list

[DISCUSSION] KIP-650: Enhance Kafkaesque Raft semantics

2020-12-02 Thread Boyang Chen
Hey there, I would like to start a discussion thread for a KIP to improve on our existing Kafka Raft semantics, specifically adding pre-vote and linearizable read: https://cwiki.apache.org/confluence/display/KAFKA/KIP-650%3A+Enhance+Kafkaesque+Raft+semantics Let me know what you think, thank

[jira] [Created] (KAFKA-10799) AlterIsr path does not update ISR shrink/expand meters

2020-12-02 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10799: --- Summary: AlterIsr path does not update ISR shrink/expand meters Key: KAFKA-10799 URL: https://issues.apache.org/jira/browse/KAFKA-10799 Project: Kafka

Re: [VOTE] KIP-689: Extend `StreamJoined` to allow more store configs

2020-12-02 Thread Walker Carlson
+1 (non-binding) Thank you, walker On Wed, Dec 2, 2020 at 8:15 AM Bruno Cadonna wrote: > +1 (non-binding) > > Thanks Leah! > > Best, > Bruno > > On 02.12.20 16:55, Leah Thomas wrote: > > Hi all, > > > > I'd like to start the vote for KIP-689 for enabling/disabling logging for > >

Config command to describe SSL certificate paramters

2020-12-02 Thread Nikolay Izhikov
Hello. Kafka has an ability to configure SSL connections between brokers and clients. SSL certificates has different params such as * issuer * CN * validity date and so on. Values of these parameters important during maintenance: *

Re: [VOTE] 2.7.0 RC3

2020-12-02 Thread Jason Gustafson
Hi Bill, I found a potential blocker here: https://issues.apache.org/jira/browse/KAFKA-10799. A patch should be along shortly. Best, Jason On Mon, Nov 30, 2020 at 7:27 AM Bill Bejeck wrote: > Thanks for the vote, Gwen. > > Here's an update for Jenkins build > > * Successful Jenkins builds

[VOTE] KIP-689: Extend `StreamJoined` to allow more store configs

2020-12-02 Thread Leah Thomas
Hi all, I'd like to start the vote for KIP-689 for enabling/disabling logging for `StreamJoined`. https://cwiki.apache.org/confluence/display/KAFKA/KIP-689%3A+Extend+%60StreamJoined%60+to+allow+more+store+configs Thanks, Leah

Re: [VOTE] KIP-689: Extend `StreamJoined` to allow more store configs

2020-12-02 Thread Bruno Cadonna
+1 (non-binding) Thanks Leah! Best, Bruno On 02.12.20 16:55, Leah Thomas wrote: Hi all, I'd like to start the vote for KIP-689 for enabling/disabling logging for `StreamJoined`.

Re: Sticky Partitioner

2020-12-02 Thread Justine Olshan
Hi Evelyn, Thanks for taking a look at improving the sticky partitioner! These edge cases seem like they would cause quite a bit a trouble. I think the idea to check for max.in.flight.requests.per.connection is a good one, but one concern I have is how this information will be available to the

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #252

2020-12-02 Thread Apache Jenkins Server
See

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-12-02 Thread Nikolay Izhikov
Hello, Paul. Thanks for the feedback! > How does the producer get notified of a failure to pass the RecordPolicy for > one or more records, The producer will receive `PolicyViolationException`. > how should it recover? Obvious answers are Producer should switch to the correct schema OR

[jira] [Created] (KAFKA-10797) Build / JDK 8 / org.apache.kafka.common.security.authenticator.SaslAuthenticatorTest.testValidSaslPlainOverSsl failed

2020-12-02 Thread limeng (Jira)
limeng created KAFKA-10797: -- Summary: Build / JDK 8 / org.apache.kafka.common.security.authenticator.SaslAuthenticatorTest.testValidSaslPlainOverSsl failed Key: KAFKA-10797 URL:

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-12-02 Thread Bruno Cadonna
Thanks for the KIP! LGTM, as well! Best, Bruno On 02.12.20 00:41, Walker Carlson wrote: Thanks for making these changes. It makes more sense now to me. Overall LGTM walker On Tue, Dec 1, 2020 at 3:39 PM Sophie Blee-Goldman wrote: Thanks for the KIP! I'm happy with the state of things

[jira] [Created] (KAFKA-10796) USE OF BLACK HOLE RACIST TERMINOLOGY

2020-12-02 Thread Veerendra Singavarapu (Jira)
Veerendra Singavarapu created KAFKA-10796: - Summary: USE OF BLACK HOLE RACIST TERMINOLOGY Key: KAFKA-10796 URL: https://issues.apache.org/jira/browse/KAFKA-10796 Project: Kafka Issue

[jira] [Created] (KAFKA-10798) Failed authentication delay doesn't work with some SASL authentication failures

2020-12-02 Thread Rajini Sivaram (Jira)
Rajini Sivaram created KAFKA-10798: -- Summary: Failed authentication delay doesn't work with some SASL authentication failures Key: KAFKA-10798 URL: https://issues.apache.org/jira/browse/KAFKA-10798

Re: [DISCUSS] KIP-660: Pluggable ReplicaAssignor

2020-12-02 Thread Colin McCabe
Hi Mickael, To be honest, I think it would be better not to make replica placement pluggable. When I worked on the Hadoop Distributed Filesystem, we supported pluggable replica placement policies, and it never worked out well. Users would write plugin code that ran in a very sensitive

Re: [VOTE] KIP-689: Extend `StreamJoined` to allow more store configs

2020-12-02 Thread Sophie Blee-Goldman
Thanks for the KIP! +1 (binding) Sophie On Wed, Dec 2, 2020 at 8:42 AM Walker Carlson wrote: > +1 (non-binding) > > Thank you, > walker > > On Wed, Dec 2, 2020 at 8:15 AM Bruno Cadonna wrote: > > > +1 (non-binding) > > > > Thanks Leah! > > > > Best, > > Bruno > > > > On 02.12.20 16:55, Leah

[DISCUSS] KIP-691: Transactional Producer Exception Handling

2020-12-02 Thread Boyang Chen
Hey there, I would like to start a discussion thread for KIP-691: https://cwiki.apache.org/confluence/display/KAFKA/KIP-691%3A+Enhance+Transactional+Producer+Exception+Handling The KIP is aiming to simplify the exception handling logic for transactional Producer users by classifying fatal and

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2020-12-02 Thread Ron Dagostino
Hi Colin. Thanks for the updates. It's now clear to me that brokers keep their broker epoch for the life of their JVM -- they register once, get their broker epoch in the response, and then never re-register again. Brokers may get fenced, but they keep the same broker epoch for the life of

Re: [VOTE] 2.7.0 RC3

2020-12-02 Thread Bill Bejeck
Thanks for the heads-up. I agree this should go into 2.7. I'll roll a new RC once you merge the patch. -Bill On Wed, Dec 2, 2020 at 1:28 PM Jason Gustafson wrote: > Hi Bill, > > I found a potential blocker here: > https://issues.apache.org/jira/browse/KAFKA-10799. A patch should be along >