Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #271

2020-12-08 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10634; Adding LeaderId to voters list in LeaderChangeMessage along with granting voters (#9539) [github] MINOR: Using primitive data types for loop index (#9705)

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-08 Thread Boyang Chen
Hey Gwen, thanks for the feedback. On Sun, Dec 6, 2020 at 10:06 PM Gwen Shapira wrote: > Agree with Igor. IIRC, we also encountered cases where filewatch was > not triggered as expected. An interval will give us a better > worse-case scenario that is easily controlled by the Kafka admin. > >

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #294

2020-12-08 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-696: Update Streams FSM to clarify ERROR state meaning

2020-12-08 Thread Walker Carlson
Thanks for the feedback Guozhang! I clarified some of the points in the Proposed Changes section so hopefully it will be more clear what is going on now. I also agree with your suggestion about the possible call to close() on ERROR so I added this line. "Close() called on ERROR will be idempotent

[jira] [Created] (KAFKA-10831) Consider increasing default session timeout for consumer

2020-12-08 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10831: --- Summary: Consider increasing default session timeout for consumer Key: KAFKA-10831 URL: https://issues.apache.org/jira/browse/KAFKA-10831 Project: Kafka

[jira] [Created] (KAFKA-10830) Kafka Producer API should throw unwrapped exceptions

2020-12-08 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10830: - Summary: Kafka Producer API should throw unwrapped exceptions Key: KAFKA-10830 URL: https://issues.apache.org/jira/browse/KAFKA-10830 Project: Kafka Issue

[jira] [Created] (KAFKA-10829) Kafka Streams handle produce exception improvement

2020-12-08 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10829: - Summary: Kafka Streams handle produce exception improvement Key: KAFKA-10829 URL: https://issues.apache.org/jira/browse/KAFKA-10829 Project: Kafka Issue

Re: [DISCUSS] KIP-660: Pluggable ReplicaAssignor

2020-12-08 Thread Colin McCabe
On Thu, Dec 3, 2020, at 07:41, Edoardo Comar wrote: > Hi Colin > thanks for your comments. > I think your objections to creating an interface for replica placement > could be used against similar server-side plug-ins (Authorizer, > QuotaCallback). Hi Edoardo, The Authorizer API is not really

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2020-12-08 Thread Colin McCabe
On Thu, Dec 3, 2020, at 16:37, Jun Rao wrote: > Hi, Colin, > > Thanks for the updated KIP. A few more comments below. > Hi Jun, Thanks again for the reviews. > 80.2 For deprecated configs, we need to include zookeeper.* and > broker.id.generation.enable. > Added. > 83.1 If a broker is

[jira] [Created] (KAFKA-10828) Consider using "acknowledged" over "endorsing" for voters which have recognized the current leader

2020-12-08 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10828: --- Summary: Consider using "acknowledged" over "endorsing" for voters which have recognized the current leader Key: KAFKA-10828 URL:

Re: [DISCUSS] KIP-696: Update Streams FSM to clarify ERROR state meaning

2020-12-08 Thread Guozhang Wang
Hello Walker, Thanks for the KIP! Overall it looks reasonable to me. Just a few minor comments for the wiki page itself: 1) Could you clarify the conditions when RUNNING / REBALANCING -> PENDING_ERROR will happen; and when PENDING_ERROR -> ERROR will happen. E.g. when I read "Streams will only

[jira] [Created] (KAFKA-10827) Consumer group coordinator node never gets updated for manual partition assignment

2020-12-08 Thread Jaebin Yoon (Jira)
Jaebin Yoon created KAFKA-10827: --- Summary: Consumer group coordinator node never gets updated for manual partition assignment Key: KAFKA-10827 URL: https://issues.apache.org/jira/browse/KAFKA-10827

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #293

2020-12-08 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10264; Fix Flaky Test TransactionsTest.testBumpTransactionalEpoch (#9291) [github] MINOR: Configure reconnect backoff in `BrokerToControllerChannelManager` (#9709)

[DISCUSS] KIP-696: Update Streams FSM to clarify ERROR state meaning

2020-12-08 Thread Walker Carlson
Hello all, I'd like to propose KIP-696 to clarify the meaning of ERROR state in the KafkaStreams Client State Machine. This will update the States to be consistent with changes in KIP-671 and KIP-663. Here are the details: https://cwiki.apache.org/confluence/x/lCvZCQ Thanks, Walker

[jira] [Created] (KAFKA-10826) Ensure raft io thread wakes up after linger expiration

2020-12-08 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10826: --- Summary: Ensure raft io thread wakes up after linger expiration Key: KAFKA-10826 URL: https://issues.apache.org/jira/browse/KAFKA-10826 Project: Kafka

[jira] [Created] (KAFKA-10825) Consolidate code between ZK and AlterISR for ISR updates

2020-12-08 Thread David Arthur (Jira)
David Arthur created KAFKA-10825: Summary: Consolidate code between ZK and AlterISR for ISR updates Key: KAFKA-10825 URL: https://issues.apache.org/jira/browse/KAFKA-10825 Project: Kafka

[jira] [Resolved] (KAFKA-10756) Add missing unit test for `UnattachedState`

2020-12-08 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10756. - Resolution: Fixed > Add missing unit test for `UnattachedState` >

Re: [DISCUSS] KIP-693: Client-side Circuit Breaker for Partition Write Errors

2020-12-08 Thread Justine Olshan
Hi George, I've been looking at the discussion on improving the sticky partitioner, and one of the potential issues we discussed is how we could get information to the partitioner to tell it not to choose certain partitions. Currently, the partitioner can only use availablePartitionsForTopic. I

Re: [DISCUSS] KIP-693: Client-side Circuit Breaker for Partition Write Errors

2020-12-08 Thread Jun Rao
Hi, George, Thanks for submitting the KIP. There was an earlier discussing on improving the sticky partitioner in the producer ( https://lists.apache.org/thread.html/rae8d2d5587dae57ad9093a85181e0cb4256f10d1e57138ecdb3ef287%40%3Cdev.kafka.apache.org%3E). It seems to be solving a very similar

Re: [VOTE] KIP-679: Producer will enable the strongest delivery guarantee by default

2020-12-08 Thread Cheng Tan
Thanks you all for discussing and voting on this KIP. Now it has been approved with 4 binding votes. Best, - Cheng > On Dec 8, 2020, at 12:52 AM, David Jacot wrote: > > +1 (binding) > > Thanks for the KIP, Cheng! > > On Tue, Dec 8, 2020 at 12:23 AM Ismael Juma wrote: > >> Thanks, +1

[jira] [Resolved] (KAFKA-10264) Flaky Test TransactionsTest.testBumpTransactionalEpoch

2020-12-08 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10264. - Resolution: Fixed > Flaky Test TransactionsTest.testBumpTransactionalEpoch >

[VOTE] KIP-695: Improve Streams Time Synchronization

2020-12-08 Thread John Roesler
Hello all, There hasn't been much discussion on KIP-695 so far, so I'd like to go ahead and call for a vote. As a reminder, the purpose of KIP-695 to improve on the "task idling" feature we introduced in KIP-353. This KIP will allow Streams to offer deterministic time semantics in join-type

Re: [DISCUSS] KIP-695: Improve Streams Time Synchronization

2020-12-08 Thread John Roesler
Thanks for taking a look, Bruno! You have a sharp eye. All I meant by that is that we don't want to draw conclusions from metadata that we received a long time ago (for example, if fetches have been failing), but we also don't want to enforce waiting on a new fetch every single time we process a

[DISCUSS] KIP-693: Client-side Circuit Breaker for Partition Write Errors

2020-12-08 Thread 舒国强
Hello, We write up a KIP based on a straightforward mechanism implemented and tested in order to solve a practical issue in production. https://cwiki.apache.org/confluence/display/KAFKA/KIP-693%3A+Client-side+Circuit+Breaker+for+Partition+Write+Errors Look forward to hearing feedback and

[DISCUSS] KIP-694: Support Reducing Partitions for Topics

2020-12-08 Thread 舒国强
Hello, We write up a KIP based on a straightforward mechanism implemented and tested in order to solve a practical issue in production. https://cwiki.apache.org/confluence/display/KAFKA/KIP-694%3A+Support+Reducing+Partitions+for+Topics Look forward to hearing feedback and suggestions. Thanks!

[VOTE] KIP-690: Add additional configuration to control MirrorMaker 2 internal topics naming convention

2020-12-08 Thread Omnia Ibrahim
Hi everyone, I’m proposing a new KIP for MirrorMaker 2 to add the ability to control internal topics naming convention. The proposal details are here https://cwiki.apache.org/confluence/display/KAFKA/KIP-690%3A+Add+additional+configuration+to+control+MirrorMaker+2+internal+topics+naming+convention

[jira] [Created] (KAFKA-10824) Connection to node -1 could not be established.

2020-12-08 Thread Mohammad Abboud (Jira)
Mohammad Abboud created KAFKA-10824: --- Summary: Connection to node -1 could not be established. Key: KAFKA-10824 URL: https://issues.apache.org/jira/browse/KAFKA-10824 Project: Kafka Issue

Re: [DISCUSS] KIP-695: Improve Streams Time Synchronization

2020-12-08 Thread Bruno Cadonna
Thank you for the KIP, John! Overall, the KIP looks good to me. I was just wondering what do you mean by "too stale". Could you define "too stale"? Best, Bruno On 04.12.20 23:39, John Roesler wrote: Hello all, I'd like to propose KIP-695 to improve on the "task idling" feature we

Re: [VOTE] KIP-679: Producer will enable the strongest delivery guarantee by default

2020-12-08 Thread David Jacot
+1 (binding) Thanks for the KIP, Cheng! On Tue, Dec 8, 2020 at 12:23 AM Ismael Juma wrote: > Thanks, +1 (binding). > > On Mon, Dec 7, 2020 at 1:40 PM Cheng Tan wrote: > > > Hi Ismael, > > > > Yes. Add deprecation warning for `IDEMPOTENT_WRITE` in 3.0 makes sense. > > I’ve updated the KIP’s