[jira] [Resolved] (KAFKA-10456) wrong description in kafka-console-producer.sh help

2020-09-02 Thread huxihx (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxihx resolved KAFKA-10456. Fix Version/s: 2.7.0 Resolution: Fixed > wrong description in kafka-console-producer.sh help >

Re: [VOTE] KIP-554: Add Broker-side SCRAM Config API

2020-09-02 Thread Ron Dagostino
Hi Rajini. Thanks for the explanation. I think these are the APIs that are authorized via the ALTER CLUSTER operation, none of which are restricted when authenticating via delegation token: ALTER_PARTITION_REASSIGNMENTS ALTER_REPLICA_LOG_DIRS CREATE_ACL DELETE_ACL ELECT_LEADERS I think if we

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #40

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] https://issues.apache.org/jira/browse/KAFKA-10456 (#9240) -- [...truncated 3.25 MB...] org.apache.kafka.streams.TopologyTestDriverTest

[jira] [Resolved] (KAFKA-10098) Remove unnecessary escaping in regular expression in SaslAuthenticatorTest.java

2020-09-02 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10098. Fix Version/s: 2.7.0 Resolution: Fixed > Remove unnecessary escaping in regular

Regarding Contributor access

2020-09-02 Thread Satyawati Tripathi
Hi Team, Please provide me contributor access on Jira for Kafka Project. Thanks, Satyawati Tripathi

Re: Regarding Contributor access

2020-09-02 Thread Satyawati Tripathi
I want to work on Jira : https://issues.apache.org/jira/browse/KAFKA-10375 Username: Satyatr On Wed, Sep 2, 2020 at 4:35 PM Satyawati Tripathi < satyawatitripathi@gmail.com> wrote: > Hi Team, > > Please provide me contributor access on Jira for Kafka Project. > > Thanks, > Satyawati

Request for contributor Access to JIRA

2020-09-02 Thread Anoop Shenoy
Dear Team, I am a developer and interested in contributing for the Open Source community. JIRA ID: *anoop.shenoy* Please do the needful. Regards, Anoop

[jira] [Resolved] (KAFKA-10272) kafka-server-stop.sh fails on IBM i

2020-09-02 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10272. Fix Version/s: 2.7.0 Resolution: Fixed > kafka-server-stop.sh fails on IBM i >

Re: Regarding Contributor access

2020-09-02 Thread Mickael Maison
Done. Thanks for your interest in Apache Kafka! On Wed, Sep 2, 2020 at 6:01 PM Satyawati Tripathi wrote: > > I want to work on Jira : https://issues.apache.org/jira/browse/KAFKA-10375 > > Username: Satyatr > > On Wed, Sep 2, 2020 at 4:35 PM Satyawati Tripathi < > satyawatitripathi@gmail.com>

Re: Request for contributor Access to JIRA

2020-09-02 Thread Mickael Maison
Done. Thanks for your interest in Apache Kafka! On Wed, Sep 2, 2020 at 6:01 PM Anoop Shenoy wrote: > > Dear Team, > > I am a developer and interested in contributing for the Open Source > community. > > JIRA ID: *anoop.shenoy* > > Please do the needful. > > Regards, > Anoop

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #41

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10098: Remove unnecessary escaping in regular expression. (#8798) [github] KAFKA-10272: Add IBM i support to "stop" scripts (#9023)

[jira] [Resolved] (KAFKA-10129) Fail QA if there are javadoc warnings

2020-09-02 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10129. Resolution: Won't Fix > Fail QA if there are javadoc warnings >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #41

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10098: Remove unnecessary escaping in regular expression. (#8798) -- [...truncated 3.25 MB...]

Re: [VOTE] KIP-554: Add Broker-side SCRAM Config API

2020-09-02 Thread Rajini Sivaram
Hi Ron, Not sure the person who creates/manages users is always the person who controls access to Kafka resources. Separate ACLs gives the flexibility to keep them separate while you can still grant both to the user, while a combined ACL means that they can only be granted together. A related

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #42

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10272: Add IBM i support to "stop" scripts (#9023) [github] MINOR: Include call name in TimeoutException (#8050) --

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #39

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10098: Remove unnecessary escaping in regular expression. (#8798) [github] KAFKA-10272: Add IBM i support to "stop" scripts (#9023) [github] MINOR: Include call name in

Re: [VOTE] KIP-554: Add Broker-side SCRAM Config API

2020-09-02 Thread Ron Dagostino
Thanks, Rajini. That's a good point about authorizing user creation and ACL creation separately to enable that separation as an *option* -- I agree with that, which I think argues for a separate ALTER_USER operation (or ALTER_USER_CREDENTIAL operation; not sure what the best name is, but probably

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

2020-09-02 Thread Matthias J. Sax
Thanks for updating the KIP. Why do you propose to return `boolean` from addStreamThread() if the thread could not be started? As an alternative, we could also throw an exception if the client is not in state RUNNING? -- I guess both are valid options: just want to see what the pros/cons of each

Re: [VOTE] KIP-612: Ability to Limit Connection Creation Rate on Brokers

2020-09-02 Thread David Jacot
Hi Anna, Thanks for the update. If you use Token Bucket, it will expose another metric which reports the number of remaining tokens in the bucket, in addition to the current rate metric. It would be great to add it in the metrics section of the KIP as well for completeness. Best, David On Tue,

Request for KIP creation access

2020-09-02 Thread satyanarayan komandur
Hi, I would like to have the access for creating KIP for Kafka. My wiki id is ksbalan2016. I have opened a Jira ticket and had brief interaction with Mathias on stack overflow about this ticket. He would like me to open a KIp in this regards. Thanks for your help Please let me know if you have

Re: [VOTE] KIP-554: Add Broker-side SCRAM Config API

2020-09-02 Thread Rajini Sivaram
Hi Ron, Sounds good to me, thank you. Regards, Rajini On Wed, Sep 2, 2020 at 8:00 PM Ron Dagostino wrote: > Thanks, Rajini. That's a good point about authorizing user creation and > ACL creation separately to enable that separation as an *option* -- I agree > with that, which I think

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2020-09-02 Thread Leah Thomas
Hey John, I see what you say about the console consumer in particular. I don't think that adding the extra config would *hurt* at all, so I'm good with keeping that in the KIP. I re-updated the KIP proposal to include the configs. The serde resolution sounds good to me as well, I added a few

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #42

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] MINOR: Include call name in TimeoutException (#8050) [github] MINOR: Fix build scala 2.12 build after KAFKA-10020 (#9245) --

Re: [VOTE] KIP-554: Add Broker-side SCRAM Config API

2020-09-02 Thread Rajini Sivaram
Hi Ron/Colin, Without any restrictions, if delegation tokens can be used to create new users or change the password of the user you are impersonating, you also get the power to create/renew a new token by authenticating as a SCRAM user you just created or updated. It seems like a new power that

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #38

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] https://issues.apache.org/jira/browse/KAFKA-10456 (#9240) -- [...truncated 3.23 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #40

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] https://issues.apache.org/jira/browse/KAFKA-10456 (#9240) -- [...truncated 3.25 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Re: [DISCUSS] KIP-655: Windowed "Distinct" Operation for KStream

2020-09-02 Thread Matthias J. Sax
Thanks for the KIP Ivan. Having a built-in deduplication operator is for sure a good addition. Couple of questions: (1) Using the `idExtractor` has the issue that data might not be co-partitioned as you mentioned in the KIP. Thus, I am wondering if it might be better to do deduplication only on

Re: [VOTE] KIP-614: Add Prefix Scan support for State Stores

2020-09-02 Thread Guozhang Wang
Thanks for the KIP Sagar. I'm +1 (binding) too. Guozhang On Tue, Sep 1, 2020 at 1:24 PM Bill Bejeck wrote: > Thanks for the KIP! This is a great addition to the streams API. > > +1 (binding) > > -Bill > > On Tue, Sep 1, 2020 at 12:33 PM Sagar wrote: > > > Hi All, > > > > Bumping the thread

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2020-09-02 Thread John Roesler
Thanks, Leah, This sounds good! -John On Wed, Sep 2, 2020, at 19:23, Matthias J. Sax wrote: > Thanks for the KIP and the detailed discussion. I guess this all makes > sense. > > -Matthias > > On 9/2/20 1:28 PM, Leah Thomas wrote: > > Hey John, > > > > I see what you say about the console

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #41

2020-09-02 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-406: GlobalStreamThread should honor custom reset policy

2020-09-02 Thread Matthias J. Sax
Thanks for the input Sophie. Those are all good points and I fully agree with them. When saying "pausing the processing threads" I only considered them in `RUNNING` and thought we figure out the detail on the PR... Excellent catch! Changing state transitions is to some extend backward

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #43

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix build scala 2.12 build after KAFKA-10020 (#9245) -- [...truncated 6.52 MB...] org.apache.kafka.streams.TestTopicsTest >

Re: Request for KIP creation access

2020-09-02 Thread Matthias J. Sax
Added you to the wiki. On 9/2/20 12:45 PM, satyanarayan komandur wrote: > Hi, > I would like to have the access for creating KIP for Kafka. My wiki id is > ksbalan2016. I have opened a Jira ticket and had brief interaction with > Mathias on stack overflow about this ticket. He would like me to

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2020-09-02 Thread Matthias J. Sax
Thanks for the KIP and the detailed discussion. I guess this all makes sense. -Matthias On 9/2/20 1:28 PM, Leah Thomas wrote: > Hey John, > > I see what you say about the console consumer in particular. I don't think > that adding the extra config would *hurt* at all, so I'm good with keeping >

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2020-09-02 Thread Matthias J. Sax
+1 (binding) On 8/26/20 8:02 AM, John Roesler wrote: > Hi all, > > I've just sent a new message to the DISCUSS thread. We > forgot to include the Scala API in the proposal. > > Thanks, > -John > > On Mon, 2020-08-24 at 18:00 -0700, Sophie Blee-Goldman > wrote: >> Thanks for the KIP! +1

Re: [DISCUSS] KIP-406: GlobalStreamThread should honor custom reset policy

2020-09-02 Thread Matthias J. Sax
I think this makes sense. When we introduce this new state, we might also tackle the jira a mentioned. If there is a global thread, on startup of a `KafakStreams` client we should not transit to `REBALANCING` but to the new state, and maybe also make the "bootstrapping" non-blocking. I guess

Re: Can't find any sendfile system call trace from Kafka process?

2020-09-02 Thread Haruki Okada
There are two cases that zero-copy fetch thanks to sendfile don't work. - SSL encryption is enabled * Need to encrypt on Kafka process before sending to client - https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/common/network/SslTransportLayer.java#L946

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #43

2020-09-02 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #40

2020-09-02 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix build scala 2.12 build after KAFKA-10020 (#9245) -- [...truncated 6.46 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Re: [VOTE] KIP-554: Add Broker-side SCRAM Config API

2020-09-02 Thread Colin McCabe
Hi Rajini & Ron, Thanks, this is an interesting discussion. I think Ron made a good point earlier that if you have ALTER on CLUSTER then you can give yourself whatever other ACLs you want. And this is true even if you are authenticated via a delegation token. So splitting the ability to

Re: [DISCUSS] KIP-406: GlobalStreamThread should honor custom reset policy

2020-09-02 Thread Sophie Blee-Goldman
If we're going to add a new GLOBAL_RESTORING state to the KafkaStreams FSM, maybe it would make sense to add a new plain RESTORING state that we transition to when restoring non-global state stores following a rebalance. Right now all restoration occurs within the REBALANCING state, which is

[jira] [Created] (KAFKA-10458) Need a way to update quota for TokenBucket registered with Sensor

2020-09-02 Thread Anna Povzner (Jira)
Anna Povzner created KAFKA-10458: Summary: Need a way to update quota for TokenBucket registered with Sensor Key: KAFKA-10458 URL: https://issues.apache.org/jira/browse/KAFKA-10458 Project: Kafka

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #44

2020-09-02 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-656: MirrorMaker2 Exactly-once Semantics

2020-09-02 Thread Ning Zhang
bump for another potential more discussion On 2020/08/27 23:31:38, Ning Zhang wrote: > Hello Mickael, > > > 1. How does offset translation work with this new sink connector? > > Should we also include a CheckpointSinkConnector? > > CheckpointSourceConnector will be re-used as the same as

Re: [VOTE] KIP-614: Add Prefix Scan support for State Stores

2020-09-02 Thread Sagar
Thanks All! I see 3 binding +1 votes and 2 non-binding +1s. Does it mean this KIP has gained a lazy majority? Thanks! Sagar. On Thu, Sep 3, 2020 at 6:51 AM Guozhang Wang wrote: > Thanks for the KIP Sagar. I'm +1 (binding) too. > > > Guozhang > > On Tue, Sep 1, 2020 at 1:24 PM Bill Bejeck