[jira] [Resolved] (KAFKA-6127) Streams should never block infinitely

2020-09-18 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-6127. Resolution: Fixed > Streams should never block infinitely >

Re: [DISCUSS] KIP-666: Add Instant-based methods to ReadOnlySessionStore

2020-09-18 Thread John Roesler
Thanks for the KIP, Jorge! Sorry it took me so long. I just reviewed the KIP, and it looks good to me. Thanks, John On Tue, Sep 1, 2020, at 12:35, Jorge Esteban Quilcate Otoya wrote: > Thanks Sophie! > > > one nit: you missed updating the startTime long to Instant in both > appearances of the

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-09-18 Thread Jason Gustafson
Hi Jose, A few comments/questions below: 1. There is a comment in the proposal which suggests that we will maintain multiple snapshots: > Having multiple snapshots is useful for minimizing re-fetching of the snapshot when a new snapshot is generated. However, the document later says that

Re: New to Apache kafka. Need suggestions!!!

2020-09-18 Thread Matthias J. Sax
Srinivas, Thanks for your interest in Apache Kafka. There is some information on the web-page: https://kafka.apache.org/contributing Let us know if you have any further questions. Welcome to the community! -Matthias On 9/18/20 9:54 AM, Srinivas Vemula wrote: > Hi all, > I am Srinivas

[jira] [Resolved] (KAFKA-10480) Kafka streams application is being stuck

2020-09-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10480. - Resolution: Invalid > Kafka streams application is being stuck >

[jira] [Reopened] (KAFKA-10480) Kafka streams application is being stuck

2020-09-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-10480: - > Kafka streams application is being stuck > > >

Re: Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #70

2020-09-18 Thread niranjan kumar
unsubscribe On Sat, Sep 19, 2020 at 1:07 AM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://ci-builds.apache.org/job/Kafka/job/kafka-trunk-jdk8/70/display/redirect?page=changes > > > > Changes: > > [github] MINOR: Remove unused variable (#9303) > > >

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

2020-09-18 Thread Sophie Blee-Goldman
Makes sense to me :) On Thu, Sep 17, 2020 at 9:34 AM Bruno Cadonna wrote: > Hi Sophie, > > Thank you for the feedback! I replied inline. > > Best, > Bruno > > On 16.09.20 19:19, Sophie Blee-Goldman wrote: > >> > >> We guarantee that the metadata of the dead stream threads will be > >> returned

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-18 Thread John Roesler
Hi Dongjin, Yes, that’s right. My the time of KIP-307, we had no choice but to add a second name. But we do have a choice with Suppress. Thanks! -John On Thu, Sep 17, 2020, at 13:14, Dongjin Lee wrote: > Hi John, > > I just reviewed KIP-307. As far as I understood, ... > > 1. There was

Re: [VOTE] KIP-664: Provide tooling to detect and abort hanging transactions

2020-09-18 Thread Boyang Chen
Thanks Jason, +1 (binding) from me Boyang On Fri, Sep 11, 2020 at 10:12 AM Robert Barrett wrote: > +1 (non-binding) > > Thanks Jason! > > On Tue, Sep 8, 2020 at 5:28 PM Guozhang Wang wrote: > > > +1. Thanks! > > > > Guozhang > > > > On Tue, Sep 8, 2020 at 3:04 PM Ron Dagostino wrote: > > > >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #71

2020-09-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove unused variable (#9303) -- [...truncated 3.29 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

[jira] [Resolved] (KAFKA-10480) Kafka streams application is being stuck

2020-09-18 Thread Abuli Palagashvili (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abuli Palagashvili resolved KAFKA-10480. Resolution: Fixed > Kafka streams application is being stuck >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #70

2020-09-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove unused variable (#9303) -- [...truncated 6.58 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #70

2020-09-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove unused variable (#9303) -- [...truncated 6.53 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-567: Kafka Cluster Audit (new discussion)

2020-09-18 Thread Dániel Urbán
Hi, Thanks for the KIP. If the auditor needs access to the details of the action, one could argue that even the response should be passed down to the auditor. Is it feasible to convert the Java requests and responses to public API? If not, do we have another option to access this info in the

[jira] [Created] (KAFKA-10500) Add API to Start and Stop Stream Threads

2020-09-18 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-10500: - Summary: Add API to Start and Stop Stream Threads Key: KAFKA-10500 URL: https://issues.apache.org/jira/browse/KAFKA-10500 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-09-18 Thread Jun Rao
Hi, Justine, Thanks for the reply. 13. If the log directory is the source of truth, it means that the redundant info in the metadata file will be ignored. Then the question is why do we need to put the redundant info in the metadata file now? Thanks, Jun On Thu, Sep 17, 2020 at 5:07 PM

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #15

2020-09-18 Thread Apache Jenkins Server
See Changes: [David Arthur] MINOR: Fix now that kafka.apache.org resolves to 3 IP addresses (#9294) -- [...truncated 6.31 MB...]

Re: [DISCUSS] KIP-665 Kafka Connect Hash SMT

2020-09-18 Thread Brandon Brown
Thanks Michael! So proposed hash functions would be MD5, SHA1, SHA256. I can expand the motivation on the KIP but here’s where my head is at. MaskField would completely remove the value by setting it to an equivalent null value. One problem with this would be that you’d not be able to know in

New to Apache kafka. Need suggestions!!!

2020-09-18 Thread Srinivas Vemula
Hi all, I am Srinivas and I am new to Apache Kafka. I want to learn and contribute here as much as possible. Can any one from this group please guide me from where should I get started and get hands on it? Thanks & Regards, Srinivas.

Re: [DISCUSS] KIP-665 Kafka Connect Hash SMT

2020-09-18 Thread Mickael Maison
Thanks Brandon for the KIP. There's already a built-in transformation (MaskField) that can obfuscate fields. In the motivation section, it would be nice to explain the use cases when MaskField is not suitable and when users would need the proposed transformation. The KIP exposes a "function"

[jira] [Created] (KAFKA-10501) Log Cleaner never clean up some __consumer_offsets partitions

2020-09-18 Thread Mykhailo Baluta (Jira)
Mykhailo Baluta created KAFKA-10501: --- Summary: Log Cleaner never clean up some __consumer_offsets partitions Key: KAFKA-10501 URL: https://issues.apache.org/jira/browse/KAFKA-10501 Project: Kafka

Re: [DISCUSS] KIP-595: A Raft Protocol for the Metadata Quorum

2020-09-18 Thread jianjie feng
Hi, Jason I'd like to attend to this project and do some development, could you tell me where shall I started? Thanks Jianjie On 2020/04/16 23:44:59, Jason Gustafson wrote: > Hi All, > > I'd like to start a discussion on KIP-595: >

Re: [DISCUSS] KIP-595: A Raft Protocol for the Metadata Quorum

2020-09-18 Thread jianjie feng
Hello, Jason I'd like to attend this project and do some development, could you tell where shall I start ? Thanks Jianjie On 2020/04/16 23:44:59, Jason Gustafson wrote: > Hi All, > > I'd like to start a discussion on KIP-595: >

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-09-18 Thread Justine Olshan
Hi Jun, I see what you are saying. For now we can remove the extra information. I'll leave the option to add more fields to the file in the future. The KIP has been updated to reflect this change. Thanks, Justine On Fri, Sep 18, 2020 at 8:46 AM Jun Rao wrote: > Hi, Justine, > > Thanks for the

Re: [DISCUSS] KIP-664: Provide tooling to detect and abort hanging transactions

2020-09-18 Thread Jason Gustafson
Hey Boyang, Thanks for the comments. Responses below: > 1. Why do we need to use type string for `StatesFilter` instead of a short value, as we could translate it and save space? I went back and forth on this. In the end I used a string for consistency with `DescribeGroups`. I doubt space is

[jira] [Created] (KAFKA-10502) Threadlocal may can not set null,because it may create a memory leak

2020-09-18 Thread huangyiming (Jira)
huangyiming created KAFKA-10502: --- Summary: Threadlocal may can not set null,because it may create a memory leak Key: KAFKA-10502 URL: https://issues.apache.org/jira/browse/KAFKA-10502 Project: Kafka