[jira] [Resolved] (KAFKA-9444) Cannot connect to zookeeper after updating the kafka config

[ https://issues.apache.org/jira/browse/KAFKA-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rishabh Bohra resolved KAFKA-9444. -- Resolution: Invalid Please refer to [KAFKA-7335] - Store clusterId locally to ensure broker

[jira] [Created] (KAFKA-10438) Lazy initialization of record header to reduce memory usage in validating records

Chia-Ping Tsai created KAFKA-10438: -- Summary: Lazy initialization of record header to reduce memory usage in validating records Key: KAFKA-10438 URL: https://issues.apache.org/jira/browse/KAFKA-10438

Re: [DISCUSS] KIP-647: Add ability to handle late messages in streams-aggregation

Hi Igor, Thank you for your answers! I think I understand your reasoning. Looking at your proposal, some questions/comments arose. 1. Who would be responsible for the topic to which the late records should be sent? Is it a topic users create and manage or is it an internal topic that is

Request to get added to Asignee list

Hi, Please add me to the JIRA Asignee list. I would like to start contributing. Jira user id: aakashgupta96 Full Name: Aakash Gupta Apologies in case I've sent this request to wrong mailing list. Thanks, Aakash Gupta

Re: Request to get added to Asignee list

Done. Thanks for your interest in Apache Kafka! On Wed, Aug 26, 2020 at 1:41 PM Aakash Gupta wrote: > > Hi, > > Please add me to the JIRA Asignee list. I would like to start contributing. > > Jira user id: aakashgupta96 > Full Name: Aakash Gupta > > Apologies in case I've sent this request to

Re: [DISCUSS] Apache Kafka 2.7.0 release

Greetings All! I've published a release plan at https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158872629. I have included all of the KIPs that are currently approved, but I'm happy to make any adjustments as necessary. The KIP freeze is on September 30 with a target release

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

Hi all, I've just sent a new message to the DISCUSS thread. We forgot to include the Scala API in the proposal. Thanks, -John On Mon, 2020-08-24 at 18:00 -0700, Sophie Blee-Goldman wrote: > Thanks for the KIP! +1 (non-binding) > > Sophie > > On Mon, Aug 24, 2020 at 5:06 PM John Roesler

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Hello Burno, Thanks for the KIP! Not to pile on, but I also had a couple additional questions. I am not super familiar with the StreamThread internals so please forgive any misconceptions if these are not relevant questions. 1. In requestClose if a thread does not close properly and deadlocks

[DISCUSS] KIP-664: Provide tooling to detect and abort hanging transactions

Hi All, I've added a proposal to handle the problem of hanging transactions: https://cwiki.apache.org/confluence/display/KAFKA/KIP-664%3A+Provide+tooling+to+detect+and+abort+hanging+transactions. In theory, this should never happen. In practice, we have hit one bug where it was possible and there

Request for wiki access to submit KIP

Hi, Please grant me the access to create wiki page to submit KIP proposal. Full Name: Aakash Gupta Email ID: aakash.gupt...@outlook.com Regards, Aakash

Re: [DISCUSS] KIP-664: Provide tooling to detect and abort hanging transactions

Hi Jason. Thanks for the excellently-written KIP. Will the implementation be backported to prior Kafka versions? The reason I ask is because if it is not backported and similar functionality is not otherwise made available for older versions, then the only recourse (aside from deleting and

Re: Please, take a look at my PR

Hi Tess, I've seen the issue and the PR. I'll send a review soon. Thanks for surfacing this issue! Konstantine On Wed, Aug 26, 2020 at 8:19 AM Tess D'erberwill wrote: > Hi, guys! > Please, take a look at my ticket and PR: > https://issues.apache.org/jira/browse/KAFKA-10426 > > This is my

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

Hi Leah, I was just reviewing the PR for KIP-616 and realized that we forgot to mention the Scala API in your KIP. We should consider it because `scala.Serdes.timeWindowedSerde` is implicitly using the exact constructor you're deprecating. I had some ideas in the code review:

Re: [DISCUSS] KIP-546: Add quota-specific APIs to the Admin Client, redux

Hi Mickael, Unfortunately, it's not actively being worked on, but I welcome anyone to come forward. Otherwise it's on my list that I'll eventually get around to. Currently the logic replicates what was being done historically with the quota configuration management, and is therefore compatible

[jira] [Created] (KAFKA-10439) Connect's Values class loses precision for integers, larger than 64 bits

Oleksandr Diachenko created KAFKA-10439: --- Summary: Connect's Values class loses precision for integers, larger than 64 bits Key: KAFKA-10439 URL: https://issues.apache.org/jira/browse/KAFKA-10439

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

Hey John, Thanks for pointing this out, I wasn't sure how to handle the Scala changes. I'm not fully versed in the Scala version of Streams, so feel free to correct me if any of my assumptions are wrong. I think logging an error message and then calling the constructor that requires a windowSize

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Hi Bruno, Thanks for the well motivated and throrough KIP! It's a good point that the record cache should be re- distributed over the threads. Reading your KIP leads me to a few questions: 1. Start vs. Add Maybe this is paranoid, but I'm mildly concerned that users who don't read the docs too

Please, take a look at my PR

Hi, guys! Please, take a look at my ticket and PR: https://issues.apache.org/jira/browse/KAFKA-10426 This is my first PR, so I'm not sure how to notify about it in a right way. I have added reviewers, but I di not know if they received any notification. This PR is quite important for us.

[DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Hi, I would like to propose the following KIP to start and shut down stream threads during execution as well as to shut down asynchronously a Kafka Streams client from an uncaught exception handler.

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Thanks for the KIP Bruno. While reading it, I had the same questions as raised by John and Walker (so I won't repeat them). In addition, I think that adding/removing threads should only be allowed if the client state is RUNNING (but not in any other state, maybe except ERROR). Furthermore, it

Re: Join request

Mani, the mailing list is self-service. Please follow the instructions on the Kafka web page to subscribe: https://kafka.apache.org/contact -Matthias On 8/26/20 9:18 AM, Mani Jindal wrote: > > signature.asc Description: OpenPGP digital signature

Re: Request for wiki access to submit KIP

Hi, Aakash, Thanks for your interest. Just gave you the wiki permissions. Jun On Wed, Aug 26, 2020 at 11:57 AM Aakash Gupta wrote: > Hi, > > Please grant me the access to create wiki page to submit KIP proposal. > > Full Name: Aakash Gupta > Email ID: aakash.gupt...@outlook.com > > Regards, >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #33

See Changes: [github] MINOR: fix JavaDoc (#9217) -- [...truncated 6.43 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-664: Provide tooling to detect and abort hanging transactions

Hey Ron, We do not typically backport new APIs to older versions. I think we can however make the --abort command compatible with older versions. It would require a user to do some analysis on their own to identify a hanging transaction, but then they can use the tool from a new release to

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #34

See Changes: [github] MINOR: fix JavaDoc (#9217) -- [...truncated 3.24 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #34

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #35

See Changes: [github] KAFKA-10384: Separate converters from generated messages (#9194) -- [...truncated 6.48 MB...]

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Updated the KIP with Meeting Notes section https://cwiki.apache.org/confluence/display/KAFKA/KIP-405%3A+Kafka+Tiered+Storage#KIP405:KafkaTieredStorage-MeetingNotes On Tue, Aug 25, 2020 at 1:03 PM Jun Rao wrote: > Hi, Harsha, > > Thanks for the summary. Could you add the summary and the

Re: [DISCUSS] KIP-664: Provide tooling to detect and abort hanging transactions

Yes, that definitely sounds reasonable. Thanks, Jason! Ron On Wed, Aug 26, 2020 at 3:03 PM Jason Gustafson wrote: > Hey Ron, > > We do not typically backport new APIs to older versions. I think we can > however make the --abort command compatible with older versions. It would > require a user

Join request

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #34

See

Re: [VOTE] KIP-554: Add Broker-side SCRAM Config API

Hi everyone. Multiple changes came up during the discussion of the PR for KIP-554 (https://github.com/apache/kafka/pull/9032). I will update the KIP soon (likely tomorrow) but wanted to send notification to this email thread in case anyone wishes to discuss the changes. They are as follows: 1.

Jenkins build is back to normal : Kafka » kafka-2.6-jdk8 #11

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #35

See Changes: [github] KAFKA-10384: Separate converters from generated messages (#9194) -- [...truncated 3.24 MB...]

Access to submit KIP

Hi all, Please grant me access to create a KIP. Email - welcomemand...@gmail.com Username - ifconfig Thanks, Mandeep Gandhi

Re: [DISCUSS] KIP-546: Add quota-specific APIs to the Admin Client, redux

Hi, Is anyone actively working on adding support for custom quotas callbacks? We should really try to get this in soon as otherwise this KIP is not usable in environments with custom quotas. It's unfortunate to have the capability on the client-side but no support on brokers. Thanks On Sat,