[jira] [Resolved] (KAFKA-9372) Add producer config to make topicExpiry configurable

[ https://issues.apache.org/jira/browse/KAFKA-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiao Zhang resolved KAFKA-9372. --- Resolution: Duplicate let me close it as this issue could be covered by https://issues.apache.org/ji

[jira] [Created] (KAFKA-9616) Add new metrics to get total response time with throttle time subtracted

Jiao Zhang created KAFKA-9616: - Summary: Add new metrics to get total response time with throttle time subtracted Key: KAFKA-9616 URL: https://issues.apache.org/jira/browse/KAFKA-9616 Project: Kafka

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congrats Konstantine!! On Thu, Feb 27, 2020 at 12:35 PM Tom Bentley wrote: > > Congratulations! > > On Thu, Feb 27, 2020 at 6:43 AM David Jacot wrote: > > > Congrats! > > > > Le jeu. 27 févr. 2020 à 06:58, Vahid Hashemian > > a écrit : > > > > > Congratulations Konstantine! > > > > > > Regards,

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congratulations! On Thu, Feb 27, 2020 at 6:43 AM David Jacot wrote: > Congrats! > > Le jeu. 27 févr. 2020 à 06:58, Vahid Hashemian > a écrit : > > > Congratulations Konstantine! > > > > Regards, > > --Vahid > > > > On Wed, Feb 26, 2020 at 6:49 PM Boyang Chen > > wrote: > > > > > Congrats Konst

Build failed in Jenkins: kafka-2.4-jdk8 #157

See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- [...truncated 2.75 MB...] org.apache.kafka.streams.MockProcessorContextTest > fullCon

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congrats! Le jeu. 27 févr. 2020 à 06:58, Vahid Hashemian a écrit : > Congratulations Konstantine! > > Regards, > --Vahid > > On Wed, Feb 26, 2020 at 6:49 PM Boyang Chen > wrote: > > > Congrats Konstantine！ > > > > On Wed, Feb 26, 2020 at 6:32 PM Manikumar > > wrote: > > > > > Congrats Konstant

Build failed in Jenkins: kafka-2.3-jdk8 #182

See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- [...truncated 2.95 MB...] kafka.controller.ControllerChannelManagerTest > testStopRepl

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congratulations Konstantine! Regards, --Vahid On Wed, Feb 26, 2020 at 6:49 PM Boyang Chen wrote: > Congrats Konstantine！ > > On Wed, Feb 26, 2020 at 6:32 PM Manikumar > wrote: > > > Congrats Konstantine! > > > > On Thu, Feb 27, 2020 at 7:46 AM Matthias J. Sax > wrote: > > > > > -BEGIN PGP

Build failed in Jenkins: kafka-trunk-jdk8 #4277

See Changes: [github] KAFKA-9607: Do not clear partition queues during close (#8168) -- [...truncated 2.88 MB...] org.apache.kafka.streams.test.OutputVerifierTest > sho

Build failed in Jenkins: kafka-2.0-jdk8 #311

See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- [...truncated 894.38 KB...] kafka.zk.KafkaZkClientTest > testEntityConfigManagementMet

Build failed in Jenkins: kafka-2.2-jdk8 #32

See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- [...truncated 2.74 MB...] kafka.api.TransactionsTest > testMultipleMarkersOneLeader STA

Build failed in Jenkins: kafka-2.4-jdk8 #156

See Changes: [vvcephei] MINOR: Fix gradle error writing test stdout (#8133) -- [...truncated 5.57 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldFailIfKey

Build failed in Jenkins: kafka-trunk-jdk8 #4276

See Changes: [github] MINOR: Remove tag from metric to measure process-rate on source nodes -- [...truncated 2.88 MB...] org.apache.kafka.streams.TestTopicsTest > testDu

Re: Discussion thread for KIP-X

Sounds great Boyang! Look forward to hearing back. Rangan - Original Message - From: Boyang Chen To: RANGAN PRABHAKARAN, dev@kafka.apache.org At: 26-Feb-2020 13:45:01 Thanks Rangan for the input! We shall do a retro for Q1. I will reflect your use cases there and notify you if we ha

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congrats Konstantine！ On Wed, Feb 26, 2020 at 6:32 PM Manikumar wrote: > Congrats Konstantine! > On Thu, Feb 27, 2020 at 7:46 AM Matthias J. Sax wrote: > > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA512 > > > > Congrats! > > > > On 2/27/20 2:21 AM, Jeremy Custenborder wrote: > > > Cong

Jenkins build is back to normal : kafka-2.5-jdk8 #45

See

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congrats Konstantine! On Thu, Feb 27, 2020 at 7:46 AM Matthias J. Sax wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > Congrats! > > On 2/27/20 2:21 AM, Jeremy Custenborder wrote: > > Congrats Konstantine! > > > > On Wed, Feb 26, 2020 at 2:39 PM Bill Bejeck > > wrote: > >> > >> Co

Re: [ANNOUNCE] New committer: Konstantine Karantasis

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 2/27/20 2:21 AM, Jeremy Custenborder wrote: > Congrats Konstantine! > > On Wed, Feb 26, 2020 at 2:39 PM Bill Bejeck > wrote: >> >> Congratulations Konstantine! Well deserved. >> >> -Bill >> >> On Wed, Feb 26, 2020 at 5:37 PM Jason Gust

Build failed in Jenkins: kafka-1.0-jdk8 #289

See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- [...truncated 376.13 KB...] kafka.coordinator.transaction.TransactionMarkerRequestComp

[jira] [Resolved] (KAFKA-9607) Should not clear partition queue during task close

[ https://issues.apache.org/jira/browse/KAFKA-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9607. -- Fix Version/s: 2.6.0 Resolution: Fixed > Should not clear partition queue during task cl

回复：[Vote] KIP-571: Add option to force remove members in StreamsResetter

Updated with the KIP link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-571%3A+Add+option+to+force+remove+members+in+StreamsResetter -- 发件人：feyman2009 发送时间：2020年2月27日(星期四) 09:38 收件人：dev 主　题：[Vote] KIP-571: Add option to f

回复：[Discuss] KIP-571: Add option to force remove members in StreamsResetter

Hi, Sophie Thanks a lot! I have initiated a vote Thanks! Feyman -- 发件人：Sophie Blee-Goldman 发送时间：2020年2月27日(星期四) 08:04 收件人：feyman2009 主　题：Re: [Discuss] KIP-571: Add option to force remove members in StreamsResetter Hi guy

Build failed in Jenkins: kafka-2.1-jdk8 #253

See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- [...truncated 467.34 KB...] kafka.log.LogValidatorTest > testLogAppendTimeWithoutRecom

[Vote] KIP-571: Add option to force remove members in StreamsResetter

Hi, all I would like to start a vote on KIP-571: Add option to force remove members in StreamsResetter . Thanks! Feyman

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congrats Konstantine! On Wed, Feb 26, 2020 at 2:39 PM Bill Bejeck wrote: > > Congratulations Konstantine! Well deserved. > > -Bill > > On Wed, Feb 26, 2020 at 5:37 PM Jason Gustafson wrote: > > > The PMC for Apache Kafka has invited Konstantine Karantasis as a committer > > and we > > are please

Build failed in Jenkins: kafka-trunk-jdk8 #4275

See Changes: [github] KAFKA-9601: Stop logging raw connector config values (#8165) [github] KAFKA-9614: Not initialize topology twice in StreamTask (#8173) [github] KAFKA-9610: do not throw illegal state when r

Build failed in Jenkins: kafka-trunk-jdk11 #1195

See Changes: [github] KAFKA-9601: Stop logging raw connector config values (#8165) [github] KAFKA-9614: Not initialize topology twice in StreamTask (#8173) [github] KAFKA-9610: do not throw illegal state when

Re: [VOTE] KIP-409: Allow creating under-replicated topics and partitions

Hey all, please consider voting for this KIP. It's really a shame that topic creation is impossible when clusters are under-provisioned, which is not uncommon in a dynamic environment like Kubernetes. Ryanne On Thu, Feb 6, 2020 at 10:57 AM Mickael Maison wrote: > I have not seen any new feedba

[jira] [Resolved] (KAFKA-9601) Workers log raw connector configs, including values

[ https://issues.apache.org/jira/browse/KAFKA-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9601. -- Reviewer: Randall Hauch Resolution: Fixed Thanks for the fix, [~ChrisEgerton]! Merged to

Re: [KAFKA-557] Add emit on change support for Kafka Streams

Hi Richard, I've been making a final pass over the KIP. Re: Proposed Behavior Change: I think this point is controversial and probably doesn't need to be there at all: > 2.b. In certain situations where there is a high volume of idempotent > updates throughout the Streams DAG, it will be recomm

Build failed in Jenkins: kafka-2.2-jdk8-old #214

See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment v

Re: [ANNOUNCE] New committer: Konstantine Karantasis

Congratulations Konstantine! Well deserved. -Bill On Wed, Feb 26, 2020 at 5:37 PM Jason Gustafson wrote: > The PMC for Apache Kafka has invited Konstantine Karantasis as a committer > and we > are pleased to announce that he has accepted! > > Konstantine has contributed 56 patches and helped to

[ANNOUNCE] New committer: Konstantine Karantasis

The PMC for Apache Kafka has invited Konstantine Karantasis as a committer and we are pleased to announce that he has accepted! Konstantine has contributed 56 patches and helped to review even more. His recent work includes a major overhaul of the Connect task management system in order to support

Re: [DISCUSS] Apache Kafka 2.5.0 release

Thanks, David. The PR has been merged to trunk and 2.5, and I'm backporting to earlier branches. I'll resolve https://issues.apache.org/jira/browse/KAFKA-9601 when I finish backporting. On Wed, Feb 26, 2020 at 1:28 PM David Arthur wrote: > Thanks, Randall. Leaking sensitive config to the logs se

Re: [DISCUSS] KIP-569: DescribeConfigsResponse - Update the schema to include datatype of the field

Hi Shailesh, I think most users of the DescribeConfigs API do not want to get help text or configuration schema information. So, it would be inefficient to always include this information as part of the DescribeConfigs response. It would be better to create a new, separate API for getting thi

[jira] [Resolved] (KAFKA-9610) Should not throw illegal state exception during task revocation

[ https://issues.apache.org/jira/browse/KAFKA-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9610. -- Fix Version/s: 2.6.0 Resolution: Fixed > Should not throw illegal state exception during

[jira] [Resolved] (KAFKA-9614) Avoid initializing the topology twice when resuming stream tasks from suspended state

[ https://issues.apache.org/jira/browse/KAFKA-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9614. -- Fix Version/s: 2.6.0 Resolution: Fixed > Avoid initializing the topology twice when resu

Re: [VOTE] KIP-568: Explicit rebalance triggering on the Consumer

Hi all, Apologies for the back and forth on this issue, but while implementing the new API I've come around to thinking we should not return anything after all, and just leave it up to the user to determine if they need to retry the rebalance. Since I was the main (only) strong proponent of this

[jira] [Created] (KAFKA-9615) Refactor TaskManager to extract task creation / cleanup out of StreamThread

Guozhang Wang created KAFKA-9615: Summary: Refactor TaskManager to extract task creation / cleanup out of StreamThread Key: KAFKA-9615 URL: https://issues.apache.org/jira/browse/KAFKA-9615 Project: Ka

[jira] [Created] (KAFKA-9614) Avoid initializing the topology twice when resuming stream tasks from suspended state

Guozhang Wang created KAFKA-9614: Summary: Avoid initializing the topology twice when resuming stream tasks from suspended state Key: KAFKA-9614 URL: https://issues.apache.org/jira/browse/KAFKA-9614 P

[jira] [Created] (KAFKA-9613) orruptRecordException: Found record size 0 smaller than minimum record overhead

Amit Khandelwal created KAFKA-9613: -- Summary: orruptRecordException: Found record size 0 smaller than minimum record overhead Key: KAFKA-9613 URL: https://issues.apache.org/jira/browse/KAFKA-9613 Pro

Re: [DISCUSS] Apache Kafka 2.5.0 release

Thanks, Randall. Leaking sensitive config to the logs seems fairly severe. I think should include this. Let's proceed with cherry-picking to 2.5. -David On Wed, Feb 26, 2020 at 2:25 PM Randall Hauch wrote: > Hi, David. > > If we're still not quite ready for an RC, I'd like to squeeze in > https

Build failed in Jenkins: kafka-trunk-jdk11 #1194

See Changes: [github] MINOR: Fix gradle error writing test stdout (#8133) -- [...truncated 2.89 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldPunctuate

Re: [DISCUSS] Apache Kafka 2.5.0 release

Hi, David. If we're still not quite ready for an RC, I'd like to squeeze in https://issues.apache.org/jira/browse/KAFKA-9601, which removes the raw connector config properties in a DEBUG level log message. PR is ready (test failures are unrelated), the risk is very low, and I think it'd be great t

Build failed in Jenkins: kafka-trunk-jdk8 #4274

See Changes: [github] MINOR: Fix gradle error writing test stdout (#8133) -- [...truncated 2.88 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldRespectTas

Re: Discussion thread for KIP-X

Thanks Rangan for the input! We shall do a retro for Q1. I will reflect your use cases there and notify you if we have the next step plan to help out. Boyang From: Rangan Prabhakaran (BLOOMBERG/ 919 3RD A) Sent: Tuesday, February 25, 2020 2:57 AM To: dev@kafka.a

[DISCUSS] KIP-574: CLI Dynamic Configuration with file input

Hi, I'd like to discuss adding a new argument to kafka-configs.sh (ConfigCommand.scala). Recently I've been working on some things that require complex configurations. I've chosen to represent them as JSON strings in my server.properties. This works well, and I'm able to update the configurations

[jira] [Created] (KAFKA-9612) CLI Dynamic Configuration with file input

Aneel Nazareth created KAFKA-9612: - Summary: CLI Dynamic Configuration with file input Key: KAFKA-9612 URL: https://issues.apache.org/jira/browse/KAFKA-9612 Project: Kafka Issue Type: Improve

Re: [DISCUSS] Apache Kafka 2.5.0 release

Viktor, the change LGTM. I've approved and merged the cherry-pick version into 2.5. Thanks! David On Tue, Feb 25, 2020 at 4:43 AM Viktor Somogyi-Vass wrote: > Hi David, > > There are two short JIRAs related to KIP-352 that documents the newly added > metrics. Is it possible to merge them in? >

Re: Permission to create KIP

Hello Aneel, I've added your id to the wiki space. Guozhang On Wed, Feb 26, 2020 at 7:40 AM Aneel Nazareth wrote: > Hi, I'd like to create a KIP. Would you please give user "aneel" permission > to do so? > > Thanks, > Aneel Nazareth > -- -- Guozhang

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

On Tue, Feb 25, 2020 at 12:46 PM, Jun Rao wrote: > Hi, Satish, > > Thanks for the updated doc. The new API seems to be an improvement > overall. A few more comments below. > > 100. For each of the operations related to tiering, it would be useful to > provide a description on how it works with th

Permission to create KIP

Hi, I'd like to create a KIP. Would you please give user "aneel" permission to do so? Thanks, Aneel Nazareth

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

> I was under the impression that you wanted to expand the scope of the KIP to additionally allow querying the internal buffer, not just the result. Can you clarify whether you are proposing to allow querying the state of the internal buffer, the result, or both? Sorry for the confusion. As we alr

Re: access to jiira

Hi Stepanenko, You've been added as a contributor to Jira, so you should be able to self-assign tickets now. Thanks for your interest in Apache Kafka. -Bill On Wed, Feb 26, 2020 at 4:14 AM we studio wrote: > Hello. I would like to contribute to Kafka. Could you please add me to > jira? My jir

Re: [KAFKA-557] Add emit on change support for Kafka Streams

Hi Richard, 1. Could you change "idempotent update operations will only be dropped from KTables, not from other classes." -> idempotent update operations will only be dropped from materialized KTables? For non-materialized KTables -- as they can occur after optimization of the topology -- we canno

[jira] [Created] (KAFKA-9611) KGroupedTable.aggregate(...) emits incorrect values

Neil Green created KAFKA-9611: - Summary: KGroupedTable.aggregate(...) emits incorrect values Key: KAFKA-9611 URL: https://issues.apache.org/jira/browse/KAFKA-9611 Project: Kafka Issue Type: Bug

access to jiira

Hello. I would like to contribute to Kafka. Could you please add me to jira? My jira account username: avalsa (Stepanenko Vyacheslav)

Build failed in Jenkins: kafka-trunk-jdk8 #4273

See Changes: [github] HOTFIX: compile error in EmbeddedKafkaCluster (#8170) [manikumar] KAFKA-9594: Add a separate lock to pause the follower log append while -- [...tr