Build failed in Jenkins: kafka-trunk-jdk10 #405

See Changes: [wangguoz] KAFKA-6761: Reduce streams footprint part IV add optimization (#5451) -- [...truncated 1.98 MB...] org.apache.kafka.streams.StreamsConfigTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2896

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H26 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #404

See Changes: [lindong28] KAFKA-7019; Make reading metadata lock-free by maintaining an -- [...truncated 1.54 MB...]

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

@Jan Thanks Jan. I take it you mean "key-widening" somehow includes information about which record is processed first? I understand about a CombinedKey with both the Foreign and Primary key, but I don't see how you track ordering metadata in there unless you actually included a metadata field in

Build failed in Jenkins: kafka-trunk-jdk8 #2895

See -- Started by an SCM change Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H26 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #2894

See Changes: [github] MINOR: Use explicit construction of clients in IntegrationTestHarness [lindong28] KAFKA-7019; Make reading metadata lock-free by maintaining an --

[jira] [Created] (KAFKA-7295) Fix RequestHandlerAvgIdlePercent metric calculation

Dong Lin created KAFKA-7295: --- Summary: Fix RequestHandlerAvgIdlePercent metric calculation Key: KAFKA-7295 URL: https://issues.apache.org/jira/browse/KAFKA-7295 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-354 Time-based log compaction policy

Per discussion with Dong, he made a very good point that if compaction and time based retention are both enabled on a topic, the compaction might prevent records from being deleted on time. The reason is when compacting multiple segments into one single segment, the newly created segment will

Re: Question Regarding Apache Kafka replication

Hi Shibha, I have a KIP in the works which proposes to do this. Stay tuned. -Jason On Tue, Aug 14, 2018 at 4:43 PM, Shibha Malik wrote: > Hi Team, > > I wanted to know as to why Kafka does not support read by consumers from a > replica of a partition which is not a leader of the partition (

Question Regarding Apache Kafka replication

Hi Team, I wanted to know as to why Kafka does not support read by consumers from a replica of a partition which is not a leader of the partition ( but one of the partition on ISR ) ? Thanks, Shibha Malik

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

Sorry for the noise. Let me try again: My initial suggestion was to *track *the uncleanable disk space. > I can see why marking a log directory as offline after a certain threshold > of uncleanable disk space is more useful. > I'm not sure if we can set that threshold to be of certain size (e.g

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

Hey Stanislav, responses below: My initial suggestion was to *track *the uncleanable disk space. > I can see why marking a log directory as offline after a certain threshold > of uncleanable disk space is more useful. > I'm not sure if we can set that threshold to be of certain size (e.g 100GB) >

Jenkins build is back to normal : kafka-2.0-jdk8 #117

See

Build failed in Jenkins: kafka-trunk-jdk8 #2893

See Changes: [rajinisivaram] KAFKA-7169: Validate SASL extensions through callback on server side -- [...truncated 424.50 KB...] kafka.security.auth.ResourceTest >

Re: [VOTE] KIP-356: Add withCachingDisabled() to StoreBuilder

+1 (binding) On 8/14/18 11:16 AM, Eno Thereska wrote: > +1 (non binding) > > Thanks > Eno > > On Tue, Aug 14, 2018 at 10:53 AM, Bill Bejeck wrote: > >> Thanks for the KIP. >> >> +1 >> >> -Bill >> >> On Tue, Aug 14, 2018 at 1:42 PM Guozhang Wang wrote: >> >>> Hello folks, >>> >>> I'd like to

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hello Adam, As for your question regarding GraphNodes, it is for extending Streams optimization framework. You can find more details on https://issues.apache.org/jira/browse/KAFKA-6761. The main idea is that instead of directly building up the "physical topology" (represented as Topology in the

Jenkins build is back to normal : kafka-trunk-jdk10 #402

See

Re: [DISCUSS] KIP-354 Time-based log compaction policy

Dong, Thanks for the comment. There are two retention policy: log compaction and time based retention. Log compaction: we have use cases to keep infinite retention of a topic (only compaction). GDPR cares about deletion of PII (personal identifiable information) data. Since Kafka doesn't know

[jira] [Created] (KAFKA-7294) Optimize repartitioning for merge()

Matthias J. Sax created KAFKA-7294: -- Summary: Optimize repartitioning for merge() Key: KAFKA-7294 URL: https://issues.apache.org/jira/browse/KAFKA-7294 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-7293) Merge followed by groupByKey/join might violate co-partioning

Matthias J. Sax created KAFKA-7293: -- Summary: Merge followed by groupByKey/join might violate co-partioning Key: KAFKA-7293 URL: https://issues.apache.org/jira/browse/KAFKA-7293 Project: Kafka

[jira] [Resolved] (KAFKA-7222) KIP-328: Add Window Grace Period (and deprecate Window Retention)

[ https://issues.apache.org/jira/browse/KAFKA-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-7222. - Resolution: Fixed Fix Version/s: 2.1.0 [https://github.com/apache/kafka/pull/5369] is

Jenkins build is back to normal : kafka-trunk-jdk8 #2892

See

Build failed in Jenkins: kafka-1.1-jdk7 #179

See Changes: [rajinisivaram] KAFKA-7119: Handle transient Kerberos errors as non-fatal exceptions -- [...truncated 422.46 KB...] kafka.zookeeper.ZooKeeperClientTest >

Build failed in Jenkins: kafka-1.0-jdk7 #232

See Changes: [rajinisivaram] KAFKA-7119: Handle transient Kerberos errors as non-fatal exceptions -- [...truncated 376.91 KB...] kafka.controller.ZookeeperClientTest >

Build failed in Jenkins: kafka-trunk-jdk10 #401

See Changes: [jason] MINOR: Clean up to avoid errors in dynamic broker config tests (#5486) [wangguoz] KAFKA-7222: Add Windows grace period (#5369) [github] KAFKA-7119: Handle transient Kerberos errors as

[jira] [Resolved] (KAFKA-7169) Add support for Custom SASL extensions in OAuth authentication

[ https://issues.apache.org/jira/browse/KAFKA-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7169. --- Resolution: Fixed Reviewer: Ron Dagostino Fix Version/s: 2.1.0 > Add support

Re: [VOTE] KIP-353: Allow Users to Configure Multi-Streams Timestamp Synchronization Behavior

+1 Original message From: Bill Bejeck Date: 8/14/18 11:09 AM (GMT-08:00) To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-353: Allow Users to Configure Multi-Streams Timestamp Synchronization Behavior +1 Thanks, Bill On Thu, Aug 9, 2018 at 4:20 PM John Roesler wrote: >

Re: [VOTE] KIP-356: Add withCachingDisabled() to StoreBuilder

+1 (non binding) Thanks Eno On Tue, Aug 14, 2018 at 10:53 AM, Bill Bejeck wrote: > Thanks for the KIP. > > +1 > > -Bill > > On Tue, Aug 14, 2018 at 1:42 PM Guozhang Wang wrote: > > > Hello folks, > > > > I'd like to start a voting thread on the following KIP: > > > > > >

Re: [VOTE] KIP-353: Allow Users to Configure Multi-Streams Timestamp Synchronization Behavior

+1 Thanks, Bill On Thu, Aug 9, 2018 at 4:20 PM John Roesler wrote: > +1 non-binding > > On Thu, Aug 9, 2018 at 3:14 PM Matthias J. Sax > wrote: > > > +1 (binding) > > > > On 8/9/18 11:57 AM, Guozhang Wang wrote: > > > Hello all, > > > > > > I would like to start the voting processing on the

Re: [EXTERNAL] [VOTE] KIP-310: Add a Kafka Source Connector to Kafka Connect

Bumping this thread. Looking for some binding votes or further request for discussion. > On Aug 10, 2018, at 12:38 PM, McCaig, Rhys wrote: > > Thanks Stephane! > > If there is a desire for further discussion I am certainly open to reverting > this to a discussion thread. For now I’ll keep

Re: [VOTE] KIP-356: Add withCachingDisabled() to StoreBuilder

Thanks for the KIP. +1 -Bill On Tue, Aug 14, 2018 at 1:42 PM Guozhang Wang wrote: > Hello folks, > > I'd like to start a voting thread on the following KIP: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-356%3A+Add+withCachingDisabled%28%29+to+StoreBuilder > > It is a pretty

Re: [VOTE] KIP-356: Add withCachingDisabled() to StoreBuilder

+1 On Tue, Aug 14, 2018 at 10:42 AM Guozhang Wang wrote: > Hello folks, > > I'd like to start a voting thread on the following KIP: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-356%3A+Add+withCachingDisabled%28%29+to+StoreBuilder > > It is a pretty straightforward one, adding a

Re: Can't start kafka

You know people are still trying to find your error message, right :) ? On 14 August 2018 at 15:19, Mohamed Salah Baccouche wrote: > hello , i was trying to connect kafka and cassandra when i finally > succeeded kafka stopped and i got this error message that i sent you with > the email , and

[VOTE] KIP-356: Add withCachingDisabled() to StoreBuilder

Hello folks, I'd like to start a voting thread on the following KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-356%3A+Add+withCachingDisabled%28%29+to+StoreBuilder It is a pretty straightforward one, adding a missing API to StoreBuilder which should actually be added at the very

[jira] [Resolved] (KAFKA-7119) Intermittent test failure with GSSAPI authentication failure

[ https://issues.apache.org/jira/browse/KAFKA-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7119. --- Resolution: Fixed Reviewer: Jun Rao Fix Version/s: 2.1.0

[jira] [Resolved] (KAFKA-6224) Can not build Kafka 1.0.0 with gradle 3.2.1

[ https://issues.apache.org/jira/browse/KAFKA-6224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-6224. -- Resolution: Cannot Reproduce Please reopen if the issue still exists. > Can not build Kafka 1.0.0

[jira] [Created] (KAFKA-7292) Converters should report their configuration options

Jeremy Custenborder created KAFKA-7292: -- Summary: Converters should report their configuration options Key: KAFKA-7292 URL: https://issues.apache.org/jira/browse/KAFKA-7292 Project: Kafka

[jira] [Created] (KAFKA-7291) kafka-console-consumer.sh waits on inexistent topic

HUSLEAG Dumitru created KAFKA-7291: -- Summary: kafka-console-consumer.sh waits on inexistent topic Key: KAFKA-7291 URL: https://issues.apache.org/jira/browse/KAFKA-7291 Project: Kafka Issue

Re: issues resolution help

Hi, Anton, Thanks for your interest. Just added you to the contributor list. You can assign the jira to yourself now. Jun On Tue, Aug 14, 2018 at 3:51 AM, Anton Bankovskii < anton_bankovs...@epam.com.invalid> wrote: > Hello! I would like to help with task https://issues.apache.org/ >

issues resolution help

Hello! I would like to help with task https://issues.apache.org/jira/browse/KAFKA-6755 Please assign it to me, my jira account is Anton Bankovskii (Stabmeqt) Anton Bankovskii Senior Software Engineer Cell: +7 987 540 20 22 Email: anton_bankovs...@epam.com

Can't start kafka

hello , i was trying to connect kafka and cassandra when i finally succeeded kafka stopped and i got this error message that i sent you with the email , and from then kafka wouldn't start , please help me Thank you

[jira] [Created] (KAFKA-7290) Kafka Streams application fails to rebalance and is stuck in "Updated cluster metadata version"

Tim Van Laer created KAFKA-7290: --- Summary: Kafka Streams application fails to rebalance and is stuck in "Updated cluster metadata version" Key: KAFKA-7290 URL: https://issues.apache.org/jira/browse/KAFKA-7290

[jira] [Created] (KAFKA-7289) Performance tools should allow user to specify output type

Attila Sasvari created KAFKA-7289: - Summary: Performance tools should allow user to specify output type Key: KAFKA-7289 URL: https://issues.apache.org/jira/browse/KAFKA-7289 Project: Kafka

[jira] [Created] (KAFKA-7288) Transient failure in SslSelectorTest.testCloseConnectionInClosingState

Rajini Sivaram created KAFKA-7288: - Summary: Transient failure in SslSelectorTest.testCloseConnectionInClosingState Key: KAFKA-7288 URL: https://issues.apache.org/jira/browse/KAFKA-7288 Project:

Re: [DISCUSS] KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file

+1 (non-binding) Thanks for the explanation. In the meantime, I have also tested your patch with an SSL-enabled broker, and kafka-log-dirs worked well. Regards, - Attila On Sat, Aug 11, 2018 at 6:21 PM Dong Lin wrote: > Hey Attila, > > Sorry for late reply.. I forgot to reply the email. > >

[jira] [Created] (KAFKA-7287) Set open ACL permissions for old consumer znode path

Manikumar created KAFKA-7287: Summary: Set open ACL permissions for old consumer znode path Key: KAFKA-7287 URL: https://issues.apache.org/jira/browse/KAFKA-7287 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-354 Time-based log compaction policy

Adding to this, what about topics that are not log compacted? As Dong says, "one of the GDPR requirement is that we can not keep messages longer than e.g. 30 days in storage (e.g. Kafka)". The GDPR requirement must hold irrespective of the low level details, on whether the topic is compacted or

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi Adam, I love how you are on to this already! I resolve this by "key-widening" I treat the result of FKA,and FKB differently. As you can see the output of my join has a Combined Key and therefore I can resolve the "race condition" in a group by if I so desire. I think this reflects more