[jira] [Created] (KAFKA-7546) Java implementation for Authorizer

Pradeep Bansal created KAFKA-7546: - Summary: Java implementation for Authorizer Key: KAFKA-7546 URL: https://issues.apache.org/jira/browse/KAFKA-7546 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-7547) Avoid relogin in kafka if connection is already established.

Pradeep Bansal created KAFKA-7547: - Summary: Avoid relogin in kafka if connection is already established. Key: KAFKA-7547 URL: https://issues.apache.org/jira/browse/KAFKA-7547 Project: Kafka

[jira] [Created] (KAFKA-7548) KafkaConsumer should not throw away already fetched data for paused partitions.

Mayuresh Gharat created KAFKA-7548: -- Summary: KafkaConsumer should not throw away already fetched data for paused partitions. Key: KAFKA-7548 URL: https://issues.apache.org/jira/browse/KAFKA-7548

Re: Frequent under-replicated partitions

Still looking for some response here. Pls assist. On Sat, Oct 20, 2018 at 12:43 AM Suman B N wrote: > Rate of ingestion is not 150-200rps. Its 150k-200k rps. > > On Fri, Oct 19, 2018 at 11:12 PM Suman B N wrote: > >> Team, >> We have been observing some partitions being under-replicated.

Build failed in Jenkins: kafka-trunk-jdk11 #54

See Changes: [manikumar.reddy] KAFKA-5462: Add configuration to build custom SSL principal name -- [...truncated 2.34 MB...]

Re: [VOTE] KIP-377: TopicCommand to use AdminClient

Thanks for the votes so far. @Colin: yup, I've added this to the KIP. Thanks. On Thu, Oct 25, 2018 at 2:30 AM Colin McCabe wrote: > > Thanks, Viktor. +1 (binding). > > One note: can we add a deprecation warning when --zookeeper is used, to > indicate that this option will be phased out in the

[jira] [Resolved] (KAFKA-5462) Add a configuration for users to specify a template for building a custom principal name

[ https://issues.apache.org/jira/browse/KAFKA-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5462. -- Resolution: Fixed Fix Version/s: 2.2.0 > Add a configuration for users to specify a template

Re: [VOTE] KIP-377: TopicCommand to use AdminClient

Thanks for the KIP. +1 (binding). -Harsha On Oct 25, 2018, 10:40 AM -0400, Viktor Somogyi-Vass , wrote: > Thanks for the votes so far. > > @Colin: yup, I've added this to the KIP. Thanks. > On Thu, Oct 25, 2018 at 2:30 AM Colin McCabe wrote: > > > > Thanks, Viktor. +1 (binding). > > > > One

Re: [DISCUSS] KIP-385: Provide configuration allowing consumer to no throw away prefetched data

Hi Colin/Zahari, I have created a ticket for the similar/same feature : https://issues.apache.org/jira/browse/KAFKA-7548 We (Linkedin) had a use case in Samza at Linkedin when they moved from the SimpleConsumer to KafkaConsumer and they wanted to do this pause and resume pattern. They realized

[jira] [Created] (KAFKA-7551) Refactor to create both producer & consumer in Worker

Magesh kumar Nandakumar created KAFKA-7551: -- Summary: Refactor to create both producer & consumer in Worker Key: KAFKA-7551 URL: https://issues.apache.org/jira/browse/KAFKA-7551 Project:

[jira] [Resolved] (KAFKA-7535) KafkaConsumer doesn't report records-lag if isolation.level is read_committed

[ https://issues.apache.org/jira/browse/KAFKA-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7535. -- Resolution: Fixed > KafkaConsumer doesn't report records-lag if isolation.level is read_committed >

Re: [VOTE] KIP-377: TopicCommand to use AdminClient

+1 (non-binding) Regards, Kevin On Thu, Oct 25, 2018 at 8:19 AM Harsha Chintalapani wrote: > Thanks for the KIP. +1 (binding). > -Harsha > On Oct 25, 2018, 10:40 AM -0400, Viktor Somogyi-Vass < > viktorsomo...@gmail.com>, wrote: > > Thanks for the votes so far. > > > > @Colin: yup, I've added

Re: [DISCUSS] KIP-385: Provide configuration allowing consumer to no throw away prefetched data

Hi Zahari, One question we didn't figure out earlier was who would actually want this cached data to be thrown away. If there's nobody who actually wants this, then perhaps we can simplify the proposal by just unconditionally retaining the cache until the partition is resumed, or we

Re: [VOTE] KIP-377: TopicCommand to use AdminClient

+1 (binding) Thanks for working on this. On Wed, Oct 24, 2018, 7:28 AM Viktor Somogyi-Vass wrote: > Hi All, > > I'd like to start a vote on KIP-377: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-377%3A+TopicCommand+to+use+AdminClient > . > > Summary: > The KIP basically proposes to

Build failed in Jenkins: kafka-trunk-jdk11 #56

See Changes: [lindong28] MINOR: add upgrade note for KIP-336 -- [...truncated 2.35 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: kafka-2.0-jdk8 #176

See -- [...truncated 434.91 KB...] kafka.security.auth.ZkAuthorizationTest > testConsumerOffsetPathAcls STARTED kafka.security.auth.ZkAuthorizationTest > testConsumerOffsetPathAcls PASSED

Re: Request for contributor permission

Done. On 10/25/18 7:27 AM, Andrew Schofield wrote: > Please could I have contributor permission to Apache Kafka. Here are my > details: > > JIRA ID: schofielaj > Wiki ID: schofielaj > > Thanks, > Andrew Schofield > IBM Event Streams > signature.asc Description: OpenPGP digital signature

Request for contributor permission

Please could I have contributor permission to Apache Kafka. Here are my details: JIRA ID: schofielaj Wiki ID: schofielaj Thanks, Andrew Schofield IBM Event Streams

[jira] [Created] (KAFKA-7552) StatefulProcessorNode tries to connect state store to processor before it is added

Adam Bellemare created KAFKA-7552: - Summary: StatefulProcessorNode tries to connect state store to processor before it is added Key: KAFKA-7552 URL: https://issues.apache.org/jira/browse/KAFKA-7552

[jira] [Created] (KAFKA-7553) Jenkins PR tests hung

John Roesler created KAFKA-7553: --- Summary: Jenkins PR tests hung Key: KAFKA-7553 URL: https://issues.apache.org/jira/browse/KAFKA-7553 Project: Kafka Issue Type: Bug Reporter: John

[jira] [Created] (KAFKA-7554) zookeeper.session.timeout.ms Value

BELUGA BEHR created KAFKA-7554: -- Summary: zookeeper.session.timeout.ms Value Key: KAFKA-7554 URL: https://issues.apache.org/jira/browse/KAFKA-7554 Project: Kafka Issue Type: Improvement

Jenkins build is back to normal : kafka-trunk-jdk11 #55

See

Re: [DISCUSS] KIP-385: Provide configuration allowing consumer to no throw away prefetched data

Hi there Mayuresh, Great to heat that this is actually working well in production for some time now. I have changed the details of the KIP to reflect the fact that as already discussed - we do not really need any kind of configuration as this data should not be thrown away at all. Submitting a

Build failed in Jenkins: kafka-2.0-jdk8 #175

See Changes: [lindong28] KAFKA-7535; KafkaConsumer doesn't report records-lag if isolation.level -- [...truncated 928.21 KB...] kafka.security.auth.ZkAuthorizationTest >

[jira] [Created] (KAFKA-7550) 0-byte log segments on topics with log compaction

Jakub Korab created KAFKA-7550: -- Summary: 0-byte log segments on topics with log compaction Key: KAFKA-7550 URL: https://issues.apache.org/jira/browse/KAFKA-7550 Project: Kafka Issue Type: Bug

Jenkins build is back to normal : kafka-trunk-jdk11 #57

See

Re: [DISCUSS] KIP-385: Provide configuration allowing consumer to no throw away prefetched data

Hi Zahari, Oops. We had planned to put this patch upstream but somehow slipped my mind. We were recently going over hotfixes that we have and this seemed something that had been due for sometime now. Glad to know that someone else apart from us might also benefit from this :) Thanks, Mayuresh

Re: [DISCUSS] KIP-385: Provide configuration allowing consumer to no throw away prefetched data

Hi Zahari, Created the patch here : https://github.com/apache/kafka/pull/5844 Thanks, Mayuresh On Thu, Oct 25, 2018 at 4:42 PM Mayuresh Gharat wrote: > Hi Zahari, > > Oops. We had planned to put this patch upstream but somehow slipped my > mind. We were recently going over hotfixes that we

Re: [DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

Hi All, Based on the feedback in this thread, and in light of Ryanne’s excellent proposal (KIP-382: MirrorMaker 2.0) which incorporates and extends the goals of KIP-310, I have updated the status of KIP-310 to “Discarded" and added a comment that KIP-382 supersedes it. Thank you all for the

Jenkins build is back to normal : kafka-2.0-jdk8 #177

See

Re: [VOTE] KIP-349 Priorities for Source Topics

The reporter of KAFKA-6690 (Bala) replied in the JIra ticket to my question to elaborate about his use-case. I don’t think he’s on the dev list. Here’s his response: Bala: Sorry about the delay in reply. We use Kafka to process the asynchronous events of our Document Management System

[VOTE] 2.0.1 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 2.0.1. This is a bug fix release closing 49 tickets: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+2.0.1 Release notes for the 2.0.1 release:

[jira] [Resolved] (KAFKA-395) kafka.tools.MirrorMaker black/white list improvement

[ https://issues.apache.org/jira/browse/KAFKA-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-395. Resolution: Workaround As this issue has not been touched in more than 6 years I think it is fairly

[jira] [Created] (KAFKA-7555) If the disk is full, Kafka will suddenly fail.

hajin kim created KAFKA-7555: Summary: If the disk is full, Kafka will suddenly fail. Key: KAFKA-7555 URL: https://issues.apache.org/jira/browse/KAFKA-7555 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-7549) Old ProduceRequest with zstd compression does not return error to client

Magnus Edenhill created KAFKA-7549: -- Summary: Old ProduceRequest with zstd compression does not return error to client Key: KAFKA-7549 URL: https://issues.apache.org/jira/browse/KAFKA-7549 Project:

Fwd: [DISCUSS] Make org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable

Hello I'd like to introduce new feature for kafka client: Making org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable Here is KPI https://cwiki.apache.org/confluence/display/KAFKA/KIP-375%3A+Make+org.apache.kafka.clients.Metadata%23TOPIC_EXPIRY_MS+configurable The problem is: if