[jira] [Created] (KAFKA-6932) Avroconverter does not propagate subjectname stratergy

Masthan Shaik created KAFKA-6932: Summary: Avroconverter does not propagate subjectname stratergy Key: KAFKA-6932 URL: https://issues.apache.org/jira/browse/KAFKA-6932 Project: Kafka Issue

Build failed in Jenkins: kafka-trunk-jdk8 #2668

See Changes: [mjsax] KAFKA-6850: Add Record Header support to Kafka Streams Processor API [github] MINOR: Fix transiently failing consumer group admin integration test

Re: [VOTE] KIP-306: Configuration for Delaying Response to Failed Client Authentication

Thank you, everyone. I have updated the KIP to address Jason's comment. I am also closing this vote with 4 binding and 3 non-binding votes, and no objections. Thanks, Dhruvil On Tue, May 22, 2018 at 1:55 AM, Rajini Sivaram wrote: > Hi Dhruvil, Thanks for the KIP! > >

Re: [EXTERNAL] Kafka Connect: New Kafka Source Connector

Sorry for the delay, didn't see this until now. I've given you edit permissions on the wiki. -Ewen On Tue, May 15, 2018 at 2:21 PM McCaig, Rhys wrote: > Hi Team, > > Would someone be able to provide me with Confluence permission in order to > write a KIP for the below

Jenkins build is back to normal : kafka-trunk-jdk8 #2667

See

Re: [VOTE] KIP-305: Add Connect primitive number converters

+1 Thanks, Yeva On Tue, May 22, 2018 at 7:48 PM, Magesh Nandakumar wrote: > +1 (non-binding) > > Thanks > Magesh > > On Tue, May 22, 2018 at 4:23 PM, Randall Hauch wrote: > > > (bump so a few new subscribers see this thread.) > > > > On Tue, May 22,

Jenkins build is back to normal : kafka-trunk-jdk10 #130

See

Re: [VOTE] KIP-235 Add DNS alias support for secured connection

Thanks for the KIP. I think this is a good and low risk change. It would be good to ensure that it works well with KIP-302 if we think that makes sense too. In any case, +1 (binding). Ismael On Fri, Mar 23, 2018 at 12:05 PM Skrzypek, Jonathan < jonathan.skrzy...@gs.com> wrote: > Hi, > > I would

[jira] [Resolved] (KAFKA-6875) EosIntegrationTest#shouldNotViolateEosIfOneTaskFails is flaky

[ https://issues.apache.org/jira/browse/KAFKA-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-6875. --- Resolution: Cannot Reproduce > EosIntegrationTest#shouldNotViolateEosIfOneTaskFails is flaky >

Re: [VOTE] KIP-305: Add Connect primitive number converters

+1 (non-binding) Thanks Magesh On Tue, May 22, 2018 at 4:23 PM, Randall Hauch wrote: > (bump so a few new subscribers see this thread.) > > On Tue, May 22, 2018 at 4:39 PM, Randall Hauch wrote: > > > +1 (non-binding) > > > > On Tue, May 22, 2018 at 4:05 PM,

Build failed in Jenkins: kafka-trunk-jdk10 #129

See Changes: [me] KAFKA-5807 - Check Connector.config() and Transformation.config() -- [...truncated 1.50 MB...] kafka.log.BrokerCompressionTest >

Re: [VOTE] KIP-305: Add Connect primitive number converters

(bump so a few new subscribers see this thread.) On Tue, May 22, 2018 at 4:39 PM, Randall Hauch wrote: > +1 (non-binding) > > On Tue, May 22, 2018 at 4:05 PM, Matthias J. Sax > wrote: > >> +1 (binding) >> >> On 5/22/18 1:49 PM, Gwen Shapira wrote: >> >

[jira] [Resolved] (KAFKA-6920) Enhance ConsumerRecordFactory and OutputVerifier for Header support

[ https://issues.apache.org/jira/browse/KAFKA-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6920. Resolution: Duplicate > Enhance ConsumerRecordFactory and OutputVerifier for Header support

Jenkins build is back to normal : kafka-trunk-jdk10 #128

See

Re: [VOTE] KIP-305: Add Connect primitive number converters

+1 (non-binding) On Tue, May 22, 2018 at 4:05 PM, Matthias J. Sax wrote: > +1 (binding) > > On 5/22/18 1:49 PM, Gwen Shapira wrote: > > +1 (I can't believe we didn't have it until now...) > > > > On Tue, May 22, 2018 at 1:26 PM, Ewen Cheslack-Postava < >

Re: [VOTE] KIP-298: Error Handling in Connect kafka

All, I'm closing this voting thread with 5 binding votes (Gwen, Guozhang, Matthias, Ewen, Jason) and 3 non-binding votes (Konstantine, Magesh, Randall). Thanks everyone for your comments and feedback. Much appreciated! Best, Arjun On Tue, May 22, 2018 at 11:39 AM, Jason Gustafson

Build failed in Jenkins: kafka-trunk-jdk8 #2666

See Changes: [lindong28] MINOR: Remove o.a.kafka.common.utils.Base64 and IS_JAVA8_COMPATIBLE [lindong28] MINOR: AdminClient metadata manager should reset state on failure [github] MINOR: AdminClient consumer

Re: [VOTE] KIP-305: Add Connect primitive number converters

+1 (binding) On 5/22/18 1:49 PM, Gwen Shapira wrote: > +1 (I can't believe we didn't have it until now...) > > On Tue, May 22, 2018 at 1:26 PM, Ewen Cheslack-Postava > wrote: > >> +1 (binding) >> >> -Ewen >> >> On Tue, May 22, 2018 at 9:29 AM Ted Yu

[jira] [Resolved] (KAFKA-5807) Check Connector.config() and Transformation.config() returns a valid ConfigDef

[ https://issues.apache.org/jira/browse/KAFKA-5807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-5807. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

Re: [VOTE] KIP-305: Add Connect primitive number converters

+1 (I can't believe we didn't have it until now...) On Tue, May 22, 2018 at 1:26 PM, Ewen Cheslack-Postava wrote: > +1 (binding) > > -Ewen > > On Tue, May 22, 2018 at 9:29 AM Ted Yu wrote: > > > +1 > > > > On Tue, May 22, 2018 at 9:19 AM, Randall Hauch

Re: [VOTE] KIP-305: Add Connect primitive number converters

+1 (binding) -Ewen On Tue, May 22, 2018 at 9:29 AM Ted Yu wrote: > +1 > > On Tue, May 22, 2018 at 9:19 AM, Randall Hauch wrote: > > > I'd like to start a vote of a very straightforward proposal for Connect > to > > add converters for the basic primitive

Kafka consumer to unzip stream of .gz files and read

HI Team, Greeting! I am facing one issue on kafka consumer using python hope you guys help us to resolve this issue Kafka consumer to unzip stream of .gz files and read Kafka producer is sending

Build failed in Jenkins: kafka-trunk-jdk10 #127

See Changes: [lindong28] MINOR: Remove o.a.kafka.common.utils.Base64 and IS_JAVA8_COMPATIBLE [lindong28] MINOR: AdminClient metadata manager should reset state on failure

[jira] [Resolved] (KAFKA-2943) Transient Failure in kafka.producer.SyncProducerTest.testReachableServer

[ https://issues.apache.org/jira/browse/KAFKA-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2943. -- Resolution: Auto Closed > Transient Failure in kafka.producer.SyncProducerTest.testReachableServer >

[jira] [Resolved] (KAFKA-5432) producer and consumer SocketTimeoutException

[ https://issues.apache.org/jira/browse/KAFKA-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5432. -- Resolution: Auto Closed Closing inactive issue.  Exceptions observed with deprecated scala clients. 

[jira] [Resolved] (KAFKA-4419) Unable to GetOffset when the ACL of topic is defined

[ https://issues.apache.org/jira/browse/KAFKA-4419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-4419. -- Resolution: Duplicate Resolving as duplicate of  KAFKA-3355. > Unable to GetOffset when the ACL of

[jira] [Resolved] (KAFKA-1460) NoReplicaOnlineException: No replica for partition

[ https://issues.apache.org/jira/browse/KAFKA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1460. -- Resolution: Auto Closed Closing inactive issue.  Please reopen if you think the issue still exists in

[jira] [Resolved] (KAFKA-2174) Wrong TopicMetadata deserialization

[ https://issues.apache.org/jira/browse/KAFKA-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2174. -- Resolution: Auto Closed Closing inactive issue. > Wrong TopicMetadata deserialization >

[jira] [Resolved] (KAFKA-3345) ProducerResponse could gracefully handle no throttle time provided

[ https://issues.apache.org/jira/browse/KAFKA-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3345. -- Resolution: Auto Closed Closing as scala producer is removed from codebase.

[jira] [Resolved] (KAFKA-5039) Logging in BlockingChannel and SyncProducer connect

[ https://issues.apache.org/jira/browse/KAFKA-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5039. -- Resolution: Auto Closed Closing as scala producer is removed from codebase. > Logging in

[jira] [Resolved] (KAFKA-3246) Transient Failure in kafka.producer.SyncProducerTest.testProduceCorrectlyReceivesResponse

[ https://issues.apache.org/jira/browse/KAFKA-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3246. -- Resolution: Auto Closed > Transient Failure in >

Re: [VOTE] KIP-298: Error Handling in Connect kafka

+1. Thanks for the KIP! On Mon, May 21, 2018 at 1:34 PM, Arjun Satish wrote: > All, > > Thanks so much for your feedback on this KIP. I've made some small > modifications today. I'll wait till midnight today (PDT) to close this > vote. Please let me know if there are any

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

Hello folks, I'm closing this voting thread with 4 binding votes (Gwen, Matthias, Damian and myself) and 3 non-binding votes (Ted, John, Bill). Thanks for everyone for your feedbacks! Guozhang On Tue, May 22, 2018 at 8:13 AM, Guozhang Wang wrote: > Hi Ismael, > > Yes, I

Build failed in Jenkins: kafka-trunk-jdk10 #126

See Changes: [wangguoz] KAFKA-6474: Rewrite tests to use new public TopologyTestDriver [part 3] -- [...truncated 1.50 MB...] kafka.controller.PartitionStateMachineTest

Java 8 switch in trunk

Hi all, We have switched to Java 8 in trunk. We can now use Java 8 for new code, but I suggest we don't refactor existing code to use Java 8 features like lambdas just yet. Let's focus on getting the 2.0.0 release out and after the first bug fix, we can consider refactors that will make backports

Re: [DISCUSS] KIP-298: Error Handling in Connect

After some discussions with Jason, we decided that the error handler should retry an operation only it throws a RetriableException. At the same time, any Exception in the Transformation and Converter step can be tolerated (by skipping the record). I updated the table in the Proposed Changes

Re: [VOTE] KIP-305: Add Connect primitive number converters

+1 On Tue, May 22, 2018 at 9:19 AM, Randall Hauch wrote: > I'd like to start a vote of a very straightforward proposal for Connect to > add converters for the basic primitive number types: integer, short, long, > double, and float that reuse Kafka's corresponding serdes. Here

[VOTE] KIP-305: Add Connect primitive number converters

I'd like to start a vote of a very straightforward proposal for Connect to add converters for the basic primitive number types: integer, short, long, double, and float that reuse Kafka's corresponding serdes. Here is the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-

Re: [DISCUSS] KIP-280: Enhanced log compaction

Hello Luís, While reviewing your PR I realized my previous calculation on the memory usage was incorrect: in fact, in the current implementation, each entry in the memory-bounded cache is 16 (default MD5 hash digest length) + 8 (long type) = 24 bytes, and if we add the long-typed version value it

[jira] [Resolved] (KAFKA-6924) Making state store queryable on replicas

[ https://issues.apache.org/jira/browse/KAFKA-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6924. -- Resolution: Duplicate > Making state store queryable on replicas >

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

Hi Ismael, Yes, I have thought about deprecating the old API first, but I've decided to just go ahead and modify the public APIs because 1) with deprecated and new APIs, the internal implementation needs to do a runtime type check on each record, which is not efficient; 2) the affected public

[jira] [Created] (KAFKA-6931) Make worker id configurable

Chia-Ping Tsai created KAFKA-6931: - Summary: Make worker id configurable Key: KAFKA-6931 URL: https://issues.apache.org/jira/browse/KAFKA-6931 Project: Kafka Issue Type: Task

Re: FW: [VOTE] KIP-235 Add DNS alias support for secured connection

Hi Jonathan, I think it would make sense to convert the config in this KIP into an enum so that we can add more variations later on. But since KIP-302 is still under discussion, it is not clear what the config name should be. Since today is the KIP deadline and the implementation itself is

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

+1 On Tue, May 22, 2018 at 3:46 AM, Ismael Juma wrote: > Breaking API without a deprecation cycle doesn't seem good. Are we sure > about this? > > Ismael > > On Mon, 21 May 2018, 15:04 Guozhang Wang, wrote: > > > Hello Matthias, > > > > I've tried it

[jira] [Created] (KAFKA-6930) Update KafkaZkClient debug log

darion yaphet created KAFKA-6930: Summary: Update KafkaZkClient debug log Key: KAFKA-6930 URL: https://issues.apache.org/jira/browse/KAFKA-6930 Project: Kafka Issue Type: Improvement

RE: [DISCUSS] KIP-280: Enhanced log compaction

Hi Matthias / Guozhang, Were the questions clarified? Please feel free to add more feedback, otherwise it would be nice to move this topic onwards  Kind Regards, Luís Cabral From: Guozhang Wang Sent: 09 May 2018 20:00 To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-280: Enhanced log

[jira] [Created] (KAFKA-6929) ZkData - Consumers offsets Zookeeper path is not correct

maytal created KAFKA-6929: - Summary: ZkData - Consumers offsets Zookeeper path is not correct Key: KAFKA-6929 URL: https://issues.apache.org/jira/browse/KAFKA-6929 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-6892) Kafka Streams memory usage grows over the time till OOM

[ https://issues.apache.org/jira/browse/KAFKA-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Kulig resolved KAFKA-6892. Resolution: Cannot Reproduce > Kafka Streams memory usage grows over the time till OOM >

Jenkins build is back to normal : kafka-trunk-jdk10 #125

See

Re: [DISCUSS] Apache Kafka 2.0.0 Release Plan

Thanks 2018-05-21 15:30 GMT+01:00 Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com>: > Ok, thanks! > > On Mon, 21 May 2018, 15:17 Rajini Sivaram, > wrote: > > > Jorge, > > > > KIP-244 has binding votes from Guozhang, Matthias and Damian. So you can > > close the

Re: [VOTE] KIP-306: Configuration for Delaying Response to Failed Client Authentication

Hi Dhruvil, Thanks for the KIP! +1 (binding) Regards, Rajini On Tue, May 22, 2018 at 1:18 AM, Jason Gustafson wrote: > +1. Just one nit: could we use an INT type for the config? I can't imagine > that not being enough. > > -Jason > > On Mon, May 21, 2018 at 3:59 PM,

Jenkins build is back to normal : kafka-trunk-jdk8 #2663

See

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

Breaking API without a deprecation cycle doesn't seem good. Are we sure about this? Ismael On Mon, 21 May 2018, 15:04 Guozhang Wang, wrote: > Hello Matthias, > > I've tried it out on the PR, the implementation should be fine but one > concern I had is that, as you may also

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

+1 On Tue, 22 May 2018 at 00:12, Gwen Shapira wrote: > Recasting my +1 > > On Mon, May 21, 2018 at 3:38 PM, Guozhang Wang wrote: > > > Thanks Matthias, will do. > > > > On Mon, May 21, 2018 at 3:35 PM, Matthias J. Sax > > wrote: >

Build failed in Jenkins: kafka-trunk-jdk10 #124

See Changes: [github] KAFKA-4423: Drop support for Java 7 (KIP-118) and update deps (#5046) -- Started by an SCM change [EnvInject] - Loading node environment variables.

Jenkins build is back to normal : kafka-trunk-jdk10 #123

See