Build failed in Jenkins: kafka-trunk-jdk8 #2337

See Changes: [github] KAFKA-6302: Improve AdmintClient JavaDocs -- [...truncated 3.39 MB...] kafka.utils.CoreUtilsTest > testReadInt PASSED kafka.utils.CoreUtilsTest >

[VOTE] KIP-247: Add public test utils for Kafka Streams

Hi, I would like to start the vote for KIP-247: https://cwiki.apache.org/confluence/display/KAFKA/KIP-247%3A+Add+public+test+utils+for+Kafka+Streams -Matthias signature.asc Description: OpenPGP digital signature

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

Hi, I updated the KIP and added an `OutputVerifier` class. Looking forward to your feedback. I will start the Vote thread in parallel. -Matthias On 1/17/18 11:40 AM, Matthias J. Sax wrote: > Saïd, > > sorry for late reply. Avro records are basically supported. However, > there are no

答复: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations, Rajini Sivaram. Very well deserved! 发件人: Konstantine Karantasis 发送时间: 2018年1月18日 6:23 收件人: dev@kafka.apache.org 抄送: us...@kafka.apache.org 主题: Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram Congrats Rajini!

Build failed in Jenkins: kafka-trunk-jdk7 #3101

See Changes: [github] KAFKA-6302: Improve AdmintClient JavaDocs -- [...truncated 405.88 KB...] kafka.utils.CoreUtilsTest > testReadInt STARTED kafka.utils.CoreUtilsTest

Jenkins build is back to normal : kafka-trunk-jdk9 #316

See

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

Okay, I made a few more updates to the KIP: - Not all headers have a raw value, so exposing a method to get the raw value is not as useful as I thought. Removed the `Header.rawValue()` method. - The `Value.convertToX(...)` methods have to take both the value and the original schema. This makes

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini! On Thu, Jan 18, 2018 at 9:23 AM, Konstantine Karantasis < konstant...@confluent.io> wrote: > Congrats Rajini! > > -Konstantine > > On Wed, Jan 17, 2018 at 2:18 PM, Becket Qin wrote: > > > Congratulations, Rajini! > > > > On Wed, Jan 17, 2018 at 1:52

Build failed in Jenkins: kafka-trunk-jdk8 #2336

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H24 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-1.0-jdk7 #124

See Changes: [matthias] KAFKA-6302: Improve AdmintClient JavaDocs -- [...truncated 294.60 KB...] at

Build failed in Jenkins: kafka-trunk-jdk7 #3100

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H24 (ubuntu xenial) in workspace

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congrats Rajini! -Konstantine On Wed, Jan 17, 2018 at 2:18 PM, Becket Qin wrote: > Congratulations, Rajini! > > On Wed, Jan 17, 2018 at 1:52 PM, Ismael Juma wrote: > > > Congratulations Rajini! > > > > On 17 Jan 2018 10:49 am, "Gwen Shapira"

Build failed in Jenkins: kafka-trunk-jdk8 #2335

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H24 (ubuntu xenial) in workspace

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations, Rajini! On Wed, Jan 17, 2018 at 1:52 PM, Ismael Juma wrote: > Congratulations Rajini! > > On 17 Jan 2018 10:49 am, "Gwen Shapira" wrote: > > Dear Kafka Developers, Users and Fans, > > Rajini Sivaram became a committer in April 2017. Since

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini! On 17 Jan 2018 10:49 am, "Gwen Shapira" wrote: Dear Kafka Developers, Users and Fans, Rajini Sivaram became a committer in April 2017. Since then, she remained active in the community and contributed major patches, reviews and KIP discussions. I am

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini ! On Wed, Jan 17, 2018 at 8:06 PM, Paolo Patierno wrote: > Congratulations Rajini ! > > > From: Sriram Subramanian > Sent: Wednesday, January 17, 2018 8:01 PM > To: dev@kafka.apache.org > Subject: Re:

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

+1 (binding). Thanks Jorge. Guozhang On Wed, Jan 17, 2018 at 11:29 AM, Gwen Shapira wrote: > Hey, since there were no additional comments in the discussion, I'd like to > resume the voting. > > +1 (binding) > > On Fri, Nov 17, 2017 at 9:15 AM Guozhang Wang

Re: [DISCUSS] KIP-242: Mask password fields in Kafka Connect REST response

Vincent, Can the KIP more explicitly say that this is opt-in, and that by default nothing will change? Randall On Tue, Jan 16, 2018 at 11:18 PM, Ewen Cheslack-Postava wrote: > Vincent, > > I think with the addition of a configuration to control this for > compatibility,

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini ! From: Sriram Subramanian Sent: Wednesday, January 17, 2018 8:01 PM To: dev@kafka.apache.org Subject: Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram Congratulations Rajini! On Wed, Jan 17, 2018 at 11:40 AM,

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini! On Wed, Jan 17, 2018 at 11:40 AM, Edoardo Comar wrote: > Congratulations Rajini! Bravissima! > -- > > Edoardo Comar > > IBM Message Hub > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > From: Guozhang Wang

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini! Bravissima! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Guozhang Wang To: dev@kafka.apache.org Date: 17/01/2018 19:29 Subject:Re: [ANNOUNCE] New Kafka

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

Saïd, sorry for late reply. Avro records are basically supported. However, there are no plans atm to integrate the test driver with a schema registry. Note, that Apache Kafka does not provide a schema registry by itself. If we integrate one RS, we need to integrate all of them -- that is

[jira] [Reopened] (KAFKA-4186) Transient failure in KStreamAggregationIntegrationTest.shouldGroupByKey

[ https://issues.apache.org/jira/browse/KAFKA-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reopened KAFKA-4186: -- Assignee: Matthias J. Sax (was: Damian Guy) > Transient failure in

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Hey, since there were no additional comments in the discussion, I'd like to resume the voting. +1 (binding) On Fri, Nov 17, 2017 at 9:15 AM Guozhang Wang wrote: > Hello Jorge, > > I left some comments on the discuss thread. The wiki page itself looks good > overall. > > >

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini ！ Guozhang On Wed, Jan 17, 2018 at 11:08 AM, Bill Bejeck wrote: > Congrats Rajini! > > -Bill > > On Wed, Jan 17, 2018 at 2:02 PM, Matthias J. Sax > wrote: > > > Congrats Rajini!! > > > > -Matthias > > > > On 1/17/18 10:54 AM,

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congrats Rajini! -Bill On Wed, Jan 17, 2018 at 2:02 PM, Matthias J. Sax wrote: > Congrats Rajini!! > > -Matthias > > On 1/17/18 10:54 AM, Vahid S Hashemian wrote: > > Great news! Congratulations Rajini! > > > > --Vahid > > > > > > > > From: Gwen Shapira

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congrats Rajini!! -Matthias On 1/17/18 10:54 AM, Vahid S Hashemian wrote: > Great news! Congratulations Rajini! > > --Vahid > > > > From: Gwen Shapira > To: "dev@kafka.apache.org" , Users > > Date: 01/17/2018 10:49

[jira] [Created] (KAFKA-6458) ERROR Found invalid messages during fetch for partition [__consumer_offsets,20] offset 0 error Record is corrupt (stored crc = 73, computed crc = 2559213387) (kafka.serve

VinayKumar created KAFKA-6458: - Summary: ERROR Found invalid messages during fetch for partition [__consumer_offsets,20] offset 0 error Record is corrupt (stored crc = 73, computed crc = 2559213387) (kafka.server.ReplicaFetcherThread)

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Congratulations Rajini ! On Wed, Jan 17, 2018 at 10:54 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Great news! Congratulations Rajini! > > --Vahid > > > > From: Gwen Shapira > To: "dev@kafka.apache.org" , Users >

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Great news! Congratulations Rajini! --Vahid From: Gwen Shapira To: "dev@kafka.apache.org" , Users Date: 01/17/2018 10:49 AM Subject:[ANNOUNCE] New Kafka PMC Member: Rajini Sivaram Dear Kafka Developers,

[ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

Dear Kafka Developers, Users and Fans, Rajini Sivaram became a committer in April 2017. Since then, she remained active in the community and contributed major patches, reviews and KIP discussions. I am glad to announce that Rajini is now a member of the Apache Kafka PMC. Congratulations, Rajini

Re: [HELP] Guidelines/tools to test kafka performance with application layer involved

Have you looked at kafka-producer-perf-test.sh and kafka-consumer-perf-test.sh that are bundled with kafka in the bin directory? On Wed, Jan 17, 2018 at 12:50 AM, Pritam Kadam wrote: > Hello, > > We are using kafka for pub sub and want test performance of entire system.

Re: [DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

Thinking about point 61 more, I realize that the async zookeeper read may make it less of an issue for controller to read more zookeeper nodes. Writing partition_epoch in the per-partition znode makes it simpler to handle the broker failure between zookeeper writes for a topic creation. I have

Fwd: [Production Guideline] Is it good idea to provide limited number of brokers(3 brokers) in kafka client in large cluster

Hi, I have a use case where my kafka cluster will have 1000 brokers and I am writing kafka client. In order to write client, i need to provide brokers list. Question is, what are the recommended guidelines to provide brokers list in client? *Is there any proxy like service available in kafka

Fwd: [HELP] Guidelines/tools to test kafka performance with application layer involved

Hello, We are using kafka for pub sub and want test performance of entire system. Is there any tool readily available in kafka world which can simulate multiple publishers and subscribers tp measure latency and throughput considering custom application layer? Any guidelines around this would be

Re: [DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

Hey Jun, Thanks much for the comments. Please see my comments inline. On Tue, Jan 16, 2018 at 4:38 PM, Jun Rao wrote: > Hi, Dong, > > Thanks for the updated KIP. Looks good to me overall. Just a few minor > comments. > > 60. OffsetAndMetadata

Re: [DISCUSS] KIP-218: Make KafkaFuture.Function java 8 lambda compatible

Hi Steven, do you think you'll get a chance to address the points Ismael made? It'd be great to get this change into 1.1. Thanks! Xavier On Tue, Dec 19, 2017 at 12:20 PM Ismael Juma wrote: > Hi Steven, > > As a general rule, we don't freeze KIPs after the vote passes. It's >

Re: [VOTE] KIP-219 - Improve Quota Communication

Actually returning an empty fetch request may still be useful to reduce the throttle time due to request quota violation because the FetchResponse send time will be less. I just updated the KIP. Rajini, does that address your concern? On Tue, Jan 16, 2018 at 7:01 PM, Becket Qin

Re: [VOTE] KIP-219 - Improve Quota Communication

Actually returning an empty fetch request may still be useful to reduce the throttle time due to request quota violation because the FetchResponse send time will be less. I just updated the KIP. Rajini, does that address your concern? On Tue, Jan 16, 2018 at 7:01 PM, Becket Qin

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

Ewen and Michael, Thanks for the feedback. I've updated the KIP based upon your feedback. Detailed responses inline below. Randall On Tue, Jan 2, 2018 at 3:44 PM, Ewen Cheslack-Postava wrote: > A few thoughts, mostly just details: > > * Is the SchemaAndValue return type

Re: [DISCUSS] KIP-86: Configurable SASL callback handlers

Hi all, I have made some updates to this KIP to simplify addition of new SASL mechanisms: 1. The Login interface has been made configurable as well (we have had this interface for quite some time and it has been stable). 2. The callback handler properties for client-side and

[jira] [Created] (KAFKA-6457) Error: NOT_LEADER_FOR_PARTITION leads to NPE

Seweryn Habdank-Wojewodzki created KAFKA-6457: - Summary: Error: NOT_LEADER_FOR_PARTITION leads to NPE Key: KAFKA-6457 URL: https://issues.apache.org/jira/browse/KAFKA-6457 Project: Kafka

Re: [DISCUSS] KIP-248 Create New ConfigCommand That Uses The New AdminClient

Hi Viktor, Thank you for the responses. 1. ConsoleProducer uses *--producer.config --producer-property key=value*, ConsoleConsumer uses* --consumer.config --consumer-property key=value*, so perhaps we should use *--adminclient.config *rather than *--config.properties*? 3. The one difference

Re: [ANNOUNCE] New committer: Matthias J. Sax

Congratulations Mathias! On Tue, Jan 16, 2018 at 11:52 AM, Becket Qin wrote: > Congrats, Matthias! > > On Mon, Jan 15, 2018 at 9:54 PM, Konstantine Karantasis < > konstant...@confluent.io> wrote: > > > Matthias! Congratulations! > > > > Konstantine > > > > On Mon, Jan 15,

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

Matthias, What about testing topology that use avro schema ? Have you read my previous response ? Thanks. On Wed, Jan 17, 2018 at 3:34 AM Matthias J. Sax wrote: > Colin, > > the TopologyTestDriver does not connect to any broker and simulates > processing of

[jira] [Created] (KAFKA-6456) Improve JavaDoc of SourceTask

Gunnar Morling created KAFKA-6456: - Summary: Improve JavaDoc of SourceTask Key: KAFKA-6456 URL: https://issues.apache.org/jira/browse/KAFKA-6456 Project: Kafka Issue Type: Improvement