Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-16 Thread Attila Sasvári
Congratulations Vahid! On Tue, Jan 15, 2019 at 11:45 PM Jason Gustafson wrote: > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the Kafka community

Re: [DISCUSS] KIP-395: Encypt-then-MAC Delegation token metadata

2019-01-07 Thread Attila Sasvári
aster key generation as part of KAFKA-7694. This will provide us out > > of the box implementation > > using ZooKeeper and pluggable interfaces for custom implementations. > > > > What do you think? > > > > Thanks, > > Manikumar > > > > On Sat, Dec

Re: "version" in kafka-reassign-partitions's JSON input file is not updated by KIP-113

2018-12-21 Thread Attila Sasvári
Any ideas why version has not been changed of the reassignment json file? If you generate it with kafka-reassign-partitions --zookeeper $(hostname -f):2181 --topics-to-move-json-file reassign.json --broker-list "26,27,28" --generate, you can see something like this: Current partition replica

[DISCUSS] KIP-395: Encypt-then-MAC Delegation token metadata

2018-12-01 Thread Attila Sasvári
Hi All, I have a proposal to allow Kafka brokers to encrypt sensitive metadata information about delegation tokens. As of now, delegation token metadata is stored in an unencrypted format in Zookeeper. Having the possibility to encrypt-then-MAC token information would be beneficial in Kafka

Re: [ANNOUNCE] New committer: Colin McCabe

2018-09-27 Thread Attila Sasvári
Congratulations Colin! Keep up the good work! On Wed, Sep 26, 2018 at 7:27 PM Yishun Guan wrote: > Congrats! -Yishun > > On Wed, Sep 26, 2018, 10:04 AM Konstantine Karantasis < > konstant...@confluent.io> wrote: > > > Well deserved! Congratulations Colin. > > > > -Konstantine > > > > On Wed,

Re: Issue in Creating the Kafka Consumer

2018-09-21 Thread Attila Sasvári
Hi Sravanthi, Do I understand correctly that you pass the path to your JAAS configuration file to the JVM via a system property (e.g -Djava.security.auth.login.config=/path_to_your_directory/jaas.conf )? >From the error message: > Caused by: _java.lang.IllegalArgumentException_: No serviceName

Re: [DISCUSS] KIP-373: Add '--help' option to all available Kafka CLI commands

2018-09-20 Thread Attila Sasvári
Hi all, This is just to inform you that this KIP was taken over by Srinivas Reddy. Good luck Srinivas! Regards, - Attila On Wed, Sep 19, 2018 at 1:30 PM Attila Sasvári wrote: > Hi all, > > I have just created a KIP to add '--help' option to all available Kafka > CLI comma

[DISCUSS] KIP-373: Add '--help' option to all available Kafka CLI commands

2018-09-19 Thread Attila Sasvári
Hi all, I have just created a KIP to add '--help' option to all available Kafka CLI commands: https://cwiki.apache.org/confluence/display/KAFKA/KIP-373%3A+Add+%27--help%27+option+to+all+available+Kafka+CLI+commands Tracking JIRA: https://issues.apache.org/jira/browse/KAFKA-7418 Regards, -

Re: [VOTE] KIP-366 - Make FunctionConversations private

2018-09-06 Thread Attila Sasvári
+1 (non-binding) On Thu, Sep 6, 2018 at 6:38 PM Guozhang Wang wrote: > +1 for deprecating and copying the class over to internals. > > On Thu, Sep 6, 2018 at 6:56 AM, Bill Bejeck wrote: > > > +1 > > > > -Bill > > > > On Thu, Sep 6, 2018 at 4:29 AM Joan Goyeau wrote: > > > > > Sournds good,

[VOTE] KIP-363: Allow performance tools to print final results to output file

2018-09-05 Thread Attila Sasvári
Hi All, I'd like to start the vote on KIP-363: *https://cwiki.apache.org/confluence/display/KAFKA/KIP-363%3A+Allow+performance+tools+to+print+final+results+to+output+file *

Re: [VOTE] KIP-359: Verify leader epoch in produce requests

2018-09-03 Thread Attila Sasvári
+1 (non-binding) On Mon, Sep 3, 2018 at 12:21 PM Manikumar wrote: > +1 (non-binding) > Thanks for the KIP. > > On Sun, Sep 2, 2018 at 10:06 PM Satish Duggana > wrote: > > > Thanks for the KIP, > > +1 (non-binding) > > > > On Sun, Sep 2, 2018 at 7:59 PM, Matthias J. Sax > > wrote: > > > > > +1

Re: [DISCUSS] KIP-363: Allow performance tools to print final results to output file

2018-08-31 Thread Attila Sasvári
he output to a file >> > anyways. >> > >> > Just a couple minor questions... >> > >> > 1. If the configured file already exists, what would be the outcome? My >> > intuition is that the performance tool will spit out some type of error >> a

Re: [VOTE] KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

2018-08-30 Thread Attila Sasvári
Thanks for the KIP and the updates Viktor! +1 (non-binding) On Wed, Aug 29, 2018 at 10:44 AM Manikumar wrote: > +1 (non-binding) > > Thanks for the KIP. > > On Wed, Aug 29, 2018 at 1:41 AM Jason Gustafson > wrote: > > > +1 Thanks for the updates. > > > > On Tue, Aug 28, 2018 at 1:15 AM,

Re: [VOTE] KIP-363: Make FunctionConversions private

2018-08-24 Thread Attila Sasvári
Hi there, There is a conflicting KIP with the same number, see https://cwiki.apache.org/confluence/display/KAFKA/KIP-363%3A+Allow+performance+tools+to+print+final+results+to+output+file Its discussion was started earlier, on August 23

Re: [DISCUSS] KIP-363: Allow performance tools to print final results to output file

2018-08-24 Thread Attila Sasvári
ance tool will spit out some type of error > and > > quit as we do not want to accidentally overwrite files. > > > > 2. Will the performance tool still output directly to shell if this > option > > is specified? > > > > Regards, > > Kevin > > &

[DISCUSS] KIP-363: Allow performance tools to print final results to output file

2018-08-22 Thread Attila Sasvári
Hi all, I have created a minor KIP to allow consumer and producer performance tools to print final results to output file in CSV format. https://cwiki.apache.org/confluence/display/KAFKA/KIP-363%3A+Allow+performance+tools+to+print+final+results+to+output+file Please take a look and share your

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Attila Sasvári
Congratulations Dong! Well deserved. Regards, Attila Paolo Patierno ezt írta (időpont: 2018. aug. 20., H 15:09): > Congratulations Dong! > > Paolo Patierno > Principal Software Engineer (IoT) @ Red Hat > Microsoft MVP on Azure & IoT > Microsoft Azure Advisor > > Twitter :

Permission to create KIP

2018-08-15 Thread Attila Sasvári
Hi there, Can you please grant me permission to create a KIP? Wiki ID: asasvari Thanks, Attila

Re: [DISCUSS] KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file

2018-08-14 Thread Attila Sasvári
. > > Regards, > Dong > > On Tue, Aug 7, 2018 at 5:28 AM, Attila Sasvári > wrote: > > > Hi Dong, > > > > Thanks for the KIP. +1 on using "command-config". > > > > Regarding the testing strategy: > > - Is it planned to add new system tes

Re: [DISCUSS] KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file

2018-08-07 Thread Attila Sasvári
Hi Dong, Thanks for the KIP. +1 on using "command-config". Regarding the testing strategy: - Is it planned to add new system test(s) to execute kafka-log-dirs.sh (kafka-reassign-partitions.sh) against an SSL-enabled broker? I know that the change is quite small, but it might be useful. Best,

Re: [DISCUSS] KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it

2018-08-04 Thread Attila Sasvári
Thanks for the KIP. Regarding the motivation: - KIP-113 added a new command, kafka-log-dirs.sh, to get the partitions associated with a specific broker (however, it does not work on secured clusters, see KIP-340). It would be probably better/more flexible if you could specify multiple broker

Re: Didn't receive video stream data into spark through kafka

2018-07-25 Thread Attila Sasvári
Hi Biswajit, Can you please provide more information: - What other symptoms do you see? Are all your Kafka brokers up and running? - What replication did you set for offsets.topic.replication.factor (i.e. replication factor of __consumer_offsets) in your Kafka broker's config ? What is set for

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

2018-05-20 Thread Attila Sasvári
, it would be a > >>> > > >> >> >> bit harder.> >> >> >> Most likely I'd need to call into > the Scala code with > >>> > > >> >> >> reflection, which> >> >> >> could be quite complicated. > >>&

Re: [VOTE] KIP-278: Add version option to Kafka's commands

2018-05-11 Thread Attila Sasvári
+1 (non-binding) Thomas Crayford ezt írta (időpont: 2018. máj. 11., P 18:20): > +1 (non-binding) > > On Fri, May 11, 2018 at 5:17 PM, Guozhang Wang wrote: > > > Thanks Toru-san, +1 (binding) > > > > On Fri, May 11, 2018 at 8:30 AM, Jason Gustafson

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

2018-04-15 Thread Attila Sasvári
t; list > > > that is used as a key is immutable is a good idea and would ease the > life > > > of people using the interface. Also more importantly would make sure > that > > > we always use the same hashCode. I have created wrapper classes for t

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

2018-04-03 Thread Attila Sasvári
Thanks for working on it Viktor. It looks good to me, but I have some questions: - I see a new type DOUBLE is used for quota_value , and it is not listed among the primitive types on the Kafka protocol guide. Can you add some more details? - I am not sure that using an environment (i.e.

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-29 Thread Attila Sasvári
Congratulations Dong. Keep up the good work! Becket Qin ezt írta (időpont: 2018. márc. 28., Sze 19:58): > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new Kafka committer. > > Dong started working

Re: [VOTE] 1.0.1 RC2

2018-02-23 Thread Attila Sasvári
Hi there, Here is what I did: - Verified signature and hashes - Built kafka from source - Executed tests - all passed - Started Zookeeper, Kafka broker, a console producer and consumer. Verified that the stream of records published to my test Kafka topic was processed - Ran the Kafka Streams demo