[jira] [Created] (KAFKA-9977) Kafka Connect Task level error metrics exposed via JMX not removed on connector delete

2020-05-10 Thread Tharindu (Jira)
Tharindu created KAFKA-9977: --- Summary: Kafka Connect Task level error metrics exposed via JMX not removed on connector delete Key: KAFKA-9977 URL: https://issues.apache.org/jira/browse/KAFKA-9977 Project: K

Re: [DISCUSS] KIP-554: Add Broker-side SCRAM Config API

2020-05-10 Thread Cheng Tan
Hi Colin, If I understood correctly, in your design, listScramUsers will return the mechanism and iteration. Let’s use the field naming of RFC 5802 for this discussion: SaltedPassword := Hi(Normalize(password), salt, i) ClientKey := HMAC(SaltedPassword, "Client Key") Stor

Re: [DISCUSS] KIP-317 - Add end-to-end data encryption functionality to Apache Kafka

2020-05-10 Thread Adam Bellemare
@Ryanne > Seems that could still get us per-topic keys (vs encrypting the entire > volume), which would be my main requirement. Agreed, I think that per-topic separation of keys would be very valuable for multi-tenancy. My 2 cents is that if encryption at rest is sufficient to satisfy GDPR + oth

Re: [DISCUSS] KIP-602 - Change default value for client.dns.lookup

2020-05-10 Thread Badai Aqrandista
Ismael PR created: https://github.com/apache/kafka/pull/8644/files Also, as this is my first PR, please let me know if I missed anything. Thanks Badai On Mon, May 11, 2020 at 8:19 AM Badai Aqrandista wrote: > Ismael > > Thank you for responding. > > KIP-235 modified ClientUtils#parseAndValida

Re: [DISCUSS] KIP-602 - Change default value for client.dns.lookup

2020-05-10 Thread Badai Aqrandista
Ismael Thank you for responding. KIP-235 modified ClientUtils#parseAndValidateAddresses [1] to resolve an address alias (i.e. bootstrap server) into multiple addresses. This is why it would break SSL hostname verification when the bootstrap server is an IP address, i.e. it will resolve the IP add

Re: [DISCUSS] Kafka 3.0

2020-05-10 Thread Michael K. Edwards
Yes, I've read the KIP. But all it really says to me is "we have never gotten around to using ZooKeeper properly." To the extent that any of the distributed-state-maintenance problems discussed in "Metadata as an Event Log" can be solved — and some of them intrinsically can't, because CAP theorem

Re: [DISCUSS] Kafka 3.0

2020-05-10 Thread Ron Dagostino
Hi Michael. This is discussed in the KIP. https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum#KIP-500:ReplaceZooKeeperwithaSelf-ManagedMetadataQuorum-Motivation Ron > On May 10, 2020, at 1:35 PM, Michael K. Edwards wrote: > > What

Re: [DISCUSS] Kafka 3.0

2020-05-10 Thread Michael K. Edwards
What is the actual goal of removing the ZooKeeper dependency? In my experience, if ZooKeeper is properly provisioned and deployed, it's largely trouble-free. (You do need to know how to use observers properly.) There are some subtleties about timeouts and leadership changes, but they're pretty s

Re: Kafka Contributor - JIRA ID "sarahdreischer"

2020-05-10 Thread Manikumar
Hi, Thanks for your interest in Kafka project. I just added you to contributors list. Thanks, On Sun, May 10, 2020 at 10:26 PM Sarah D wrote: > Hi, > > I would like to become a Kafka Contributor as I am hoping to contribute to > a few newbie JIRA tasks soon. > > I have worked with Kafka’s Java

Kafka Contributor - JIRA ID "sarahdreischer"

2020-05-10 Thread Sarah D
Hi, I would like to become a Kafka Contributor as I am hoping to contribute to a few newbie JIRA tasks soon. I have worked with Kafka’s Java API at my current job and would therefore like to up-level my understanding of Kafka and hopefully offer improvements. My JIRA username: sarahdreischer

Build failed in Jenkins: kafka-trunk-jdk8 #4517

2020-05-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9942: ConfigCommand fails to set client quotas for default users -- [...truncated 6.12 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Jenkins build is back to normal : kafka-trunk-jdk14 #70

2020-05-10 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk11 #1439

2020-05-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9942: ConfigCommand fails to set client quotas for default users -- [...truncated 3.08 MB...] org.apache.kafka.streams.TopologyTestDriverTes

High latency on kafka communication

2020-05-10 Thread up201503995
I am doing some performance tests on Apache Kafka to compare it with others like RabbitMQ and ActiveMQ. The idea is to use it on a messaging system for agents' communication. I am testing multiple scenarios (one to one, broadcast and many to one) with different numbers of publishers and subscr