Build failed in Jenkins: kafka-trunk-jdk11 #1008

See Changes: [github] KAFKA-9091: Add a metric tracking the number of open connections with a -- [...truncated 2.75 MB...]

Re: [kafka-clients] [VOTE] 2.4.0 RC3

This particular test keeps failing for me ./gradlew :core:integrationTest --tests kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker I have created an issue to document my observations https://issues.apache.org/jira/browse/KAFKA-9283 It fails sometimes when the

[jira] [Created] (KAFKA-9284) Add documentation and system tests for TLS-encrypted Zookeeper connections

Ron Dagostino created KAFKA-9284: Summary: Add documentation and system tests for TLS-encrypted Zookeeper connections Key: KAFKA-9284 URL: https://issues.apache.org/jira/browse/KAFKA-9284 Project:

Jenkins build is back to normal : kafka-2.2-jdk8 #11

See

Build failed in Jenkins: kafka-2.1-jdk8 #246

See Changes: [rhauch] MINOR: Increase the timeout in one of Connect's distributed system tests -- [...truncated 922.39 KB...] kafka.security.auth.SimpleAclAuthorizerTest

Build failed in Jenkins: kafka-2.0-jdk8 #306

See Changes: [rhauch] MINOR: Increase the timeout in one of Connect's distributed system tests -- [...truncated 435.76 KB...] kafka.security.auth.ZkAuthorizationTest >

[jira] [Created] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

Richard Yu created KAFKA-9285: - Summary: Implement failed message topic to account for processing lag during failure Key: KAFKA-9285 URL: https://issues.apache.org/jira/browse/KAFKA-9285 Project: Kafka

Build failed in Jenkins: kafka-2.2-jdk8-old #194

See Changes: [john] MINOR: clarify node grouping of input topics using pattern subscription -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node

Build failed in Jenkins: kafka-trunk-jdk11 #1009

See Changes: [github] MINOR: Increase the timeout in one of Connect's distributed system tests [github] MINOR: Bump system test version from 2.2.1 to 2.2.2 (#7765) [vvcephei] MINOR: clarify node grouping of

[jira] [Created] (KAFKA-9283) Flaky Test - kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker

Israel Ekpo created KAFKA-9283: -- Summary: Flaky Test - kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker Key: KAFKA-9283 URL: https://issues.apache.org/jira/browse/KAFKA-9283

Build failed in Jenkins: kafka-2.1-jdk8 #245

See Changes: [rhauch] KAFKA-7489: Fix ConnectDistributedTest system test to use KafkaVersion -- [...truncated 889.07 KB...] kafka.api.PlaintextConsumerTest >

[jira] [Resolved] (KAFKA-9281) Consider more flexible node grouping for Pattern subscription

[ https://issues.apache.org/jira/browse/KAFKA-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9281. Resolution: Duplicate > Consider more flexible node grouping for Pattern

[jira] [Resolved] (KAFKA-9267) ZkSecurityMigrator should not create /controller node

[ https://issues.apache.org/jira/browse/KAFKA-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-9267. -- Fix Version/s: 2.5.0 Resolution: Fixed Issue resolved by pull request 7778

Re: Broker Interceptors

Hi, Couldn't this be done without exposing broker internals at the slightly higher level of AbstractRequest and AbstractResponse? Those classes are public. If the observer interface used Java default methods then adding a new request type would not break existing implementations. I'm thinking

Re: [DISCUSS] KIP-542: Partition Reassignment Throttling

Thanks for the question. I think it depends on how the user will try to fix it. - If they just replace the disk then I think it shouldn't count as a reassignment and should be allocated under the normal replication quotas. In this case there is no reassignment going on as far as I can tell, the

Build failed in Jenkins: kafka-trunk-jdk11 #1006

See Changes: [github] KAFKA-9179; Fix flaky test due to race condition when fetching -- [...truncated 4.55 MB...] kafka.api.PlaintextConsumerTest > testCommitMetadata

[jira] [Created] (KAFKA-9278) Avoid using static instance of DisconnectException

Qinghui Xu created KAFKA-9278: - Summary: Avoid using static instance of DisconnectException Key: KAFKA-9278 URL: https://issues.apache.org/jira/browse/KAFKA-9278 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-9279) Silent data loss in Kafka producer

Andrew Klopper created KAFKA-9279: - Summary: Silent data loss in Kafka producer Key: KAFKA-9279 URL: https://issues.apache.org/jira/browse/KAFKA-9279 Project: Kafka Issue Type: Bug

Proposal for EmbeddedKafkaCluster: Support JUnit 5 Extension in addition to JUnit 4 Rule

Hi all, when reading ‘Kafka Streams in Action’ I especially enjoyed the thoughtful treatment of mocking, unit, and integration tests. Integration testing in the book (and in the Kafka codebase) is done using the @ClassRule-annotated EmbeddedKafkaCluster. JUnit 5 Jupiter replaced Rules with a

[jira] [Created] (KAFKA-9280) Duplicate messages are observed in ACK mode ALL

VIkram created KAFKA-9280: - Summary: Duplicate messages are observed in ACK mode ALL Key: KAFKA-9280 URL: https://issues.apache.org/jira/browse/KAFKA-9280 Project: Kafka Issue Type: Bug Affects

Re: Broker Interceptors

AbstractRequest and AbstractResponse are currently internal classes. Ismael On Fri, Dec 6, 2019 at 1:56 AM Tom Bentley wrote: > Hi, > > Couldn't this be done without exposing broker internals at the slightly > higher level of AbstractRequest and AbstractResponse? Those classes are > public. If

Re: [DISCUSS] KIP-542: Partition Reassignment Throttling

My concern is that we're very focused on reassignment where I think users enable throttling to avoid overwhelming brokers with replica catch up traffic (typically disk and/or bandwidth). The current approach achieves that by not throttling ISR replication. The downside is that when a broker falls

Re: Broker Interceptors

Hi Ismael, How come? They're public in the clients jar. I'm not doubting you, all I'm really asking is "how should I have known this?" Tom On Fri, Dec 6, 2019 at 4:12 PM Ismael Juma wrote: > AbstractRequest and AbstractResponse are currently internal classes. > > Ismael > > On Fri, Dec 6,

Re: Broker Interceptors

Public API classes can be found here: https://kafka.apache.org/24/javadoc/overview-summary.html Everything else is internal. Ismael On Fri, Dec 6, 2019 at 8:20 AM Tom Bentley wrote: > Hi Ismael, > > How come? They're public in the clients jar. I'm not doubting you, all I'm > really asking is

Re: Proposal for EmbeddedKafkaCluster: Support JUnit 5 Extension in addition to JUnit 4 Rule

Hi Matthias! Thanks for the note, and the kind sentiment. We're always open to improvements like this, so your contribution would certainly be welcome. Just FYI, "public interface" changes need to go through the KIP process (see

Re: [DISCUSS] KIP-435: Internal Partition Reassignment Batching

Hi Colin, Thanks for the honest answer. As a bottom line I think a better reassignment logic should be included with Kafka somehow instead of relying on external tools. It makes the system more mature on its own and standardizes what others implemented many times. Actually I also agree that

Re: [VOTE] 2.4.0 RC3

Hi Manikumar, We've gotten to the bottom of https://issues.apache.org/jira/browse/KAFKA-9212 and I think it should be a blocker. The impact of this bug is that consumers cannot make progress while a reassignment is in progress. The problem is missing logic in the controller to update its metadata

Build failed in Jenkins: kafka-trunk-jdk11 #1007

See Changes: [manikumar] KAFKA-9267: ZkSecurityMigrator should not create /controller node -- [...truncated 5.57 MB...] org.apache.kafka.streams.test.OutputVerifierTest

Re: Proposal for EmbeddedKafkaCluster: Support JUnit 5 Extension in addition to JUnit 4 Rule

Personally, I would love to see EmbeddedKafkaCluster moved to a public test artifact, similarly to kafka-streams-test-utils. Having to copy/paste internal classes into your project is...unfortunate. On Fri, 2019-12-06 at 10:42 -0600, John Roesler wrote: [EXTERNAL EMAIL] Attention: This email

[jira] [Created] (KAFKA-9281) Consider more flexible node grouping for Pattern subscription

Sophie Blee-Goldman created KAFKA-9281: -- Summary: Consider more flexible node grouping for Pattern subscription Key: KAFKA-9281 URL: https://issues.apache.org/jira/browse/KAFKA-9281 Project:

Jenkins build is back to normal : kafka-2.4-jdk8 #100

See

Re: Proposal for EmbeddedKafkaCluster: Support JUnit 5 Extension in addition to JUnit 4 Rule

Hi Tommy, There are some practically ancient discussions around doing this exact thing, but they haven't generally come to fruition because EmbeddedKafkaCluster itself isn't really a slam dunk, usability-wise. You'll notice that copying it (i.e., using it _at all_ ) is the option of last

[jira] [Created] (KAFKA-9282) Consider more flexible node grouping for Pattern subscription

Sophie Blee-Goldman created KAFKA-9282: -- Summary: Consider more flexible node grouping for Pattern subscription Key: KAFKA-9282 URL: https://issues.apache.org/jira/browse/KAFKA-9282 Project:

Re: Broker Interceptors

to me this is an "API vs SPI" discussion. pluggable broker bits should fall on the "SPI" side, where tighter coupling is the price you pay for power and performance, the target audience is small (and supposedly smarter), and compatibility breaks are more common and accepted. On Fri, Dec 6, 2019

[jira] [Resolved] (KAFKA-7489) ConnectDistributedTest is always running broker with dev version

[ https://issues.apache.org/jira/browse/KAFKA-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-7489. -- Reviewer: John Roesler Resolution: Fixed Merged this to the `2.3`, `2.2`., and `2.1`

Build failed in Jenkins: kafka-2.2-jdk8-old #192

See Changes: [rhauch] KAFKA-7489: Fix ConnectDistributedTest system test to use KafkaVersion -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node

Build failed in Jenkins: kafka-2.2-jdk8-old #193

See Changes: [github] MINOR: Increase the timeout in one of Connect's distributed system tests -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node

Re: [kafka-clients] [VOTE] 2.4.0 RC3

Ran the tests in the following environments using Eric's script available here: https://github.com/elalonde/kafka/blob/master/bin/verify-kafka-rc.sh OS: Ubuntu 18.04.3 LTS Java Version: OpenJDK 11.0.4 Scala Versions: 2.12.10, 12.13.0, 12.13.1 Gradle Version: 5.6.2 I have made one observation in