Build failed in Jenkins: kafka-trunk-jdk8 #3871

See Changes: [wangguoz] KAFKA-8412: Fix nullpointer exception thrown on flushing before closing [harsha] KAFKA-8669: Add security providers in kafka security config (#7090)

Build failed in Jenkins: kafka-trunk-jdk11 #776

See Changes: [wangguoz] KAFKA-8816: Make offsets immutable to users of RecordCollector.offsets -- [...truncated 2.61 MB...]

Re: [DISCUSS] KIP-360: Improve handling of unknown producer

Hi Jason, I've made another pass on the wiki page and it reads much better now. One more clarification about the "Simplified error handling" section: 1. There will be no "retriable error" from the broker side regarding any send requests and txn requests (to txn coordinators). All errors would

Re: [DISCUSS] KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum

Hi Ryanne, Good point. I added a section titled "future work" with information about the follow-on KIPs that we discussed here. best, Colin On Fri, Aug 23, 2019, at 13:15, Ryanne Dolan wrote: > Thanks Colin, sgtm. Please make this clear in the KIP -- otherwise it is > hard to nail down what

[jira] [Resolved] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-8831. --- Resolution: Not A Problem I will think about better logging and put up a patch. Closing this

Re: [ DISCUSS ] KIP-512:Adding headers to RecordMetaData

Hi Eric, We thought about that but we didn't find the strong enough reason for having record itself in Acknowledgement. Headers are supposed to carry metadata and that is the reason headers are added to producer/consumer records. Also we feel having headers information in record metadata is good

[jira] [Reopened] (KAFKA-8800) Flaky Test SaslScramSslEndToEndAuthorizationTest#testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl

[ https://issues.apache.org/jira/browse/KAFKA-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anna Povzner reopened KAFKA-8800: - Assignee: Anastasia Vela (was: Lee Dongjin) > Flaky Test >

Re: [DISCUSS] KIP-495: Dynamically Adjust Log Levels in Connect

Hi Arjun, >From a high level, I feel like we are making light of the JMX api because it's convenient and the broker already has it. Personally I would take the broker out of the picture. The JMX endpoint is not something we were happy with, hence KIP-412. Ultimately I think we will deprecate and

[jira] [Created] (KAFKA-8837) KafkaMetricReporterClusterIdTest may not shutdown ZooKeeperTestHarness

Anna Povzner created KAFKA-8837: --- Summary: KafkaMetricReporterClusterIdTest may not shutdown ZooKeeperTestHarness Key: KAFKA-8837 URL: https://issues.apache.org/jira/browse/KAFKA-8837 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk11 #775

See Changes: [wangguoz] KAFKA-8412: Fix nullpointer exception thrown on flushing before closing [harsha] KAFKA-8669: Add security providers in kafka security config (#7090)

Build failed in Jenkins: kafka-2.3-jdk8 #96

See Changes: [wangguoz] KAFKA-8412: Fix nullpointer exception thrown on flushing before closing -- [...truncated 58.39 KB...]

Re: [ DISCUSS ] KIP-512:Adding headers to RecordMetaData

Have you considered adding a new onAcknowledgement method to the ProducerInterceptor with the signature onAcknowledgement(RecordMetadata metadata, Exception exception, ProducerRecord record)? I would also consider adding this to Producer Callbacks as well, since linking a Callback to a specific

Re: [ DISCUSS ] KIP-512:Adding headers to RecordMetaData

Hi Gwen, 1.We are not doing any changes on the broker side. This change is only on Kafka clients library. 2. RecordMetaData is created by client library while appending record to ProducerBatch where offset alone returned by broker. Here we are adding headers to RecordMetaData while creating

Build failed in Jenkins: kafka-2.1-jdk8 #226

See Changes: [wangguoz] KAFKA-8412: Fix nullpointer exception thrown on flushing before closing -- [...truncated 91.06 KB...] return valueSerde != null ?

[jira] [Created] (KAFKA-8836) Add inter-broker protocol to alter ISR

Jason Gustafson created KAFKA-8836: -- Summary: Add inter-broker protocol to alter ISR Key: KAFKA-8836 URL: https://issues.apache.org/jira/browse/KAFKA-8836 Project: Kafka Issue Type:

Build failed in Jenkins: kafka-2.2-jdk8 #162

See Changes: [wangguoz] KAFKA-8412: Fix nullpointer exception thrown on flushing before closing -- Started by an SCM change [EnvInject] - Loading node environment

[jira] [Created] (KAFKA-8835) Update documentation for URP changes in KIP-352

Jason Gustafson created KAFKA-8835: -- Summary: Update documentation for URP changes in KIP-352 Key: KAFKA-8835 URL: https://issues.apache.org/jira/browse/KAFKA-8835 Project: Kafka Issue

[jira] [Created] (KAFKA-8834) Distinguish URPs caused by reassignment plus other metrics

Jason Gustafson created KAFKA-8834: -- Summary: Distinguish URPs caused by reassignment plus other metrics Key: KAFKA-8834 URL: https://issues.apache.org/jira/browse/KAFKA-8834 Project: Kafka

[jira] [Resolved] (KAFKA-8412) Still a nullpointer exception thrown on shutdown while flushing before closing producers

[ https://issues.apache.org/jira/browse/KAFKA-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8412. -- Resolution: Fixed > Still a nullpointer exception thrown on shutdown while flushing before >

Re: [DISCUSS] KIP-481: SerDe Improvements for Connect Decimal type in JSON

Thanks for the feedback Randall! I have updated the KIP with the following edits: * Updated the reference from "producer" to "source" (I had missed that one!) * Changed the config from "json.decimal.serialization.format" to "decimal.format" * Clarified case sensitivity * Clarified the proposed

Re: [VOTE] KIP-352: Distinguish URPs caused by reassignment

Closing this vote. The final result is +9 with 4 binding votes. @Satish Sorry, I missed your question above. Good point about updating documentation. I will create a separate jira to make sure this gets done. -Jason On Fri, Aug 23, 2019 at 11:23 AM Jason Gustafson wrote: > Thanks Stan, good

[jira] [Created] (KAFKA-8833) Metric for Broker Consumer Lag in size and time

NIKHIL created KAFKA-8833: - Summary: Metric for Broker Consumer Lag in size and time Key: KAFKA-8833 URL: https://issues.apache.org/jira/browse/KAFKA-8833 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-trunk-jdk11 #774

See Changes: [gwen] KAFKA-8391; Temporarily ignore flaky Connect rebalance integration tests [rhauch] MINOR: Fix the doc of scheduled.rebalance.max.delay.ms config property

Re: [DISCUSS] KIP-482: The Kafka Protocol should Support Optional Fields

Great KIP as always, Colin! Some comments: > If the flexible versions are not specified, it is assumed that all versions are flexible. This is ambiguous, if a protocol-generator is pointed to an older Kafka protocol specification it can't know if the lack of flexibleVersions field means

Re: [DISCUSS] KIP-447: Producer scalability for exactly once semantics

Hey Guozhang and Jason, I'm ok with either way. Thinking of Guozhang's approach, it is simpler to implement a consumer-producer if we avoid callback pattern and only do the group metadata initialization once, however the access pattern of consumer rebalance state is scattered, which means we get