Build failed in Jenkins: kafka-trunk-jdk11 #727

See Changes: [jason] KAFKA-7548; KafkaConsumer should not discard fetched data for paused -- [...truncated 2.57 MB...] org.apache.kafka.streams.integration.SuppressionInte

Build failed in Jenkins: kafka-trunk-jdk8 #3824

See Changes: [cmccabe] KAFKA-8601: Implement KIP-480: Sticky Partitioning for keyless records [jason] KAFKA-7548; KafkaConsumer should not discard fetched data for paused ---

Build failed in Jenkins: kafka-trunk-jdk11 #726

See Changes: [cmccabe] KAFKA-8601: Implement KIP-480: Sticky Partitioning for keyless records -- [...truncated 2.57 MB...] org.apache.kafka.connect.json.JsonConverterTest

Build failed in Jenkins: kafka-trunk-jdk8 #3823

See Changes: [github] KAFKA-8456: Stabilize flaky StoreUpgradeIntegrationTest (#6941) [matthias] MINOR: Fix wrong debug log message (#7137) -- [...truncated 6.47 MB...] o

[jira] [Resolved] (KAFKA-7548) KafkaConsumer should not throw away already fetched data for paused partitions.

[ https://issues.apache.org/jira/browse/KAFKA-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7548. Resolution: Fixed Fix Version/s: 2.4.0 > KafkaConsumer should not throw away already

[jira] [Created] (KAFKA-8745) DumpLogSegments doesn't show keys, when the message is null

James Cheng created KAFKA-8745: -- Summary: DumpLogSegments doesn't show keys, when the message is null Key: KAFKA-8745 URL: https://issues.apache.org/jira/browse/KAFKA-8745 Project: Kafka Issue

[jira] [Created] (KAFKA-8744) Add Support to Scala API for KIP-307

Bill Bejeck created KAFKA-8744: -- Summary: Add Support to Scala API for KIP-307 Key: KAFKA-8744 URL: https://issues.apache.org/jira/browse/KAFKA-8744 Project: Kafka Issue Type: Task Com

Build failed in Jenkins: kafka-trunk-jdk11 #725

See Changes: [github] KAFKA-8456: Stabilize flaky StoreUpgradeIntegrationTest (#6941) [matthias] MINOR: Fix wrong debug log message (#7137) -- [...truncated 2.58 MB...] o

Re: [DISCUSS] KIP-499 - Unify connection name flag for command line tool

+1 for the KIP On Tue, Jul 30, 2019 at 5:25 PM Mitchell wrote: > > Hello, > I have written a proposal to add the command line argument > `--bootstrap-server` to 5 of the existing command line tools that do not > currently use `--broker-list` for passing cluster connection information. > > https:/

Re: [DISCUSS] KIP-499 - Unify connection name flag for command line tool

+1 for the KIP. -Harsha On Thu, Aug 1, 2019, at 3:07 PM, Colin McCabe wrote: > On Wed, Jul 31, 2019, at 05:26, Mitchell wrote: > > Hi Jason, > > Thanks for looking at this! > > > > I wasn't exactly sure what to put in the compatibility section. I wrote > > the KIP thinking that we should probab

Re: [DISCUSS] KIP-499 - Unify connection name flag for command line tool

On Wed, Jul 31, 2019, at 05:26, Mitchell wrote: > Hi Jason, > Thanks for looking at this! > > I wasn't exactly sure what to put in the compatibility section. I wrote > the KIP thinking that we should probably mark the old arguments for > deprecation for a release or two before actually removing t

Re: [VOTE] KIP-455: Create an Administrative API for Replica Reassignment

On Thu, Aug 1, 2019, at 12:00, Jun Rao wrote: > Hi, Colin, > > 10. Sounds good. > > 13. Our current convention is to bump up the version of ZK value if there > is any format change. For example, we have bumped up the version of the > value in /brokers/ids/nnn multiple times and all of those chang

Re: [VOTE] KIP-492 Add java security providers in Kafka Security config

Thanks, everyone, for the good discussions and votes. The vote has been open for 72hrs, and has three binding votes (Harsha, Rajini and Mani Kumar), and one non-biding vote(Satish Duggana), and no negative votes. so the KIP vote passes! I'll close my vote and create an actual change for review.

Re: [DISCUSS] KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum

Hi Harsha, Thanks for the heads up. This should be fixed-- give it another try. best, Colin On Thu, Aug 1, 2019, at 14:15, Harsha wrote: > Hi Colin, > Looks like KIP is missing the images , links are broken. > Thanks, > Harsha > > On Thu, Aug 1, 2019, at 2:05 PM, Colin McCabe wro

Re: [DISCUSS] KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum

Hi Colin, Looks like KIP is missing the images , links are broken. Thanks, Harsha On Thu, Aug 1, 2019, at 2:05 PM, Colin McCabe wrote: > Hi all, > > I've written a KIP about removing ZooKeeper from Kafka. Please take a > look and let me know what you think: > > https://cwiki.apach

[DISCUSS] KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum

Hi all, I've written a KIP about removing ZooKeeper from Kafka. Please take a look and let me know what you think: https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum cheers, Colin

Re: [DISCUSS] KIP-495: Dynamically Adjust Log Levels in Connect

Thanks Arjun! Looks good to me. On Thu, Aug 1, 2019 at 12:33 PM Arjun Satish wrote: > Thanks for the feedback, Chris! > > Yes, the example is pretty much how Connect will use the new feature. > Tweaked the section to make this more clear. > > Best, > > On Fri, Jul 26, 2019 at 11:52 AM Chris Eger

Re: [DISCUSS] KIP-495: Dynamically Adjust Log Levels in Connect

Thanks for the feedback, Chris! Yes, the example is pretty much how Connect will use the new feature. Tweaked the section to make this more clear. Best, On Fri, Jul 26, 2019 at 11:52 AM Chris Egerton wrote: > Hi Arjun, > > This looks great. The changes to public interface are pretty small and

Re: [VOTE] KIP-455: Create an Administrative API for Replica Reassignment

Hi, Colin, 10. Sounds good. 13. Our current convention is to bump up the version of ZK value if there is any format change. For example, we have bumped up the version of the value in /brokers/ids/nnn multiple times and all of those changes are compatible (just adding new fields). This has the sli

[jira] [Created] (KAFKA-8743) Flaky Test RepartitionWithMergeOptimizingIntegrationTest#shouldSendCorrectRecords_OPTIMIZED

Matthias J. Sax created KAFKA-8743: -- Summary: Flaky Test RepartitionWithMergeOptimizingIntegrationTest#shouldSendCorrectRecords_OPTIMIZED Key: KAFKA-8743 URL: https://issues.apache.org/jira/browse/KAFKA-8743

[jira] [Created] (KAFKA-8742) Flaky Test RepartitionWithMergeOptimizingIntegrationTest#shouldSendCorrectResults_NO_OPTIMIZATION

Matthias J. Sax created KAFKA-8742: -- Summary: Flaky Test RepartitionWithMergeOptimizingIntegrationTest#shouldSendCorrectResults_NO_OPTIMIZATION Key: KAFKA-8742 URL: https://issues.apache.org/jira/browse/KAFKA-874

[jira] [Reopened] (KAFKA-6461) TableTableJoinIntegrationTest is unstable if caching is enabled

[ https://issues.apache.org/jira/browse/KAFKA-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-6461: Assignee: (was: Ted Yu) Failed again in `trunk`:  [https://builds.apache.org/job/kafk

Re: Kafka connect task assignment Improvement ( New Feature )

Manjeet, this sounds like a problem that exists outside Connect's purview. Connect has nothing to do with resource management. Ryanne On Mon, Jul 29, 2019, 2:05 PM Manjeet Duhan wrote: > Hi , > > This is Manjeet here working in operative media . I have been working on > confluent kafka for almo

Re: Kafka connect task assignment Improvement ( New Feature )

Dude don't put a lot of details about operative media and names. From: Manjeet Duhan Sent: Monday, July 29, 2019 11:28 PM To: dev@kafka.apache.org Cc: Praveen Manvi Subject: Kafka connect task assignment Improvement ( New Feature ) Hi , This is Manjeet here

[jira] [Created] (KAFKA-8741) We should add mx4j-tools.jar into dependencies

maohong created KAFKA-8741: -- Summary: We should add mx4j-tools.jar into dependencies Key: KAFKA-8741 URL: https://issues.apache.org/jira/browse/KAFKA-8741 Project: Kafka Issue Type: Wish C

Re: [DISCUSS] KIP-470: TopologyTestDriver test input and output usability improvements

Hi Jukka, I also think 3, 4, and 5 are all good options. My personal preference is 4, but I also wouldn't mind going with 5 if that is what others want to do. Thanks, Bill On Tue, Jul 30, 2019 at 9:31 AM John Roesler wrote: > Hey Jukka, > > Sorry for the delay. > > For what it's worth, I thin

Re: Configuration for custom authorizer

Answering my own question in case it helps someone else... The properties provided to the authorizer's configure() function when Kafka is started are taken from the server.properties file so there is no need to provide them by any other means. Thanks, Jeff On Tue, Jul 30, 2019 at 12:17 PM Jeff Z

Re: Dynamic configuration of interbroker SSL certificates

Hi Michael, Thank you for reporting this. It is possible that we missed out some client-side update in KAFKA-8336. Would it be possible for you to provide logs from multiple brokers around the time of a broker restart when handshake failures started occurring so that we can try to work out which c

Re: [DISCUSS] KIP-498: Add client-side configuration for maximum response size to protect against OOM

Thanks Gokul and Stanislav for your answers. I went through the PR 5940 [1]. Indeed Gokul, your reasoning echoes the observations of Ismael about a potential inter-protocol layering violation. As you said Stanislav, the server-side SSL engine responds with an alert with code 80 (internal_error) f

Re: [DISCUSS] KIP-498: Add client-side configuration for maximum response size to protect against OOM

Hey Alexandre, thanks for the KIP! I had personally hit the same problem and found it very annoying. Have you considered detecting such a scenario in the client and simply throwing an exception, rather than allocating any memory? I have an open PR that does just that - https://github.com/apache/ka

[jira] [Created] (KAFKA-8740) Threads causing circular deadlock

Sukumar Enuguri created KAFKA-8740: -- Summary: Threads causing circular deadlock Key: KAFKA-8740 URL: https://issues.apache.org/jira/browse/KAFKA-8740 Project: Kafka Issue Type: Bug