[jira] [Created] (KAFKA-9042) Auto infer external topic partitions in stream reset tool

Boyang Chen created KAFKA-9042: -- Summary: Auto infer external topic partitions in stream reset tool Key: KAFKA-9042 URL: https://issues.apache.org/jira/browse/KAFKA-9042 Project: Kafka Issue

Build failed in Jenkins: kafka-trunk-jdk8 #3969

See Changes: [wangguoz] MINOR: move "Added/Removed sensor" log messages to TRACE (#7502) [bbejeck] KAFKA-9020: Streams sub-topologies should be sorted by sink -> source [matthias] MINOR: clarify wording around

[jira] [Resolved] (KAFKA-8460) Flaky Test PlaintextConsumerTest#testLowMaxFetchSizeForRequestAndPartition

[ https://issues.apache.org/jira/browse/KAFKA-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8460. Resolution: Duplicate > Flaky Test

[jira] [Created] (KAFKA-9041) Flaky Test LogCleanerIntegrationTest#testIsThreadFailed

Matthias J. Sax created KAFKA-9041: -- Summary: Flaky Test LogCleanerIntegrationTest#testIsThreadFailed Key: KAFKA-9041 URL: https://issues.apache.org/jira/browse/KAFKA-9041 Project: Kafka

[jira] [Resolved] (KAFKA-9006) Flaky Test KTableKTableForeignKeyJoinIntegrationTest.doLeftJoinFilterOutRapidlyChangingForeignKeyValues

[ https://issues.apache.org/jira/browse/KAFKA-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-9006. - Resolution: Duplicate > Flaky Test >

Jenkins build is back to normal : kafka-2.3-jdk8 #124

See

Re: KAFKA-8104: Help with the review

Hello, Guozhang. Got it, thanks for the help with the PR. Will wait for your review. В Пн, 14/10/2019 в 13:40 -0700, Guozhang Wang пишет: > Hello Nikolay, > > I'm still on your PR, but was swamped with some other issues as the release > code freeze date's approaching, will try to make another

Build failed in Jenkins: kafka-trunk-jdk11 #881

See Changes: [wangguoz] MINOR: move "Added/Removed sensor" log messages to TRACE (#7502) [bbejeck] KAFKA-9020: Streams sub-topologies should be sorted by sink -> source [matthias] MINOR: clarify wording around

[jira] [Created] (KAFKA-9040) Implement --all option when describing configs

Jason Gustafson created KAFKA-9040: -- Summary: Implement --all option when describing configs Key: KAFKA-9040 URL: https://issues.apache.org/jira/browse/KAFKA-9040 Project: Kafka Issue Type:

Re: [VOTE] KIP-534: Retain tombstones for approximately delete.retention.ms milliseconds

Hi, Richard, Thanks for the KIP. Looks good to me overall. A few minor comments below. 1. Could you change the title from "Retain tombstones" to "Retain tombstones and transaction markers" to make it more general? 2. Could you document which bit in the batch attribute will be used for the new

Build failed in Jenkins: kafka-2.4-jdk8 #12

See Changes: [bill] KAFKA-9020: Streams sub-topologies should be sorted by sink -> source -- [...truncated 2.67 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

[VOTE] KIP-534: Retain tombstones for approximately delete.retention.ms milliseconds

Hi all, The discussion for KIP-534 seems to have concluded. So I wish to vote this in so that we can get it done. Its a small bug fix. :) Below is the KIP link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-534%3A+Retain+tombstones+for+approximately+delete.retention.ms+milliseconds

Jenkins build is back to normal : kafka-trunk-jdk11 #880

See

Build failed in Jenkins: kafka-trunk-jdk8 #3968

See Changes: [bbejeck] delete (#7504) -- [...truncated 5.42 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldProcessConsumerRecordList[Eos enabled =

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

https://cwiki.apache.org/confluence/display/KAFKA/KIP-150+-+Kafka-Streams+Cogroup here is a link On Mon, Oct 14, 2019 at 2:52 PM Walker Carlson wrote: > Hello all, > > I have picked up and updated KIP-150. Due to changes to the project since > KIP #150 was written there are a few items that

[DISCUSS] KIP-150 - Kafka-Streams Cogroup

Hello all, I have picked up and updated KIP-150. Due to changes to the project since KIP #150 was written there are a few items that need to be updated. First item that changed is the adoption of the Materialized parameter. The second item is the WindowedBy. How the old KIP handles windowing is

Re: KAFKA-8104: Help with the review

Hello Nikolay, I'm still on your PR, but was swamped with some other issues as the release code freeze date's approaching, will try to make another pass on it asap. Guozhang On Mon, Oct 14, 2019 at 12:46 PM Nikolay Izhikov wrote: > Hello. > > I got very helpfull advices from guozhang. > And

[jira] [Resolved] (KAFKA-9020) Streams sub-topologies should be sorted by sink -> source relationship

[ https://issues.apache.org/jira/browse/KAFKA-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9020. Fix Version/s: 2.4.0 Resolution: Fixed > Streams sub-topologies should be

Re: KAFKA-8104: Help with the review

Hello. I got very helpfull advices from guozhang. And now, we have a ready fix and reproducer. This PR fixes a very long living Kafka Consumer bug. Please, join to the review. [1] https://issues.apache.org/jira/browse/KAFKA-8104 [2] https://github.com/apache/kafka/pull/7460 В Пн, 07/10/2019 в

Re: [DISCUSS] KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils

Hi, After some investigations, I updated the KIP and the sample MR again: 1. Move the Mocks under test-utils/state 2. extends a WrappedStateStore<>. The reason is that since we decided to provide the testing capability to wrap around a store the developer provides, WrappedStateStore seems the

Re: [VOTE] 2.3.1 RC1

Hi David, Probably not a blocker, but I noticed the authorization section in the security docs was not updated in 2.3.0 to include authorization details for ElectPreferredLeaders and IncrementalAlterConfigs. I just opened a PR to address that in 2.3: https://github.com/apache/kafka/pull/7508 (and

[jira] [Created] (KAFKA-9039) Optimize replica fetching CPU utilization with large number of partitions

Guozhang Wang created KAFKA-9039: Summary: Optimize replica fetching CPU utilization with large number of partitions Key: KAFKA-9039 URL: https://issues.apache.org/jira/browse/KAFKA-9039 Project:

Re: [DISCUSS] KIP-535: Allow state stores to serve stale reads during rebalance

Hi Navinder, Thanks for sharing the KIP! Few thoughts - Can we link the JIRA, discussion thread also to the KIP - Based on the discussion on KAFKA-6144, I was under the impression that this KIP is also going to cover exposing of the standby information in StreamsMetadata and thus subsume

[jira] [Created] (KAFKA-9038) Allow creating partitions while partition reassignment is in progress

Bob Barrett created KAFKA-9038: -- Summary: Allow creating partitions while partition reassignment is in progress Key: KAFKA-9038 URL: https://issues.apache.org/jira/browse/KAFKA-9038 Project: Kafka

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Thanks Tao Xiao, It worked. On Mon, Oct 14, 2019 at 9:55 PM tao xiao wrote: > one more thing you need to do is to include slf4j-log4j in build.gradle as > it is not included as compiled by default > > On Tue, Oct 15, 2019 at 12:21 AM chandresh pancholi < > chandreshpancholi...@gmail.com> wrote:

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

one more thing you need to do is to include slf4j-log4j in build.gradle as it is not included as compiled by default On Tue, Oct 15, 2019 at 12:21 AM chandresh pancholi < chandreshpancholi...@gmail.com> wrote: > Wondering if below exception is anywhere related > > SLF4J: Failed to load class

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Wondering if below exception is anywhere related SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. SLF4J: Failed to load class

Re: [VOTE] 2.3.1 RC1

David, Why do we have two site-doc packages, one for each Scala version? It is just HTML, right? IIRC, in previous releases we only packaged the docs once? Gwen On Fri, Oct 4, 2019 at 6:52 PM David Arthur wrote: > > Hello all, we identified a few bugs and a dependency update we wanted to > get

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

I have given full path in VM options *-Dlog4j.configuration=file:/Users/Chandresh/opensource/kafka/config/log4j.properties* still no logs in console. [image: Screenshot 2019-10-14 at 8.44.34 PM.png] On Mon, Oct 14, 2019 at 8:16 PM tao xiao wrote: > yes, you need to add log4j to jvm option > >

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

yes, you need to add log4j to jvm option -Dlog4j.configuration=file:/path/to/log4j.properties On Mon, Oct 14, 2019 at 10:33 PM chandresh pancholi < chandreshpancholi...@gmail.com> wrote: > Let me rephrase it. > > I figured out that Kafka is running successfully but i can't see logs in >

Re: [DISCUSS] KIP-515: Reorganize checkpoint system in log cleaner to be per partition

The sentence ` (KAFKA-4545 ) ` could be change to `KAFKA-4545 < https://issues.apache.org/jira/browse/KAFKA-4545 >` ? On Sun, Oct 13, 2019 at 2:08 AM Richard Yu wrote: > Hi Jun, Jason, > > I've updated the

Re: [VOTE] KIP-511: Collect and Expose Client's Name and Version in the Brokers

+1 On Mon, Oct 14, 2019 at 3:47 PM David Jacot wrote: > Hi all, > > Jun, > The new fields are not flexible fields while the request and response are > flexible versions. It does not cost us because the version of the request > is bumped anyway to enable the flexible versions. The rationale

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Let me rephrase it. I figured out that Kafka is running successfully but i can't see logs in IntelliJ console. To see the logs do i have to change any properties. On Mon, Oct 14, 2019 at 5:53 PM chandresh pancholi < chandreshpancholi...@gmail.com> wrote: > Sadly, No luck !! > > [image:

[DISCUSS] KIP-536: Propagate broker timestamp to Admin API

We are in the process of migrating the pieces of automation that currently reads and modifies zookeeper state to use the Admin API. One of the things that we miss doing this is access to the start time of brokers in a cluster which is used by our automation doing rolling restarts. We

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Sadly, No luck !! [image: Screenshot 2019-10-14 at 5.52.55 PM.png] On Mon, Oct 14, 2019 at 5:22 PM Manasvi Gupta wrote: > Can you try copying config/log4j.properties to > core/src/main/resources/log4j.properties and see if it helps? > > On Mon 14 Oct, 2019, 5:01 PM chandresh pancholi, < >

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Can you try copying config/log4j.properties to core/src/main/resources/log4j.properties and see if it helps? On Mon 14 Oct, 2019, 5:01 PM chandresh pancholi, < chandreshpancholi...@gmail.com> wrote: > Manasavi, > > I have followed your blog but I am getting no logs in IDE. I am seeing >

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Manasavi, I have followed your blog but I am getting no logs in IDE. I am seeing Kafka.main running infinitely with logging anything in IDE console. I have attached an image for your reference. On Mon, Oct 14, 2019 at 4:56 PM Manasvi Gupta wrote: > >

Re: [Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

https://medium.com/@manasvi/getting-started-with-contributing-to-apache-kafka-part-1-build-and-run-kafka-from-source-code-f900452fdc06 I wrote this blog post sometime ago for folks to get started with contributing to Apache Kafka. I am behind of part 2 of the post, hopefully will be done in few

[jira] [Created] (KAFKA-9037) Java Out Of Memory(OOM) error encountered while deleting Kafka records using SASL designated port.

Akshath Karanam created KAFKA-9037: -- Summary: Java Out Of Memory(OOM) error encountered while deleting Kafka records using SASL designated port. Key: KAFKA-9037 URL:

[Newbie][IntelliJ Setup] How to run Kafka in IntelliJ

Hello Dev Community, I have been trying to setup Kafka in Intellij. When i try to run Kafka class in core package. it takes infinite time. It keeps loading. I want to pick up some newbie Kafka issues and work on them but this setup is not working for me. If anyone can help me setting up kafka

Re: [VOTE] KIP-511: Collect and Expose Client's Name and Version in the Brokers

Hi all, Jun, The new fields are not flexible fields while the request and response are flexible versions. It does not cost us because the version of the request is bumped anyway to enable the flexible versions. The rationale behind this choice is that it forces the clients to provide the

[jira] [Created] (KAFKA-9036) Allow kafka auth acls with match pattern

Pradeep Bansal created KAFKA-9036: - Summary: Allow kafka auth acls with match pattern Key: KAFKA-9036 URL: https://issues.apache.org/jira/browse/KAFKA-9036 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

Hi Clement 1) existing validation code will remain in SslFactory 2) the createEngine() method in SslEngineBuilder will move to SslFactory and the client/server mode setting will go there (I documented this in the latest KIP update) In the current KIP I am proposing (as per the latest updates) to