[GitHub] kafka pull request #3845: KAFKA-4501: Fix EasyMock and disable PowerMock tes...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3845 ---

Re: [VOTE] KIP-195: AdminClient.createPartitions()

This KIP currently has 2 binding +1 votes. Today is the deadline for KIPs to be added to Kafka 1.0.0. So if anyone else would like to see this feature in 1.0.0 they will need to vote by the end of the day. If there are insufficient votes for the KIP to be adopted today then I will keep the vote

Re: [VOTE] KIP-189 - Improve principal builder interface and add support for SASL

Hi All, I wanted to mention one minor change that came out of the code review. We've added an additional method to AuthenticationContext to expose the address of the authenticated client. This can be useful, for example, to enforce host-based quotas. I've updated the KIP. Thanks, Jason On Fri,

[GitHub] kafka pull request #3848: KAFKA-5692: Change PreferredReplicaLeaderElectionC...

GitHub user tombentley opened a pull request: https://github.com/apache/kafka/pull/3848 KAFKA-5692: Change PreferredReplicaLeaderElectionCommand to use Admin… …Client See also KIP-183. The contribution is my original work and I license the work to the project

[GitHub] kafka pull request #3843: MINOR: Fix JavaDoc for StreamsConfig.PROCESSING_GU...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3843 ---

[GitHub] kafka pull request #3842: KAFKA-5301 Improve exception handling on consumer ...

Github user ConcurrencyPractitioner closed the pull request at: https://github.com/apache/kafka/pull/3842 ---

Kafka Streaming with filters

Dear Team We are doing a poc on filtering option in kafka streaming with spring cloud binder. Specifically with @StreamListener and condition. Is there any java sample applications with the filtering concepts? If there please let me know. The usecase is: Messages are published

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

Hi Damian, Thanks for your feedback. Actually, this (what you propose) was the first idea of KIP-149. Then we decided to divide it into two KIPs. I also expressed my opinion that keeping the two interfaces (Rich and withKey) separate would add more overloads. So, email discussion resulted that

[jira] [Created] (KAFKA-5887) Enable findBugs (or equivalent) when building with Java 9

Ismael Juma created KAFKA-5887: -- Summary: Enable findBugs (or equivalent) when building with Java 9 Key: KAFKA-5887 URL: https://issues.apache.org/jira/browse/KAFKA-5887 Project: Kafka Issue

Re: [DISCUSS] KIP-190: Handle client-ids consistently between clients and brokers

Yes exactly ! I've updated the KIP to make it more explicit. Also I noticed my initial email didn't contain the link to the KIP, so here it is: https://cwiki.apache.org/confluence/display/KAFKA/KIP-190%3A+Handle+client-ids+consistently+between+clients+and+brokers On Tue, Sep 12, 2017 at 7:23 PM,

Build failed in Jenkins: kafka-trunk-jdk7 #2755

See Changes: [damian.guy] MINOR: Fix JavaDoc for StreamsConfig.PROCESSING_GUARANTEE_CONFIG -- [...truncated 926.13 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2016

See Changes: [ismael] KAFKA-4501; Fix EasyMock and disable PowerMock tests under Java 9 -- [...truncated 4.77 MB...] org.apache.kafka.streams.kstream.TimeWindowsTest >

[GitHub] kafka pull request #3849: Implement KIP-91 delivery.timeout.ms

GitHub user sutambe opened a pull request: https://github.com/apache/kafka/pull/3849 Implement KIP-91 delivery.timeout.ms First shot at implementing kip-91 delivery.timeout.ms. Summary 1. Added delivery.timeout.ms config. Default 120,000 2. Changed retries to MAX_INT.

Build failed in Jenkins: kafka-trunk-jdk8 #2015

See Changes: [damian.guy] MINOR: Fix JavaDoc for StreamsConfig.PROCESSING_GUARANTEE_CONFIG -- [...truncated 3.87 MB...] org.apache.kafka.common.config.ConfigDefTest >

Build failed in Jenkins: kafka-trunk-jdk7 #2756

See Changes: [ismael] KAFKA-4501; Fix EasyMock and disable PowerMock tests under Java 9 -- [...truncated 2.51 MB...]

Build failed in Jenkins: kafka-trunk-jdk9 #5

See -- Started by user ijuma [EnvInject] - Loading node environment variables. Building remotely on H21 (couchdbtest ubuntu xenial) in workspace

[GitHub] kafka pull request #3850: MINOR: Un-hide the tutorial buttons on web docs

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/3850 MINOR: Un-hide the tutorial buttons on web docs You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka KMinor-unhide-button

Re: Build failed in Jenkins: kafka-trunk-jdk8 #2016

I have filed INFRA-15080 for the 'No space left on device' error. On Wed, Sep 13, 2017 at 12:07 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See display/redirect?page=changes> > > Changes: > > [ismael] KAFKA-4501; Fix

[jira] [Created] (KAFKA-5886) Implement KIP-91

Sumant Tambe created KAFKA-5886: --- Summary: Implement KIP-91 Key: KAFKA-5886 URL: https://issues.apache.org/jira/browse/KAFKA-5886 Project: Kafka Issue Type: Improvement Components:

[GitHub] kafka pull request #3851: MINOR: Fix typo

GitHub user jeffwidman opened a pull request: https://github.com/apache/kafka/pull/3851 MINOR: Fix typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/jeffwidman/kafka patch-1 Alternatively you can review and apply these

Jenkins build is back to normal : kafka-trunk-jdk9 #6

See

[GitHub] kafka pull request #3847: MINOR: update tutorial doc to match ak-site

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3847 ---

[GitHub] kafka pull request #3851: MINOR: Fix typo

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3851 ---

Build failed in Jenkins: kafka-trunk-jdk9 #8

See Changes: [wangguoz] MINOR: Un-hide the tutorial buttons on web docs [jason] MINOR: Fix typo in test log4j.properties [wangguoz] MINOR: update tutorial doc to match ak-site

[jira] [Created] (KAFKA-5888) Transactions system test should check for message order

Apurva Mehta created KAFKA-5888: --- Summary: Transactions system test should check for message order Key: KAFKA-5888 URL: https://issues.apache.org/jira/browse/KAFKA-5888 Project: Kafka Issue

[GitHub] kafka pull request #3850: MINOR: Un-hide the tutorial buttons on web docs

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3850 ---

[GitHub] kafka pull request #3852: MINOR: Update TransactionManager to use LogContext

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3852 MINOR: Update TransactionManager to use LogContext You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

Using a downstream project, I verified that artifacts for 0.11.0.1 can be pulled down. Thanks On Wed, Sep 13, 2017 at 2:00 PM, Damian Guy wrote: > AFAICT they are there > http://repo.maven.apache.org/maven2/org/apache/kafka/kafka- > clients/0.11.0.1/ > On Wed, 13 Sep 2017

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

AFAICT they are there http://repo.maven.apache.org/maven2/org/apache/kafka/kafka-clients/0.11.0.1/ On Wed, 13 Sep 2017 at 21:46, Ted Yu wrote: > Damian: > Looks like maven artifacts are not populated yet: > > https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients

Is ConsumerConfig class supposed to contain all config options?

Hi, When going through the Kafka client examples I noticed in the Consumer example ( https://github.com/apache/kafka/blob/trunk/examples/src/main/java/kafka/examples/Consumer.java) that it is using class ConsumerConfig instead of specifying the configuration keys manually (e.g.

Build failed in Jenkins: kafka-trunk-jdk8 #2017

See Changes: [wangguoz] MINOR: Un-hide the tutorial buttons on web docs -- [...truncated 2.53 MB...] org.apache.kafka.streams.integration.RegexSourceIntegrationTest >

Build failed in Jenkins: kafka-trunk-jdk7 #2758

See Changes: [jason] MINOR: Fix typo in test log4j.properties [wangguoz] MINOR: update tutorial doc to match ak-site -- [...truncated 924.06 KB...]

Build failed in Jenkins: kafka-0.11.0-jdk7 #306

See Changes: [wangguoz] MINOR: Un-hide the tutorial buttons on web docs -- [...truncated 2.44 MB...]

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

Thanks for driving this Damian! Guozhang On Wed, Sep 13, 2017 at 4:36 AM, Damian Guy wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 0.11.0.1. This is a bug fix release that fixes 51 issues in 0.11.0.0. > > All of the changes in

[GitHub] kafka pull request #3855: MINOR: Logging changes

GitHub user chetnachaudhari opened a pull request: https://github.com/apache/kafka/pull/3855 MINOR: Logging changes Capitalised few log lines to match with rest of the code base. Please review the change @junrao You can merge this pull request into a Git repository by

Re: [DISCUSS] KIP-196: Add metrics to Kafka Connect framework

Sorry, one more thing occurred to me. Can the names of the time-based metrics include their units? That makes it much easier for people consuming the metrics to interpret them correctly. For example, offset-commit-max-time would become offset-commit-max-time-ms or

Re: [VOTE] KIP-195: AdminClient.createPartitions()

+1. Thanks for the KIP. Just one minor clarification: when no assignment is specified by the user, what will be sent in the protocol? A null assignment array? Probably worth mentioning this case explicitly in the KIP. Thanks, Jason On Wed, Sep 13, 2017 at 7:53 AM, Tom Bentley

[GitHub] kafka pull request #3853: MINOR: Capitalise topicPurgatory name

GitHub user chetnachaudhari opened a pull request: https://github.com/apache/kafka/pull/3853 MINOR: Capitalise topicPurgatory name This is a minor change, to capitalise topicPurgatory name to have consistent logging. Please find attached snapshot

[GitHub] kafka pull request #3854: MINOR: Fix LogContext message format in KafkaProdu...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/3854 MINOR: Fix LogContext message format in KafkaProducer You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka

Re: [DISCUSS] KIP-190: Handle client-ids consistently between clients and brokers

OK. LGTM then :) On Wed, Sep 13, 2017 at 12:38 PM Mickael Maison wrote: > Yes exactly ! > I've updated the KIP to make it more explicit. > > Also I noticed my initial email didn't contain the link to the KIP, so > here it is: > >

[GitHub] kafka pull request #3842: KAFKA-5301 Improve exception handling on consumer ...

GitHub user ConcurrencyPractitioner reopened a pull request: https://github.com/apache/kafka/pull/3842 KAFKA-5301 Improve exception handling on consumer path This is an improvised approach towards fixing @guozhangwang 's second issue. I have changed the method return type as

Re: [VOTE] KIP-189 - Improve principal builder interface and add support for SASL

Sure . Thanks, Mayuresh On Wed, Sep 13, 2017 at 3:12 PM, Jun Rao wrote: > Hi, Mayuresh, > > Does this KIP obviate the need for KIP-111? If so, could you close that > one? > > Thanks, > > Jun > > On Wed, Sep 13, 2017 at 8:43 AM, Jason Gustafson > wrote:

Re: [VOTE] KIP-195: AdminClient.createPartitions()

The vote has passed. with three binding +1s (Jun, Ismael and Jason), no -1s or +0s. Thanks to those who commented and voted. On 13 September 2017 at 23:22, Jason Gustafson wrote: > +1. Thanks for the KIP. Just one minor clarification: when no assignment is > specified by

Re: [VOTE] KIP-196: Add metrics to Kafka Connect framework

The KIP has passed with three binding +1 votes (Gwen, Sriram, Jason) and no -1 or +0 votes. Thanks to everyone for the feedback. On Tue, Sep 12, 2017 at 2:48 PM, Jason Gustafson wrote: > +1. Thanks for the KIP. > > On Tue, Sep 12, 2017 at 12:42 PM, Sriram Subramanian

[jira] [Created] (KAFKA-5889) MetricsTest is flaky

Ted Yu created KAFKA-5889: - Summary: MetricsTest is flaky Key: KAFKA-5889 URL: https://issues.apache.org/jira/browse/KAFKA-5889 Project: Kafka Issue Type: Test Reporter: Ted Yu The

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

Thanks for driving the release Damian. > On Sep 13, 2017, at 1:18 PM, Guozhang Wang wrote: > > Thanks for driving this Damian! > > > Guozhang > >> On Wed, Sep 13, 2017 at 4:36 AM, Damian Guy wrote: >> >> The Apache Kafka community is pleased to

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

Damian: Looks like maven artifacts are not populated yet: https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients Do you know when artifacts would be visible for downstream projects ? Thanks On Wed, Sep 13, 2017 at 4:36 AM, Damian Guy wrote: > The Apache Kafka

Build failed in Jenkins: kafka-trunk-jdk7 #2757

See Changes: [wangguoz] MINOR: Un-hide the tutorial buttons on web docs -- [...truncated 929.49 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

Re: [VOTE] KIP-192 : Provide cleaner semantics when idempotence is enabled

The KIP has passed with three binding +1 votes (Guozhang, Ismael, Jason) and no -1 or +0 votes. Thanks to everyone for the feedback. Apurva On Mon, Sep 11, 2017 at 8:31 PM, Apurva Mehta wrote: > Hi Becket, > > You are right: the calculations are per partition produced to

Re: [VOTE] KIP-189 - Improve principal builder interface and add support for SASL

Hi, Mayuresh, Does this KIP obviate the need for KIP-111? If so, could you close that one? Thanks, Jun On Wed, Sep 13, 2017 at 8:43 AM, Jason Gustafson wrote: > Hi All, > > I wanted to mention one minor change that came out of the code review. > We've added an additional

Build failed in Jenkins: kafka-trunk-jdk8 #2018

See Changes: [jason] MINOR: Fix typo in test log4j.properties [wangguoz] MINOR: update tutorial doc to match ak-site -- [...truncated 2.03 MB...]

Jenkins build is back to normal : kafka-0.11.0-jdk7 #307

See

[jira] [Created] (KAFKA-5881) Consuming from added partitions without restarting the consumer

Viliam Durina created KAFKA-5881: Summary: Consuming from added partitions without restarting the consumer Key: KAFKA-5881 URL: https://issues.apache.org/jira/browse/KAFKA-5881 Project: Kafka

[jira] [Created] (KAFKA-5882) NullPointerException in ConsumerCoordinator

Seweryn Habdank-Wojewodzki created KAFKA-5882: - Summary: NullPointerException in ConsumerCoordinator Key: KAFKA-5882 URL: https://issues.apache.org/jira/browse/KAFKA-5882 Project: Kafka

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

Hi Guozhang, I had an offline discussion with Matthias and Bill about it. It is thought that `to` offers some benefit, i.e., syntactic sugar, so perhaps no harm in keeping it. However, `through` less so, seeing as we can materialize stores via `filter`, `map` etc, so one of the main benefits of

[jira] [Resolved] (KAFKA-1354) Failed to load class "org.slf4j.impl.StaticLoggerBinder"

[ https://issues.apache.org/jira/browse/KAFKA-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1354. -- Resolution: Fixed This was fixed in 0.8.2 by adding slf4j-log4j12 binding to Kafka libs. > Failed to

[GitHub] kafka pull request #3846: MINOR: update release script for streams quickstar...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3846 MINOR: update release script for streams quickstart You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka minor-release-script Alternatively

[jira] [Resolved] (KAFKA-3124) Update protocol wiki page to reflect latest request/response formats

[ https://issues.apache.org/jira/browse/KAFKA-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3124. -- Resolution: Fixed KAFKA-3361 added support for generating protocol documentation page to Kafka docs.

[GitHub] kafka pull request #3847: MINOR: update tutorial doc to match ak-site

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3847 MINOR: update tutorial doc to match ak-site You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka minor-doc-update Alternatively you can

Build failed in Jenkins: kafka-trunk-jdk7 #2754

See Changes: [ismael] MINOR: Use sha512 instead of sha2 suffix in release artifacts -- [...truncated 2.51 MB...]

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

Hi Jeyhun, Thanks for sending out the update. I guess i was thinking more along the lines of option 2 where we collapse the Rich and ValueWithKey etc interfaces into 1 interface that has all of the arguments. I think we then only need to add one additional overload for each operator?

[GitHub] kafka pull request #3843: MINOR: Fix JavaDoc for StreamsConfig.PROCESSING_GU...

GitHub user leigh-perry opened a pull request: https://github.com/apache/kafka/pull/3843 MINOR: Fix JavaDoc for StreamsConfig.PROCESSING_GUARANTEE_CONFIG The contribution is my original work and I license the work to the project under the project's open source licence. You can

[jira] [Created] (KAFKA-5883) Run tests on Java 9 with –illegal-access=deny

Ismael Juma created KAFKA-5883: -- Summary: Run tests on Java 9 with –illegal-access=deny Key: KAFKA-5883 URL: https://issues.apache.org/jira/browse/KAFKA-5883 Project: Kafka Issue Type: Task

[jira] [Resolved] (KAFKA-5076) Remove usage of java.xml.bind.* classes hidden by default in JDK9

[ https://issues.apache.org/jira/browse/KAFKA-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5076. Resolution: Fixed Done as part of https://github.com/apache/kafka/pull/3647. > Remove usage of

[jira] [Created] (KAFKA-5884) Enable PowerMock tests when running on Java 9

Ismael Juma created KAFKA-5884: -- Summary: Enable PowerMock tests when running on Java 9 Key: KAFKA-5884 URL: https://issues.apache.org/jira/browse/KAFKA-5884 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-5885) NPE in ZKClient

Dustin Cote created KAFKA-5885: -- Summary: NPE in ZKClient Key: KAFKA-5885 URL: https://issues.apache.org/jira/browse/KAFKA-5885 Project: Kafka Issue Type: Bug Components: zkclient

Jenkins build is back to normal : kafka-trunk-jdk8 #2014

See

Re: [VOTE] 0.11.0.1 RC0

Just a quick follow-up: we have renamed the files ending in .sha2 to end in .sha512 instead as per Apache guidelines. This was requested by Henk P. Penning. Ismael On Tue, Sep 12, 2017 at 1:54 PM, Damian Guy wrote: > Thanks all the vote has now closed and the release has

[GitHub] kafka pull request #3844: MINOR: Use sha512 instead of sha2 suffix in releas...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3844 MINOR: Use sha512 instead of sha2 suffix in release artifacts As per Apache guidelines: http://www.apache.org/dev/release-distribution#sigs-and-sums You can merge this pull request into a

Admin Client : no way to create topic with default partitions and replication factor

Hi devs, taking a look at the Admin Client API and the related implementation it seems that : * the CreateTopics request allows you to have "num_partitions" and "replication_factor" with -1 as value (it means unset) which is used when you specify the "replica_assignment" instead *

[GitHub] kafka pull request #3845: KAFKA-4501: Fix EasyMock and disable PowerMock tes...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3845 KAFKA-4501: Fix EasyMock and disable PowerMock tests under Java 9 - EasyMock 3.5 supports Java 9. - Removed unnecessary PowerMock dependency from 3 tests. - Disable remaining PowerMock tests

[ANNOUCE] Apache Kafka 0.11.0.1 Released

The Apache Kafka community is pleased to announce the release for Apache Kafka 0.11.0.1. This is a bug fix release that fixes 51 issues in 0.11.0.0. All of the changes in this release can be found in the release notes: *https://archive.apache.org/dist/kafka/0.11.0.1/RELEASE_NOTES.html

[GitHub] kafka pull request #3844: MINOR: Use sha512 instead of sha2 suffix in releas...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3844 ---

[jira] [Resolved] (KAFKA-5177) Automatic creation of topic prompts warnings into console

[ https://issues.apache.org/jira/browse/KAFKA-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5177. -- Resolution: Won't Fix As mentioned above, these are transient warning messages. Please reopen if you

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

Dear all, I would like to resume the discussion on KIP-159. I (and Guozhang) think that releasing KIP-149 and KIP-159 in the same release would make sense to avoid a release with "partial" public APIs. There is a KIP [1] proposed by Guozhang (and approved by me) to unify both KIPs. Please feel

Re: [VOTE] KIP-195: AdminClient.createPartitions()

Tom, Thanks for the KIP, +1 (binding) from me. Ismael On Fri, Sep 8, 2017 at 5:42 PM, Tom Bentley wrote: > I would like to start the vote on KIP-195 which adds an AdminClient API for > increasing the number of partitions of a topic. The details are here: > >

[jira] [Resolved] (KAFKA-5296) Unable to write to some partitions of newly created topic in 10.2

[ https://issues.apache.org/jira/browse/KAFKA-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5296. -- Resolution: Fixed Closing as per above discussion. Multiple controllers can create these kind of