Build failed in Jenkins: kafka-trunk-jdk8 #1765

2017-06-27 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: remove unnecessary null check -- [...truncated 960.36 KB...] kafka.server.RequestQuotaTest > testUnauthorizedThrottle STARTED

[jira] [Reopened] (KAFKA-5167) streams task gets stuck after re-balance due to LockException

2017-06-27 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-5167: This seems to got broken via

[GitHub] kafka pull request #3449: KAFKA-5167: Release state locks in case of failure

2017-06-27 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3449 KAFKA-5167: Release state locks in case of failure You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka

[GitHub] kafka pull request #3431: MINOR: Adjust checkstyle suppression paths to work...

2017-06-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3431 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka-site pull request #18: Implementation: Clean-up invalid HTML

2017-06-27 Thread epeay
Github user epeay closed the pull request at: https://github.com/apache/kafka-site/pull/18 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3448: KAFKA-5526: Report group consumers while offsets a...

2017-06-27 Thread vahidhashemian
GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/3448 KAFKA-5526: Report group consumers while offsets are being initialized Instead of reporting no rows in consumer group command's result for new consumers while group offsets are being

Re: [VOTE] 0.11.0.0 RC2

2017-06-27 Thread Ismael Juma
This vote passes with 7 +1 votes (3 binding) and no 0 or -1 votes. +1 votes PMC Members: Jun, Gwen, Guozhang Committers: Jason, Ismael Community: Tom Crayford, Jeff Chao 0 votes: none -1 votes: none Thanks to everyone who tested, voted and/or contributed to the release. I'll continue with the

[GitHub] kafka pull request #3447: MINOR: Do not wait for first line of console consu...

2017-06-27 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/3447 MINOR: Do not wait for first line of console consumer output since we now have a more reliable test using JMX Waiting for the first line of output was added in KAFKA-2527 when JmxMixin was

0.11.0.0 RC2 Vote

2017-06-27 Thread Guozhang Wang
My vote on the original VOTE thread somehow cannot show up, I have tried several ways and nothing works. So I am sending it as a new email which should belong to this thread:

[GitHub] kafka pull request #3445: MINOR: remove unnecessary null check

2017-06-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3445 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-06-27 Thread Matthias J. Sax
I agree, that we should not duplicate functionality. However, I am worried, that a non-streams users using the offset reset tool might delete topics unintentionally (even if the changes are pretty small). Also, currently the stream reset tool required Zookeeper while the offset reset tool does

[GitHub] kafka pull request #3446: MINOR: Improve TransactionIndex.sanityCheck() mess...

2017-06-27 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3446 MINOR: Improve TransactionIndex.sanityCheck() message You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

[GitHub] kafka pull request #3445: MINOR: remove unnecessary null check

2017-06-27 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3445 MINOR: remove unnecessary null check You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka minor-remove-null-check Alternatively you can

Re: Re: [DISCUSS] KIP-165: Extend Interactive Queries for return latest update timestamp per key

2017-06-27 Thread Jeyhun Karimov
Hi Michal, Thanks a lot for your comment. I fixed the document. Cheers, Jeyhun On Sat, Jun 24, 2017 at 6:49 PM Michal Borowiecki < michal.borowie...@openbet.com> wrote: > Hi Jeyhun, > > Could the proposed KeyContext.keyTs() be made more descriptive? > > e.g. lastUpdated() or similar? So that

[jira] [Created] (KAFKA-5528) Error while reading topic, offset, partition info from process method

2017-06-27 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created KAFKA-5528: --- Summary: Error while reading topic, offset, partition info from process method Key: KAFKA-5528 URL: https://issues.apache.org/jira/browse/KAFKA-5528 Project: Kafka

[VOTE]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-06-27 Thread Jeyhun Karimov
Dear all, I would like to start the vote on KIP-149 [1]. Cheers, Jeyhun [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-149%3A+Enabling+key+access+in+ValueTransformer%2C+ValueMapper%2C+and+ValueJoiner -- -Cheers Jeyhun

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-06-27 Thread Jeyhun Karimov
Hi all, I updated the KIP w.r.t. discussion and comments. Basically I eliminated overloads for particular method if they are more than 3. As we can see there are a lot of overloads (and more will come with KIP-149 :) ) So, is it wise to wait the result of constructive DSL thread or extend KIP to

Re: [VOTE] KIP-98: Exactly Once Delivery and Transactional Messaging

2017-06-27 Thread Guozhang Wang
Hello all, I want to highlight some changes in the implementation design of KIP-98 since the proposal is voted in February. As many of you know, exactly-once support is one of the biggest features we have added in the 0.11.0.0 release. So we have been carefully think through all the corner

Jenkins build is back to normal : kafka-trunk-jdk8 #1763

2017-06-27 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-06-27 Thread Jorge Esteban Quilcate Otoya
Thanks for the feedback Matthias! The main idea is to use only 1 tool to reset offsets and don't replicate functionality between tools. Reset Offset (KIP-122) tool not only reset but support execute the reset but also export, import from files, etc. If we extend the current tool

[GitHub] kafka pull request #3426: MINOR: Fix race condition in KafkaConsumer close

2017-06-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3426 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-4815) Idempotent/transactional Producer (KIP-98)

2017-06-27 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4815. Resolution: Fixed > Idempotent/transactional Producer (KIP-98) >

[jira] [Created] (KAFKA-5527) Idempotent/transactional Producer part 2 (KIP-98)

2017-06-27 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5527: -- Summary: Idempotent/transactional Producer part 2 (KIP-98) Key: KAFKA-5527 URL: https://issues.apache.org/jira/browse/KAFKA-5527 Project: Kafka Issue Type: New

[GitHub] kafka pull request #3374: KAFKA-5032: Update the docs for message size confi...

2017-06-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3374 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-5526) ConsumerGroupCommand no longer shows output for consumer groups which have not committed offsets

2017-06-27 Thread Ryan P (JIRA)
Ryan P created KAFKA-5526: - Summary: ConsumerGroupCommand no longer shows output for consumer groups which have not committed offsets Key: KAFKA-5526 URL: https://issues.apache.org/jira/browse/KAFKA-5526

[GitHub] kafka pull request #3444: KAFKA-5006: Better exception messages when produci...

2017-06-27 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/3444 KAFKA-5006: Better exception messages when producing You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka

[GitHub] kafka pull request #3443: KAFKA-5525: Streams reset tool should have same co...

2017-06-27 Thread ppatierno
GitHub user ppatierno opened a pull request: https://github.com/apache/kafka/pull/3443 KAFKA-5525: Streams reset tool should have same console output with or without dry-run Fixed console output to be consistent with/without dry-run option You can merge this pull request into a

Re: [VOTE] 0.11.0.0 RC2

2017-06-27 Thread Ismael Juma
Thanks Jeff, that's helpful. To be clear, this should not affect the Java client (max.request.size = 1 MB) or librdkafka-based clients (message.max.bytes = 1MB) with the default settings. I'm a bit surprised that Sarama doesn't have a similar mechanism. Seems like we'll have to live with that.

[jira] [Reopened] (KAFKA-5006) KeyValueStore.put may throw exception unrelated to the current put attempt

2017-06-27 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reopened KAFKA-5006: - > KeyValueStore.put may throw exception unrelated to the current put attempt >

[jira] [Created] (KAFKA-5525) Streams reset tool should have same console output with or without dry-run

2017-06-27 Thread Paolo Patierno (JIRA)
Paolo Patierno created KAFKA-5525: - Summary: Streams reset tool should have same console output with or without dry-run Key: KAFKA-5525 URL: https://issues.apache.org/jira/browse/KAFKA-5525 Project:

[jira] [Created] (KAFKA-5524) Streams systems tests should be with EoS

2017-06-27 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5524: --- Summary: Streams systems tests should be with EoS Key: KAFKA-5524 URL: https://issues.apache.org/jira/browse/KAFKA-5524 Project: Kafka Issue Type: Improvement

[GitHub] kafka pull request #3442: KAFKA-5512: Awake the heartbeat thread when timeto...

2017-06-27 Thread rosets
GitHub user rosets opened a pull request: https://github.com/apache/kafka/pull/3442 KAFKA-5512: Awake the heartbeat thread when timetoNextHeartbeat is equal to 0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/rosets/kafka

[Review] PR-2882

2017-06-27 Thread marc . schlegel
Hello everyone I've submitted Pull-Request 2882 [1] two months ago which adds OSGi metadate to the kafka-clients project. Can someone review this and provide feedback? The added Gradle plugin just modifies the manifest according to the instruction provided by the new bnd-file. This is just a

Re: Minimum Replication Factor

2017-06-27 Thread Eno Thereska
Good discussion. Stephane, we did briefly think of your options 1 and 2 but didn’t get time to make a KIP and discuss broadly. A dynamic config is appealing, however it has the drawback that you might end up with an unpredictable replication factor. A minimum replication factor also needs some

Re: Minimum Replication Factor

2017-06-27 Thread Edoardo Comar
James, the create.topic.policy exists in 0.10.2 and for example all intermediate topics created by Kafka Stream (which has its own Admin Client) go through it. Topics created via Zookeeper won't be subject to the policy, but that stays the same in 0.11 For our users, we have kept zookeeper

PR build results gives 404 Not Found

2017-06-27 Thread Evgeniy Veretennikov
Hi all, Yesterday I was able to see pull request build results, today I'm not able to see it, web server responses with 404 code. For example, this link https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/5682/ gives 404. Did something wrong happened with Jenkins server? -- Best regards,

[jira] [Created] (KAFKA-5523) ReplayLogProducer not using the new Kafka consumer

2017-06-27 Thread Paolo Patierno (JIRA)
Paolo Patierno created KAFKA-5523: - Summary: ReplayLogProducer not using the new Kafka consumer Key: KAFKA-5523 URL: https://issues.apache.org/jira/browse/KAFKA-5523 Project: Kafka Issue

Re: Minimum Replication Factor

2017-06-27 Thread James Cheng
The create.topic.policy stuff I think is only used as part of the new CreateTopic broker API that's coming in 0.11. That's one of the administrative APIs which let you create topics by talking directly to the broker, without needing to talk to zookeeper directly. So this means your brokers

Re: [DISCUSS] KIP-172 Add regular-expression topic support for sink connector

2017-06-27 Thread 郭健
Great idea! We have similar demands so I have implemented this function in a MySQL source connector, see: https://github.com/Aegeaner/kafka-connector-mysql/blob/master/src/main/java/org/apache/kafka/connect/mysql/EventRecordFactory.java#L347 Thanks, Aegeaner On 6/27/17, 11:45, "Kenji