[jira] [Created] (KAFKA-6062) Reduce topic partition count in kafka version 0.10.0.0

2017-10-13 Thread Balu (JIRA)
Balu created KAFKA-6062: --- Summary: Reduce topic partition count in kafka version 0.10.0.0 Key: KAFKA-6062 URL: https://issues.apache.org/jira/browse/KAFKA-6062 Project: Kafka Issue Type: Task

Jenkins build is back to normal : kafka-trunk-jdk8 #2139

2017-10-13 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

2017-10-13 Thread Ted Yu
+1 On Fri, Oct 13, 2017 at 3:32 PM, Matthias J. Sax wrote: > +1 > > > > On 9/11/17 3:04 PM, Jorge Esteban Quilcate Otoya wrote: > > Hi All, > > > > It seems that there is no further concern with the KIP-171. > > At this point we would like to start the voting process. > >

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

2017-10-13 Thread Matthias J. Sax
+1 On 9/11/17 3:04 PM, Jorge Esteban Quilcate Otoya wrote: > Hi All, > > It seems that there is no further concern with the KIP-171. > At this point we would like to start the voting process. > > The KIP can be found here: >

Jenkins build is back to normal : kafka-trunk-jdk7 #2892

2017-10-13 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-205: Add getAllKeys() API to ReadOnlyWindowStore

2017-10-13 Thread Xavier Léauté
Thanks for the KIP Richard, this is a very useful addition! As far as the API changes, I just have a few comments on the methods that don't seem directly related to the KIP title, and naming of course :). On the implementation, see my notes further down that will hopefully clarify a few things.

Build failed in Jenkins: kafka-trunk-jdk9 #127

2017-10-13 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Include isolationLevel in toString of FetchRequest -- Started by an SCM change [EnvInject] - Loading node environment variables. Building

[jira] [Created] (KAFKA-6061) "ERROR Error while electing or becoming leader on broker 13 (kafka.server.ZookeeperLeaderElector) kafka.common.KafkaException: Can't parse json string: null" should prin

2017-10-13 Thread Koelli Mungee (JIRA)
Koelli Mungee created KAFKA-6061: Summary: "ERROR Error while electing or becoming leader on broker 13 (kafka.server.ZookeeperLeaderElector) kafka.common.KafkaException: Can't parse json string: null" should print out information on which

[GitHub] kafka pull request #4038: [MINOR] Include isolationLevel in toString of Fetc...

2017-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4038 ---

Re: [DISCUSS] KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change

2017-10-13 Thread Colin McCabe
Hi all, Any other thoughts about this KIP? If not, I'll start a vote on the KIP some time next week. cheers, Colin On Fri, Oct 6, 2017, at 13:03, Tom Bentley wrote: > Thanks Colin, it makes sense now, it was the HWM party I was missing. > > Cheers, > > Tom > > On 6 Oct 2017 6:44 pm, "Colin

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-10-13 Thread Jorge Esteban Quilcate Otoya
Thanks Matthias. I have updated the KIP according to this and take KAFKA-6058. We will use `KafkaConsumer` instead of reusing `ConsumerGroupCommand` and keep `StreamsResetter` in `core` until `KAFKA-6058 is fixed. Just as a reminder, [VOTE] thread is already open if there are no more feedback on

[GitHub] kafka pull request #4073: KAFKA-6060: Add workload generation capabilities t...

2017-10-13 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/4073 KAFKA-6060: Add workload generation capabilities to Trogdor Previously, Trogdor only handled "Faults." Now, Trogdor can handle "Tasks" which may be either faults, or workloads to execute in the

[jira] [Created] (KAFKA-6060) Add workload generation capabilities to Trogdor

2017-10-13 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-6060: -- Summary: Add workload generation capabilities to Trogdor Key: KAFKA-6060 URL: https://issues.apache.org/jira/browse/KAFKA-6060 Project: Kafka Issue

Re: Randomly failing tests

2017-10-13 Thread Matthias J. Sax
Hi, this can happen and we try hard to keep the build stable... If you see any failing tests, please double check if there is a corresponding Jira for those flaky tests and comment on the Jira (to raise awareness), reopen (if it's an older and resolved one) or create a new Jira. Thanks!

Randomly failing tests

2017-10-13 Thread Gilles Degols
Hello, I'm a new contributor to Kafka and I made 2 trivial pull requests the previous days. Those two were tested locally and everything was okay. But on Jenkins, even if I retest them with "retest this please", some tests are failing randomly, not the same each time. Generally all tests pass

[VOTE] 1.0.0 RC1

2017-10-13 Thread Guozhang Wang
Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 1.0.0. It's worth noting that starting in this version we are using a different version protocol with three digits: *major.minor.bug-fix* Any and all testing is welcome, but the

[GitHub] kafka pull request #4072: MINOR: Add HttpMetricsReporter for system tests

2017-10-13 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/4072 MINOR: Add HttpMetricsReporter for system tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/kafka http-metrics Alternatively you can

Re: [DISCUSS] KIP-165: Extend Interactive Queries for return latest update timestamp per key

2017-10-13 Thread Matthias J. Sax
I wanted to follow up with this KIP. One important thing that is missing in this KIP, is the question where the TS is coming from? ATM, timestamps are not stored in the state stores -- it's a plain format. Thus, if we want to enable this feature, we need to change the data format of

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-10-13 Thread Matthias J. Sax
Hi, with KIP-182 being implemented in 1.0 that will be released shortly, I wanted to follow up on this KIP. It seems, that we don't need it any longer, as KIP-182 resolves those issues. If you agree, please update the KIP wiki page accordingly and move the KIP to "discarded" table. Thanks a

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

2017-10-13 Thread Ted Yu
I agree with Randall. Actually I had the same thought during first round of review. On Fri, Oct 13, 2017 at 9:25 AM, Randall Hauch wrote: > Also, do we need these properties to be preceded with `rest`? I'd argue > that we're just configuring the worker's SSL information, and

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

2017-10-13 Thread Randall Hauch
Also, do we need these properties to be preceded with `rest`? I'd argue that we're just configuring the worker's SSL information, and that the REST API would just use that. If we added another non-REST API, we'd want to use the same security configuration. It's not that complicated in Jetty to

[jira] [Resolved] (KAFKA-4575) Transient failure in ConnectDistributedTest.test_pause_and_resume_sink in consuming messages after resuming sink connector

2017-10-13 Thread Randall Hauch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-4575. -- Resolution: Fixed This appears to no longer be an issue, so I'm closing this as fixed. >

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

2017-10-13 Thread Randall Hauch
It'd be useful to specify the default values for the configuration properties. On Tue, Oct 10, 2017 at 2:53 AM, Jakub Scholz wrote: > FYI: Based on Ewen's suggestion from the related JIRA, I added a > clarification to the KIP that it doesn't do anything around authorization / >

Re: Kafka Connect Source questions

2017-10-13 Thread Randall Hauch
On Thu, Oct 12, 2017 at 1:59 AM, Stephane Maarek < steph...@simplemachines.com.au> wrote: > Hi, > > > > I had a look at the Connect Source Worker code and have two questions: > When a Source Task commits offsets, does it perform compaction / > optimisation before sending off? E.g. I read from 1

Build failed in Jenkins: kafka-trunk-jdk8 #2138

2017-10-13 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: update comments in config/producer.properties -- [...truncated 369.23 KB...] kafka.security.auth.SimpleAclAuthorizerTest >

Build failed in Jenkins: kafka-trunk-jdk7 #2891

2017-10-13 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: update comments in config/producer.properties -- [...truncated 369.83 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2137

2017-10-13 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Merge script improvements -- [...truncated 1.87 MB...] org.apache.kafka.connect.runtime.distributed.DistributedHerderTest >

Jenkins build is back to normal : kafka-1.0-jdk7 #35

2017-10-13 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #2890

2017-10-13 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Merge script improvements -- [...truncated 371.37 KB...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[16] STARTED

[GitHub] kafka pull request #4070: MINOR: update comments in config/producer.properti...

2017-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4070 ---

[GitHub] kafka pull request #4067: MINOR: Merge script improvements

2017-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4067 ---

Build failed in Jenkins: kafka-trunk-jdk8 #2136

2017-10-13 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: add unit test for StateStoreSerdes -- [...truncated 3.68 MB...] org.apache.kafka.streams.integration.RegexSourceIntegrationTest >

Jenkins build is back to normal : kafka-trunk-jdk7 #2889

2017-10-13 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-1.0-jdk7 #34

2017-10-13 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: add unit test for StateStoreSerdes -- [...truncated 370.07 KB...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[16] STARTED