[GitHub] kafka pull request #4191: KAFKA-6184: report a metric of the lag between the...

2017-11-08 Thread huxihx
GitHub user huxihx opened a pull request: https://github.com/apache/kafka/pull/4191 KAFKA-6184: report a metric of the lag between the consumer offset ... Add `records-lead` and partition-level `{topic}-{partition}.records-lead-min|avg` for fetcher metrics. @junrao Please

[GitHub] kafka pull request #4192: MINOR: Remove unnecessary batch iteration in FileR...

2017-11-08 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4192 MINOR: Remove unnecessary batch iteration in FileRecords.downConvert You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

[jira] [Created] (KAFKA-6186) RocksDB based WindowStore fail to create db file on Windows OS

2017-11-08 Thread James Wu (JIRA)
James Wu created KAFKA-6186: --- Summary: RocksDB based WindowStore fail to create db file on Windows OS Key: KAFKA-6186 URL: https://issues.apache.org/jira/browse/KAFKA-6186 Project: Kafka Issue

[jira] [Created] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2017-11-08 Thread Valentina Baljak (JIRA)
Valentina Baljak created KAFKA-6188: --- Summary: Broker fails with FATAL Shutdown - log dirs have failed Key: KAFKA-6188 URL: https://issues.apache.org/jira/browse/KAFKA-6188 Project: Kafka

[jira] [Resolved] (KAFKA-6186) RocksDB based WindowStore fail to create db file on Windows OS

2017-11-08 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6186. --- Resolution: Duplicate > RocksDB based WindowStore fail to create db file on Windows OS >

[jira] [Created] (KAFKA-6187) Remove the Logging class in favor of LazyLogging in scala-logging

2017-11-08 Thread Viktor Somogyi (JIRA)
Viktor Somogyi created KAFKA-6187: - Summary: Remove the Logging class in favor of LazyLogging in scala-logging Key: KAFKA-6187 URL: https://issues.apache.org/jira/browse/KAFKA-6187 Project: Kafka

Re: [ANNOUNCE] New committer: Onur Karaman

2017-11-08 Thread Sandeep Nemuri
Congratulations Onur!! On Wed, Nov 8, 2017 at 9:19 AM, UMESH CHAUDHARY wrote: > Congratulations Onur! > > On Tue, 7 Nov 2017 at 21:44 Jun Rao wrote: > > > Affan, > > > > All known problems in the controller are described in the doc linked from > >

[jira] [Created] (KAFKA-6189) Loosing messages while getting OFFSET_OUT_OF_RANGE eror in consumer

2017-11-08 Thread Andrey (JIRA)
Andrey created KAFKA-6189: - Summary: Loosing messages while getting OFFSET_OUT_OF_RANGE eror in consumer Key: KAFKA-6189 URL: https://issues.apache.org/jira/browse/KAFKA-6189 Project: Kafka Issue

[GitHub] kafka pull request #4193: KAFKA-6185: Remove channels from explictlyMutedCha...

2017-11-08 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/4193 KAFKA-6185: Remove channels from explictlyMutedChannels set when closed You can merge this pull request into a Git repository by running: $ git pull

Re: [VOTE] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-11-08 Thread Damian Guy
+1 (binding) On Sat, 4 Nov 2017 at 16:50 Matthias J. Sax wrote: > Yes. A KIP needs 3 binding "+1" to be accepted. > > You can still work on the PR and get it ready to get merged -- I am > quite confident that this KIP will be accepted :) > > > -Matthias > > On 11/4/17

[GitHub] kafka pull request #4194: KAFKA-5646: Use KafkaZkClient in AdminUtils and Dy...

2017-11-08 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/4194 KAFKA-5646: Use KafkaZkClient in AdminUtils and DynamicConfigManager Use KafkaZkClient in ConfigCommand, ReassignPartitionsCommand, TopicCommand You can merge this pull request into a Git

[GitHub] kafka pull request #4195: KAFKA-5811: Add Kibosh integration for Trogdor and...

2017-11-08 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/4195 KAFKA-5811: Add Kibosh integration for Trogdor and Ducktape For ducktape: add Kibosh to the testing Dockerfile. Create files_unreadable_fault_spec.py. For trogdor: create

[GitHub] kafka pull request #4155: KAFKA-5645: Use async ZookeeperClient in SimpleAcl...

2017-11-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4155 ---

Re: Can someone update this KIP's status to "accepted"?

2017-11-08 Thread Dong Lin
Thanks. I have updated it to be accepted. On Wed, Nov 8, 2017 at 1:33 PM, Jeff Widman wrote: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-164-+Add+ > UnderMinIsrPartitionCount+and+per-partition+UnderMinIsr+metrics > > the JIRA shows it was shipped in 1.0, but the

Can someone update this KIP's status to "accepted"?

2017-11-08 Thread Jeff Widman
https://cwiki.apache.org/confluence/display/KAFKA/KIP-164-+Add+UnderMinIsrPartitionCount+and+per-partition+UnderMinIsr+metrics the JIRA shows it was shipped in 1.0, but the wiki page lists it as "Discussion" -- *Jeff Widman* jeffwidman.com | 740-WIDMAN-J (943-6265)

[GitHub] kafka pull request #4196: MINOR: KafkaZkClient refactor. Use match instead o...

2017-11-08 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/4196 MINOR: KafkaZkClient refactor. Use match instead of if/else chains Follow up from https://github.com/apache/kafka/pull/4111 You can merge this pull request into a Git repository by running: $

[GitHub] kafka pull request #4197: KAFKA-6190 GlobalKTable never finishes restoring w...

2017-11-08 Thread alexjg
GitHub user alexjg opened a pull request: https://github.com/apache/kafka/pull/4197 KAFKA-6190 GlobalKTable never finishes restoring when consuming transactional messages Calculate offset using consumer.position() in GlobalStateManagerImp#restoreState You can merge this pull

Build failed in Jenkins: kafka-1.0-jdk7 #74

2017-11-08 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-6156; Metric tag values with colons must be sanitized -- [...truncated 23.93 KB...] (topicPartition, new

[GitHub] kafka pull request #4186: KAFKA-6179: Clear min timestamp tracker upon parti...

2017-11-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4186 ---

[jira] [Resolved] (KAFKA-6179) RecordQueue.clear() does not clear MinTimestampTracker's maintained list

2017-11-08 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6179. -- Resolution: Fixed Fix Version/s: 0.11.0.2 1.1.0

[jira] [Created] (KAFKA-6190) GlobalKTable never finishes restoring when consuming transactional messages

2017-11-08 Thread Alex Good (JIRA)
Alex Good created KAFKA-6190: Summary: GlobalKTable never finishes restoring when consuming transactional messages Key: KAFKA-6190 URL: https://issues.apache.org/jira/browse/KAFKA-6190 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk7 #2954

2017-11-08 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6179: Clear min timestamp tracker upon partition queue cleanup -- [...truncated 381.93 KB...] kafka.server.ServerGenerateBrokerIdTest >

[GitHub] kafka pull request #4189: KAFKA-6146: minimize the number of triggers enqueu...

2017-11-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4189 ---

Re: [DISCUSS] KIP-219 - Improve Quota Communication

2017-11-08 Thread Becket Qin
Since we will bump up the wire request version, another option is for clients that are sending old request versions the broker can just keep the current behavior. For clients sending the new request versions, the broker can respond then mute the channel as described in the KIP wiki. In this case,

Jenkins build is back to normal : kafka-trunk-jdk7 #2953

2017-11-08 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #2196

2017-11-08 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6179: Clear min timestamp tracker upon partition queue cleanup -- [...truncated 3.80 MB...]

Re: kafka-pr-jdk9-scala2.12 keeps failing

2017-11-08 Thread Guozhang Wang
We saw the same error again in later builds: https://builds.apache.org/job/kafka-pr-jdk9-scala2.12/2498/console Does anything get reverted? Guozhang On Tue, Nov 7, 2017 at 8:33 AM, Ted Yu wrote: > https://builds.apache.org/job/kafka-pr-jdk9-scala2.12/2470/ is green. > >

Build failed in Jenkins: kafka-trunk-jdk8 #2197

2017-11-08 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-6146; minimize the number of triggers enqueuing -- [...truncated 1.39 MB...] org.apache.kafka.common.security.plain.PlainSaslServerTest >

Build failed in Jenkins: kafka-trunk-jdk7 #2956

2017-11-08 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-6146; minimize the number of triggers enqueuing -- [...truncated 381.61 KB...] kafka.server.ServerGenerateBrokerIdTest >

Jenkins build is back to normal : kafka-trunk-jdk7 #2955

2017-11-08 Thread Apache Jenkins Server
See

Re: kafka-pr-jdk9-scala2.12 keeps failing

2017-11-08 Thread Ted Yu
Different error than the jdk 9.0.1 one. What's the value for versions.jackson ? We may need to upgrade. On Wed, Nov 8, 2017 at 5:46 PM, Guozhang Wang wrote: > We saw the same error again in later builds: > https://builds.apache.org/job/kafka-pr-jdk9-scala2.12/2498/console >

[GitHub] kafka pull request #4198: MINOR: make controller helper methods private

2017-11-08 Thread onurkaraman
GitHub user onurkaraman opened a pull request: https://github.com/apache/kafka/pull/4198 MINOR: make controller helper methods private You can merge this pull request into a Git repository by running: $ git pull https://github.com/onurkaraman/kafka

[jira] [Resolved] (KAFKA-6146) minimize the number of triggers enqueuing PreferredReplicaLeaderElection events

2017-11-08 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6146. Resolution: Fixed > minimize the number of triggers enqueuing PreferredReplicaLeaderElection >

[jira] [Resolved] (KAFKA-6066) Use of SimpleDateFormat in RocksDBWindowStore may not be Threadsafe

2017-11-08 Thread Srikanth Sundarrajan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan resolved KAFKA-6066. - Resolution: Not A Problem Thanks. Marking this as closed > Use of

Re: kafka-pr-jdk9-scala2.12 keeps failing

2017-11-08 Thread Ted Yu
I used jdk 9 build 181 on Linux to build which passed. I added --debug --stacktrace to ./gradlew command line Let's see if we would have more information if compileScala fails again. On Wed, Nov 8, 2017 at 5:46 PM, Guozhang Wang wrote: > We saw the same error again in later