Build failed in Jenkins: kafka-trunk-jdk8 #992

See Changes: [wangguoz] HOTFIX: follow up on KAFKA-4275 [wangguoz] KAFKA-4269: Update topic subscription when regex pattern specified out -- [...truncated 7893 lines...]

[jira] [Commented] (KAFKA-4269) Multiple KStream instances with at least one Regex source causes NPE when using multiple consumers

[ https://issues.apache.org/jira/browse/KAFKA-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590710#comment-15590710 ] ASF GitHub Bot commented on KAFKA-4269: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2005: KAFKA-4269 extracted code updating topics when reg...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2005 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4269) Multiple KStream instances with at least one Regex source causes NPE when using multiple consumers

[ https://issues.apache.org/jira/browse/KAFKA-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4269: - Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.2.0

[jira] [Commented] (KAFKA-4275) Check of State-Store-assignment to Processor-Nodes is not enabled

[ https://issues.apache.org/jira/browse/KAFKA-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590693#comment-15590693 ] ASF GitHub Bot commented on KAFKA-4275: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2039: HOTFIX: follow up on KAFKA-4275

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2039 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590599#comment-15590599 ] huxi commented on KAFKA-4295: - The design is not changed. 0.9.x still removes the zk nodes for inactive

Re: [VOTE] KIP-73 - Replication Quotas

Hi, While testing KIP-73, we found an issue described in https://issues.apache.org/jira/browse/KAFKA-4313. Basically, when there are mixed high-volume and low-volume partitions, when replication throttling is specified, ISRs for those low volume partitions could thrash. KAFKA-4313 fixes this

Build failed in Jenkins: kafka-0.10.1-jdk7 #79

See Changes: [wangguoz] MINOR: Added more basic concepts to the documentation -- [...truncated 7393 lines...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[1] STARTED

Jenkins build is back to normal : kafka-trunk-jdk8 #990

See

[jira] [Resolved] (KAFKA-4250) make ProducerRecord and ConsumerRecord extensible

[ https://issues.apache.org/jira/browse/KAFKA-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-4250. --- Resolution: Fixed Assignee: radai rosenblatt Reviewer: Joel Koshy Fix

[jira] [Commented] (KAFKA-4250) make ProducerRecord and ConsumerRecord extensible

[ https://issues.apache.org/jira/browse/KAFKA-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590239#comment-15590239 ] ASF GitHub Bot commented on KAFKA-4250: --- Github user asfgit closed the pull request at:

[jira] [Commented] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590240#comment-15590240 ] ASF GitHub Bot commented on KAFKA-4312: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2042: KAFKA-4312: If filePath is empty string writeAsTex...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2042 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1961: KAFKA-4250: make ProducerRecord and ConsumerRecord...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1961 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: KStreams / add support for sink processor with dynamic topics

We can consider adding this feature to with a StreamsAdminClient that we are adding as part of KAFKA-4060. However, I'm still not sure if it should be added on the DSL layer or on the Processor API layer. Florian, what do you mean that the Processor is not "completely safe"? Do you mean not

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4316: - Affects Version/s: 0.10.0.1 > Kafka Streams 0.10.0.1 does not run on Windows x64 >

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4316: - Component/s: streams > Kafka Streams 0.10.0.1 does not run on Windows x64 >

[GitHub] kafka-site issue #25: Enable 0.10.1 documentation

Github user gwenshap commented on the issue: https://github.com/apache/kafka-site/pull/25 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka-site pull request #25: Enable 0.10.1 documentation

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka-site/pull/25 Enable 0.10.1 documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka-site activate-0.10.1-docs Alternatively you

Build failed in Jenkins: kafka-trunk-jdk8 #989

See Changes: [wangguoz] HOTFIX: Fix putAll and putIfAbsent logic for correct eviction behavior -- [...truncated 14202 lines...] org.apache.kafka.streams.processor.internals.AbstractTaskTest >

[jira] [Commented] (KAFKA-3995) Add a new configuration "enable.comrpession.ratio.estimation" to the producer config

[ https://issues.apache.org/jira/browse/KAFKA-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589938#comment-15589938 ] Mayuresh Gharat commented on KAFKA-3995: If we disable compression, we would not have this issue

[jira] [Reopened] (KAFKA-3995) Add a new configuration "enable.comrpession.ratio.estimation" to the producer config

[ https://issues.apache.org/jira/browse/KAFKA-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat reopened KAFKA-3995: > Add a new configuration "enable.comrpession.ratio.estimation" to the producer > config >

[jira] [Updated] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4312: - Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.2.0

[GitHub] kafka pull request #2030: MINOR: Added more basic concepts to the documentat...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2030 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2036: MINOR: Update rocksDB dependency to 4.11.2

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2036 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2038: HOTFIX: Fix put logic

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2038 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589806#comment-15589806 ] Michael Noll commented on KAFKA-4316: - [~habdank]: Sounds good. FYI: The vote on releasing Kafka

[jira] [Commented] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589756#comment-15589756 ] Seweryn Habdank-Wojewodzki commented on KAFKA-4316: --- Thanks a lot for very quick

Re: Kafka KIP meeting Oct 19 at 11:00am PST

The following are the notes from today's KIP discussion. - KIP-82 - add record header: We agreed that there are use cases for third-party vendors building tools around Kafka. We haven't reached the conclusion whether the added complexity justifies the use cases. We will follow up on

Jenkins build is back to normal : kafka-trunk-jdk7 #1640

See

Build failed in Jenkins: kafka-trunk-jdk8 #988

See Changes: [jason] KAFKA-4319; Parallelize shutdown of fetchers in AbstractFetcherManager -- [...truncated 14188 lines...] org.apache.kafka.streams.StreamsConfigTest >

[GitHub] kafka pull request #2044: Changes for supporting unsgined tinyint values

GitHub user vamossagar12 opened a pull request: https://github.com/apache/kafka/pull/2044 Changes for supporting unsgined tinyint values Based upon the theory provided in the official jdbc documentation, I have added a condition to include both Short and Byte as INT8 types in

[jira] [Updated] (KAFKA-4321) Make client.id available to MetricReporter and (De)Serializers in clients

[ https://issues.apache.org/jira/browse/KAFKA-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Arrawatia updated KAFKA-4321: --- Description: Currently, only the interceptors get the default client.id (which is generated

[jira] [Resolved] (KAFKA-4215) Consumers miss messages during partition reassignment

[ https://issues.apache.org/jira/browse/KAFKA-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apurva Mehta resolved KAFKA-4215. - Resolution: Won't Fix This is the expected behavior. When the replication factor is 1, and when

Re: [VOTE] 0.10.1.0 RC3

+1 from myself too. The vote passes with 9 +1 votes and no 0 or -1 votes. +1 votes PMC Members: * Gwen Shapira * Jun Rao * Neha Narkhede Committers: * Ismael Juma * Jason Gustafson Community: * Eno Thereska * Manikumar Reddy * Dana Powers * Magnus Edenhill 0 votes * No votes -1 votes * No

[jira] [Created] (KAFKA-4321) Make client.id available to MetricReporter and (De)Serializers in clients

Sumit Arrawatia created KAFKA-4321: -- Summary: Make client.id available to MetricReporter and (De)Serializers in clients Key: KAFKA-4321 URL: https://issues.apache.org/jira/browse/KAFKA-4321 Project:

[GitHub] kafka pull request #2023: KAFKA-4319; AbstractFetcherManager: shutdown speed...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2023 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4319) AbstractFetcherManager shutdown speedup

[ https://issues.apache.org/jira/browse/KAFKA-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4319: --- Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch

[jira] [Commented] (KAFKA-4319) AbstractFetcherManager shutdown speedup

[ https://issues.apache.org/jira/browse/KAFKA-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589236#comment-15589236 ] ASF GitHub Bot commented on KAFKA-4319: --- Github user asfgit closed the pull request at:

Re: [VOTE] 0.10.1.0 RC3

+1 (non-binding) passes librdkafka test suites 2016-10-19 15:55 GMT+02:00 Ismael Juma : > +1 (non-binding). > > Verified source and Scala 2.11 binary artifacts, ran ./gradlew test with > JDK 7u80, quick start on source artifact and Scala 2.11 binary artifacts. > > Thanks for

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589089#comment-15589089 ] Damian Guy commented on KAFKA-4311: --- Thanks - i'll take a look at it what your repository and get back

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589074#comment-15589074 ] Frank Lyaruu commented on KAFKA-4311: - I'm working on it, and frankly I'm at a loss. I've made a

Frequent UNKNOWN_MEMBER_ID errors in kafka consumer

Hi, I have a consumer which implements new consumer api (0.9.0.1). I see below errors quite frequently in the consumer application logs: ERROR [pool-4-thread-5] - o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group audit.consumer.group Can you

Re: [VOTE] 0.10.1.0 RC3

+1 (non-binding). Verified source and Scala 2.11 binary artifacts, ran ./gradlew test with JDK 7u80, quick start on source artifact and Scala 2.11 binary artifacts. Thanks for managing the release! Ismael On Sat, Oct 15, 2016 at 12:29 AM, Jason Gustafson wrote: > Hello

[jira] [Commented] (KAFKA-3995) Add a new configuration "enable.comrpession.ratio.estimation" to the producer config

[ https://issues.apache.org/jira/browse/KAFKA-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588765#comment-15588765 ] Jiangjie Qin commented on KAFKA-3995: - [~mgharat] Could you elaborate on what is the workaround? >

[jira] [Issue Comment Deleted] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4295: Comment: was deleted (was: I think we'd better follow what 0.8.x does for us. Removed consumer group's

[jira] [Commented] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588733#comment-15588733 ] huxi commented on KAFKA-4295: - I think we'd better follow what 0.8.x does for us. Removed consumer group's

[jira] [Commented] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588725#comment-15588725 ] huxi commented on KAFKA-4295: - I think we'd better follow what 0.8.x does for us. Removed consumer group's

[jira] [Assigned] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4295: --- Assignee: huxi > kafka-console-consumer.sh does not delete the temporary group in zookeeper >

[jira] [Updated] (KAFKA-4320) Log compaction docs update

[ https://issues.apache.org/jira/browse/KAFKA-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated KAFKA-4320: --- Labels: newbie (was: ) > Log compaction docs update > -- > >

[jira] [Created] (KAFKA-4320) Log compaction docs update

Dustin Cote created KAFKA-4320: -- Summary: Log compaction docs update Key: KAFKA-4320 URL: https://issues.apache.org/jira/browse/KAFKA-4320 Project: Kafka Issue Type: Bug Components:

[jira] [Updated] (KAFKA-4319) AbstractFetcherManager shutdown speedup

[ https://issues.apache.org/jira/browse/KAFKA-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Ozeritskiy updated KAFKA-4319: - Status: Patch Available (was: Open) https://github.com/apache/kafka/pull/2023 >

[jira] [Created] (KAFKA-4319) AbstractFetcherManager shutdown speedup

Alexey Ozeritskiy created KAFKA-4319: Summary: AbstractFetcherManager shutdown speedup Key: KAFKA-4319 URL: https://issues.apache.org/jira/browse/KAFKA-4319 Project: Kafka Issue Type:

Kafka running on Ceph

Hi, I found following post from achieve, but no any response. Any comments, future development and roadmap for that feature? --- From: Connie Yang To: us...@kafka.apache.org Content-Type:

[jira] [Created] (KAFKA-4318) Migrate ProducerSendTest to the new consumer

Balint Molnar created KAFKA-4318: Summary: Migrate ProducerSendTest to the new consumer Key: KAFKA-4318 URL: https://issues.apache.org/jira/browse/KAFKA-4318 Project: Kafka Issue Type: Bug

[jira] [Work started] (KAFKA-4318) Migrate ProducerSendTest to the new consumer

[ https://issues.apache.org/jira/browse/KAFKA-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4318 started by Balint Molnar. > Migrate ProducerSendTest to the new consumer >

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated KAFKA-4316: Description: We had encountered the problem that starting application with Kafka Streams 0.10.0.1

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated KAFKA-4316: Description: We had encountered the problem that starting application with Kafka Streams 0.10.0.1

[jira] [Commented] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588149#comment-15588149 ] Michael Noll commented on KAFKA-4316: - [~habdank]: Thanks for reporting this. FYI: The upcoming

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588096#comment-15588096 ] Damian Guy commented on KAFKA-4311: --- [~flyaruu] We are unable to reproduce or find the problem you are

[jira] [Created] (KAFKA-4317) RocksDB checkpoint files lost on kill -9

Greg Fodor created KAFKA-4317: - Summary: RocksDB checkpoint files lost on kill -9 Key: KAFKA-4317 URL: https://issues.apache.org/jira/browse/KAFKA-4317 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587991#comment-15587991 ] Greg Fodor commented on KAFKA-4113: --- I guess what I would argue is that KStreamBuilder#table should have

[jira] [Created] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

Seweryn Habdank-Wojewodzki created KAFKA-4316: - Summary: Kafka Streams 0.10.0.1 does not run on Windows x64 Key: KAFKA-4316 URL: https://issues.apache.org/jira/browse/KAFKA-4316 Project:

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587966#comment-15587966 ] Greg Fodor commented on KAFKA-4113: --- Having played around with Kafka Streams for a while now, I am still

[jira] [Created] (KAFKA-4315) Kafka Connect documentation problems

Seweryn Habdank-Wojewodzki created KAFKA-4315: - Summary: Kafka Connect documentation problems Key: KAFKA-4315 URL: https://issues.apache.org/jira/browse/KAFKA-4315 Project: Kafka

[jira] [Created] (KAFKA-4314) Kafka Streams documentation needs definitive rework and improvement

Seweryn Habdank-Wojewodzki created KAFKA-4314: - Summary: Kafka Streams documentation needs definitive rework and improvement Key: KAFKA-4314 URL: https://issues.apache.org/jira/browse/KAFKA-4314

Build failed in Jenkins: kafka-trunk-jdk7 #1639

See Changes: [jason] MINOR: Replaced unnecessary map and getOrElse with exists -- [...truncated 12372 lines...] org.apache.kafka.common.record.RecordTest > testFields[185] PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #987

See Changes: [jason] MINOR: Replaced unnecessary map and getOrElse with exists -- [...truncated 14464 lines...] org.apache.kafka.streams.processor.internals.AbstractTaskTest >

Re: [kafka-clients] [VOTE] 0.10.1.0 RC3

+1 (binding) Verified quick start and artifacts. On Mon, Oct 17, 2016 at 10:39 PM Dana Powers wrote: > +1 -- passes kafka-python integration tests > > On Mon, Oct 17, 2016 at 1:28 PM, Jun Rao wrote: > > Thanks for preparing the release. Verified quick