[GitHub] kafka pull request: Automatically expire RecordBatches before drai...

2016-03-29 Thread SoyeeDst
Github user SoyeeDst closed the pull request at: https://github.com/apache/kafka/pull/1154 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3205) Error in I/O with host (java.io.EOFException) raised in producer

2016-03-29 Thread Jonathan Bond (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217352#comment-15217352 ] Jonathan Bond commented on KAFKA-3205: -- Our logs are being flooded with this message from the

[jira] [Commented] (KAFKA-3205) Error in I/O with host (java.io.EOFException) raised in producer

2016-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217346#comment-15217346 ] ASF GitHub Bot commented on KAFKA-3205: --- GitHub user bondj opened a pull request:

[jira] [Commented] (KAFKA-3471) min.insync.replicas isn't respected when there's a delaying follower who still in ISR

2016-03-29 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217295#comment-15217295 ] Jiangjie Qin commented on KAFKA-3471: - I think it depends on what you actually want. Shortening

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2016-03-29 Thread Swapnesh Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217246#comment-15217246 ] Swapnesh Gandhi commented on KAFKA-1718: I am seeing the same issue, is this compressed

[jira] [Work started] (KAFKA-3338) Add print and writeAsText functions to the Streams DSL

2016-03-29 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3338 started by Bill Bejeck. -- > Add print and writeAsText functions to the Streams DSL >

[GitHub] kafka pull request: MINOR: Advance system test ducktape dependency...

2016-03-29 Thread granders
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1165 MINOR: Advance system test ducktape dependency from 0.3.10 to 0.4.0 Previous version of ducktape was found to have a memory leak which caused occasional failures in nightly runs. You can merge

Build failed in Jenkins: kafka-trunk-jdk8 #490

2016-03-29 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3425: add missing upgrade notes -- [...truncated 1613 lines...] kafka.producer.AsyncProducerTest > testNoBroker PASSED kafka.producer.AsyncProducerTest >

[jira] [Commented] (KAFKA-2426) A Kafka node tries to connect to itself through its advertised hostname

2016-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217007#comment-15217007 ] Mikaël Cluseau commented on KAFKA-2426: --- Hi, it depends on how you add the host to the container's

Build failed in Jenkins: kafka-trunk-jdk7 #1158

2016-03-29 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3425: add missing upgrade notes -- [...truncated 1551 lines...] kafka.log.LogTest > testTruncateTo PASSED kafka.log.LogTest > testCleanShutdownFile PASSED

Jenkins build is back to normal : kafka-trunk-jdk8 #489

2016-03-29 Thread Apache Jenkins Server
See

[GitHub] kafka pull request: MINOR: a simple benchmark for Streams

2016-03-29 Thread ymatsuda
GitHub user ymatsuda opened a pull request: https://github.com/apache/kafka/pull/1164 MINOR: a simple benchmark for Streams @guozhangwang @miguno You can merge this pull request into a Git repository by running: $ git pull https://github.com/ymatsuda/kafka perf Alternatively

[jira] [Updated] (KAFKA-3262) Make KafkaStreams debugging friendly

2016-03-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3262: - Fix Version/s: 0.10.0.1 > Make KafkaStreams debugging friendly >

[jira] [Commented] (KAFKA-3262) Make KafkaStreams debugging friendly

2016-03-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216934#comment-15216934 ] Guozhang Wang commented on KAFKA-3262: -- I agree that for development cycle we should enforce "single

Build failed in Jenkins: kafka-trunk-jdk7 #1157

2016-03-29 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: RocksDBStore must clear dirty flags after flush -- [...truncated 1589 lines...] kafka.log.LogSegmentTest > testCreateWithInitFileSizeClearShutdown PASSED

[jira] [Created] (KAFKA-3485) Configuration to bind Kafka Producer to specific network interface

2016-03-29 Thread Kyle Kavanagh (JIRA)
Kyle Kavanagh created KAFKA-3485: Summary: Configuration to bind Kafka Producer to specific network interface Key: KAFKA-3485 URL: https://issues.apache.org/jira/browse/KAFKA-3485 Project: Kafka

[jira] [Commented] (KAFKA-3425) Add missing notes to upgrade docs

2016-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216866#comment-15216866 ] ASF GitHub Bot commented on KAFKA-3425: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-3425) Add missing notes to upgrade docs

2016-03-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3425: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[GitHub] kafka pull request: KAFKA-3425: add missing upgrade notes

2016-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1159 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [VOTE] 0.10.0.0 RC1

2016-03-29 Thread Guozhang Wang
Hi Gwen: We found a critical bug in Kafka Streams that heavily impact its performance: https://github.com/apache/kafka/pull/1163 It has been merged to 0.10.0 branch. Can we roll out another RC? Guozhang On Mon, Mar 28, 2016 at 10:01 PM, Dana Powers wrote: > +1

[jira] [Created] (KAFKA-3484) Transient failure in SslConsumerTest.testListTopics

2016-03-29 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3484: -- Summary: Transient failure in SslConsumerTest.testListTopics Key: KAFKA-3484 URL: https://issues.apache.org/jira/browse/KAFKA-3484 Project: Kafka Issue

[jira] [Comment Edited] (KAFKA-3358) Only request metadata updates once we have topics or a pattern subscription

2016-03-29 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216760#comment-15216760 ] Jason Gustafson edited comment on KAFKA-3358 at 3/29/16 8:16 PM: - The main

[jira] [Commented] (KAFKA-3358) Only request metadata updates once we have topics or a pattern subscription

2016-03-29 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216760#comment-15216760 ] Jason Gustafson commented on KAFKA-3358: The main problem is that the current topic metadata

[jira] [Commented] (KAFKA-2426) A Kafka node tries to connect to itself through its advertised hostname

2016-03-29 Thread khenaidoo nursimulu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216726#comment-15216726 ] khenaidoo nursimulu commented on KAFKA-2426: Hello, I am having the same issue (with both

[GitHub] kafka pull request: HOTFIX: RocksDBStore must clear dirty flags af...

2016-03-29 Thread ymatsuda
GitHub user ymatsuda opened a pull request: https://github.com/apache/kafka/pull/1163 HOTFIX: RocksDBStore must clear dirty flags after flush @guozhangwang Without clearing the dirty flags, RocksDBStore will perform flush for every new record. This bug made the store

[jira] [Updated] (KAFKA-3483) Restructure ducktape tests to simplify running subsets of tests

2016-03-29 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KAFKA-3483: --- Status: Patch Available (was: Open) > Restructure ducktape tests to simplify running subsets of

[jira] [Commented] (KAFKA-3483) Restructure ducktape tests to simplify running subsets of tests

2016-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216516#comment-15216516 ] ASF GitHub Bot commented on KAFKA-3483: --- GitHub user granthenke opened a pull request:

[GitHub] kafka pull request: KAFKA-3483: Restructure ducktape tests to simp...

2016-03-29 Thread granthenke
GitHub user granthenke opened a pull request: https://github.com/apache/kafka/pull/1162 KAFKA-3483: Restructure ducktape tests to simplify running subsets of… … tests You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (KAFKA-3483) Restructure ducktape tests to simplify running subsets of tests

2016-03-29 Thread Grant Henke (JIRA)
Grant Henke created KAFKA-3483: -- Summary: Restructure ducktape tests to simplify running subsets of tests Key: KAFKA-3483 URL: https://issues.apache.org/jira/browse/KAFKA-3483 Project: Kafka

Re: Messages corrupted in kafka

2016-03-29 Thread Roger Hoover
Are you using snappy compression? There was a bug with snappy that caused corrupt messages. Sent from my iPhone > On Mar 29, 2016, at 8:15 AM, sunil kalva wrote: > > Hi > Do we store message crc also on disk, and server verifies same when we are > reading messages back

[jira] [Commented] (KAFKA-3334) First message on new topic not actually being sent, no exception thrown

2016-03-29 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216345#comment-15216345 ] Ashish K Singh commented on KAFKA-3334: --- [~becket_qin] thanks for the quick review. I think there

[jira] [Comment Edited] (KAFKA-3480) Autogenerate metrics documentation

2016-03-29 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216310#comment-15216310 ] Jason Gustafson edited comment on KAFKA-3480 at 3/29/16 4:47 PM: -

[jira] [Commented] (KAFKA-3480) Autogenerate metrics documentation

2016-03-29 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216310#comment-15216310 ] Jason Gustafson commented on KAFKA-3480: [~wushujames] Feel free to pick this up if you're

Apache Kafka Meetup today, at San Jose Convention Center

2016-03-29 Thread Guozhang Wang
Hello Apache Kafka folks, We invite you to join us for the March Apache Kafka Meetup today (Tuesday, March 29) at San Jose Convention Center, starting at 6pm: http://www.meetup.com/http-kafka-apache-org/events/229424437/ We have two great talks today: -- Title: Introduction to Kafka

Re: Messages corrupted in kafka

2016-03-29 Thread sunil kalva
Hi Do we store message crc also on disk, and server verifies same when we are reading messages back from disk? And how to handle errors when we use async publish ? On Fri, Mar 25, 2016 at 4:17 AM, Becket Qin wrote: > You mentioned that you saw few corrupted messages, (<

Re: [VOTE] KIP-43: Kafka SASL enhancements

2016-03-29 Thread Jun Rao
Rajini, Thanks for the update. +1 on the proposal. Jun On Tue, Mar 29, 2016 at 3:32 AM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Jun, > > Thank you for reviewing the KIP. Answers below: > > 1. Yes, broker can specify *sasl.mechanism. *It is used for all client-mode > connections

[jira] [Commented] (KAFKA-3476) -Xloggc is not recognised by IBM java

2016-03-29 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215837#comment-15215837 ] Rajini Sivaram commented on KAFKA-3476: --- You can export new values for GC and performance opts prior

Re: [VOTE] KIP-43: Kafka SASL enhancements

2016-03-29 Thread Rajini Sivaram
Jun, Thank you for reviewing the KIP. Answers below: 1. Yes, broker can specify *sasl.mechanism. *It is used for all client-mode connections including that in inter-broker communication. 2. If *sasl.enabled.mechanisms* is not specified, the default value of {'GSSAPI'} is used. If it is

Re: Kafka Connect ++ Kafka Streams

2016-03-29 Thread Michal Haris
Replies from the dev list weren't getting to my original sender account. I could create a pull request but it has some patchy code in ConnectEmbedded and dependencies which shouldn't be there (connect-runtime) as it was mostly intended for imagining how the integrated connect and streams topology

Request for edit access to Kafka wiki

2016-03-29 Thread Ganesh Nikam
Hi All, I want to publish C++ Kafka client. I have my git repository ready. Now I want add entry on Kafka “Clients” page (Confluence wiki page) for this new client. I did create my login for the Confluence and login with that. But I am not able to edit the page. Do I require to do some other

RE: [VOTE] 0.10.0.0 RC0

2016-03-29 Thread Simon Cooper
Sure, many thanks for looking at it SimonC -Original Message- From: Gwen Shapira [mailto:g...@confluent.io] Sent: 28 March 2016 22:30 To: dev@kafka.apache.org Subject: Re: [VOTE] 0.10.0.0 RC0 Since Dana and few others found critical issues for the release, I've rolled out another RC.

[jira] [Commented] (KAFKA-3334) First message on new topic not actually being sent, no exception thrown

2016-03-29 Thread Aleksandar Stojadinovic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215668#comment-15215668 ] Aleksandar Stojadinovic commented on KAFKA-3334: I'm carefully following the discussion.

[jira] [Resolved] (KAFKA-3482) [DOC] - Remove the part about LinkedIn running ZK 3.3.X

2016-03-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3482. Resolution: Duplicate This is a duplicate of KAFKA-2930 (which has a PR). > [DOC] - Remove the