[jira] [Commented] (KAFKA-3949) Consumer topic subscription change may be ignored if a rebalance is in progress

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429223#comment-15429223 ] ASF GitHub Bot commented on KAFKA-3949: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-3949) Consumer topic subscription change may be ignored if a rebalance is in progress

2016-08-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3949. -- Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1762

[GitHub] kafka pull request #1762: KAFKA-3949: Fix race condition when metadata updat...

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1762 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk7 #1487

2016-08-19 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4016: Added join benchmarks -- [...truncated 6370 lines...] kafka.server.SaslApiVersionsRequestTest > testApiVersionsRequestBeforeSaslHandshakeRequest STARTED

Build failed in Jenkins: kafka-trunk-jdk8 #827

2016-08-19 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4016: Added join benchmarks -- [...truncated 12090 lines...] org.apache.kafka.streams.processor.internals.assignment.AssignmentInfoTest >

Kafka KIP meeting Aug 23 at 11:00am PST

2016-08-19 Thread Jun Rao
Hi, Everyone., We plan to have a Kafka KIP meeting this coming Tuesday at 11:00am PST. If you plan to attend but haven't received an invite, please let me know. The following is the tentative agenda. Agenda: Quick status check on those that have been voted - KIP-33: Add a time based log

[jira] [Created] (KAFKA-4068) FileSinkTask - use JsonConverter to serialize

2016-08-19 Thread Shikhar Bhushan (JIRA)
Shikhar Bhushan created KAFKA-4068: -- Summary: FileSinkTask - use JsonConverter to serialize Key: KAFKA-4068 URL: https://issues.apache.org/jira/browse/KAFKA-4068 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-4051) Strange behavior during rebalance when turning the OS clock back

2016-08-19 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429000#comment-15429000 ] Onur Karaman commented on KAFKA-4051: - Is there a legitimate reason for rolling back your clock,

[jira] [Resolved] (KAFKA-4016) Kafka Streams join benchmark

2016-08-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4016. -- Resolution: Fixed Issue resolved by pull request 1700

[jira] [Commented] (KAFKA-4016) Kafka Streams join benchmark

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428946#comment-15428946 ] ASF GitHub Bot commented on KAFKA-4016: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1700: KAFKA-4016: Added join benchmarks

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1700 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk8 #826

2016-08-19 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-4056: Kafka logs values of sensitive configs like passwords [cshapi] KAFKA-4053: remove redundant if/else statements in TopicCommand -- [...truncated 12095 lines...]

Build failed in Jenkins: kafka-trunk-jdk7 #1486

2016-08-19 Thread Apache Jenkins Server
See Changes: [jjkoshy] KAFKA-4050; Allow configuration of the PRNG used for SSL [cshapi] KAFKA-4056: Kafka logs values of sensitive configs like passwords [cshapi] KAFKA-4053: remove redundant if/else statements in TopicCommand

[jira] [Commented] (KAFKA-2629) Enable getting SSL password from an executable rather than passing plaintext password

2016-08-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428880#comment-15428880 ] Bharat Viswanadham commented on KAFKA-2629: --- [~singhashish] Are you working on this? If you are

Build failed in Jenkins: kafka-trunk-jdk8 #825

2016-08-19 Thread Apache Jenkins Server
See Changes: [jjkoshy] KAFKA-4050; Allow configuration of the PRNG used for SSL -- [...truncated 12070 lines...] org.apache.kafka.streams.processor.internals.assignment.AssignmentInfoTest >

Build failed in Jenkins: kafka-trunk-jdk7 #1485

2016-08-19 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-3163; Add time based index to Kafka. -- [...truncated 12048 lines...] org.apache.kafka.streams.processor.internals.MinTimestampTrackerTest > testTracking PASSED

Re: [VOTE] KIP-73 - Replication Quotas

2016-08-19 Thread Gwen Shapira
+1 (binding) On Fri, Aug 19, 2016 at 1:21 AM, Ben Stopford wrote: > I’d like to initiate the voting process for KIP-73: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-73+Replication+Quotas >

Build failed in Jenkins: kafka-0.10.0-jdk7 #191

2016-08-19 Thread Apache Jenkins Server
See Changes: [jjkoshy] KAFKA-4050; Allow configuration of the PRNG used for SSL -- [...truncated 6131 lines...] org.apache.kafka.streams.kstream.UnlimitedWindowsTest >

Re: [VOTE] KIP-73 - Replication Quotas

2016-08-19 Thread Sriram Subramanian
I think the manual way of setting the throttling value is a good first step and definitely required when things go bad. We should continue discussing how we can build more intelligence over this incrementally. +1 (binding) On Fri, Aug 19, 2016 at 1:21 AM, Ben Stopford wrote:

[jira] [Commented] (KAFKA-4053) Refactor TopicCommand to remove redundant if/else statements

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428650#comment-15428650 ] ASF GitHub Bot commented on KAFKA-4053: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-4053) Refactor TopicCommand to remove redundant if/else statements

2016-08-19 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-4053. - Resolution: Fixed Fix Version/s: (was: 0.10.0.2) 0.10.1.0 Issue

[GitHub] kafka pull request #1751: KAFKA-4053: remove redundant if/else statements in...

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1751 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4056) Kafka logs values of sensitive configs like passwords

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428597#comment-15428597 ] ASF GitHub Bot commented on KAFKA-4056: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-4056) Kafka logs values of sensitive configs like passwords

2016-08-19 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-4056. - Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1759

[GitHub] kafka pull request #1759: KAFKA-4056: Kafka logs values of sensitive configs...

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1759 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-08-19 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4058: --- Status: Patch Available (was: In Progress) > Failure in >

[jira] [Resolved] (KAFKA-4050) Allow configuration of the PRNG used for SSL

2016-08-19 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-4050. --- Resolution: Fixed Fix Version/s: 0.10.0.2 0.10.1.0 Pushed to trunk and

[GitHub] kafka pull request #1747: KAFKA-4050: Allow configuration of the PRNG used f...

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1747 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4050) Allow configuration of the PRNG used for SSL

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428564#comment-15428564 ] ASF GitHub Bot commented on KAFKA-4050: --- Github user asfgit closed the pull request at:

Re: [DISCUSS] KIP-71 Enable log compaction and deletion to co-exist

2016-08-19 Thread Damian Guy
Thanks Jun. Everyone - i've updated the KIP to use a comma-separated list of cleanup.policies as suggested. I know we have already voted on this proposal, so are there any objections to this change? Thanks, Damian On Fri, 19 Aug 2016 at 18:38 Jun Rao wrote: > Damian, > >

Build failed in Jenkins: kafka-trunk-jdk8 #824

2016-08-19 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-3163; Add time based index to Kafka. -- [...truncated 3369 lines...] kafka.network.SocketServerTest > testSessionPrincipal STARTED kafka.network.SocketServerTest >

Re: [DISCUSS] KIP-71 Enable log compaction and deletion to co-exist

2016-08-19 Thread Jun Rao
Damian, Yes, using comma-separated policies does seem more extensible for the future. If we want to adopt it, it's better to do it as part of this KIP. Perhaps you can just update the KIP and ask this thread to see if there is any objections with the change. Thanks, Jun On Fri, Aug 19, 2016 at

Re: ZooKeeper performance issue for storing offset

2016-08-19 Thread Guozhang Wang
Hello Xin, The ZK write performance, especially latency, depends on the underlying hardware. AFAIK some organizations use SSD for their ZK clusters so that the latency is less than 1ms. There are some more discussions on how many partitions one should choose in practice and what are ZK's impact

Re: Should we have a KIP call?

2016-08-19 Thread Guozhang Wang
The list LGTM. And if the status check of the above five times was quick I would suggest focus on the time-based release plan and Java 7 support timeline especially. Guozhang On Thu, Aug 18, 2016 at 11:22 AM, Jun Rao wrote: > Grant, > > That sounds like a good idea. I will

[jira] [Created] (KAFKA-4067) improve the handling of IOException in log.close()

2016-08-19 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-4067: -- Summary: improve the handling of IOException in log.close() Key: KAFKA-4067 URL: https://issues.apache.org/jira/browse/KAFKA-4067 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka

2016-08-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-3163: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 1215

[jira] [Commented] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428469#comment-15428469 ] ASF GitHub Bot commented on KAFKA-3163: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1215: KAFKA-3163: Add time based index to Kafka.

2016-08-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1215 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-71 Enable log compaction and deletion to co-exist

2016-08-19 Thread Damian Guy
Hi Grant, I apologise - I seemed to have skipped over Joel's email. It is not something we considered, but seems valid. I'm not sure if we should do it as part of this KIP or revisit it if/when we have more cleanup policies? Thanks, Damian On Fri, 19 Aug 2016 at 15:57 Grant Henke

[jira] [Commented] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428373#comment-15428373 ] ASF GitHub Bot commented on KAFKA-4058: --- GitHub user mjsax opened a pull request:

[GitHub] kafka pull request #1766: KAFKA-4058: Failure in org.apache.kafka.streams.in...

2016-08-19 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/1766 KAFKA-4058: Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset see #1765 You can merge this pull request into a Git repository by running:

[GitHub] kafka pull request #1764: MINOR: improve Streams application reset tool to m...

2016-08-19 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/1764 MINOR: improve Streams application reset tool to make sure application is down You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka

[GitHub] kafka pull request #1765: Improve reset tool 0.10.0

2016-08-19 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/1765 Improve reset tool 0.10.0 @guozhangwang @miguno @dguy @enothereska @hjafarpour See #1764 You can merge this pull request into a Git repository by running: $ git pull

[jira] [Closed] (KAFKA-4063) Add support for infinite endpoints for range queries in Kafka Streams KV stores

2016-08-19 Thread Roger Hoover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roger Hoover closed KAFKA-4063. --- The JIRA UI was unresponsive so I accidentally submitted the form twice. > Add support for infinite

[jira] [Updated] (KAFKA-4042) DistributedHerder thread can die because of connector & task lifecycle exceptions

2016-08-19 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan updated KAFKA-4042: --- Fix Version/s: 0.10.1.0 > DistributedHerder thread can die because of connector & task

Re: [DISCUSS] KIP-71 Enable log compaction and deletion to co-exist

2016-08-19 Thread Grant Henke
Thanks for this KIP Damien. I know this vote has passed and I think its is okay as is, but I had similar thoughts as Joel about combining compaction policies. I'm just wondering if it makes sense to allow specifying multiple > comma-separated policies "compact,delete" as opposed to >

Re: [VOTE] KIP-74: Add FetchResponse size limit in bytes

2016-08-19 Thread Ismael Juma
Thanks for the KIP. +1 (binding) with the following suggestion: Fetch Request (Version: 3) => replica_id max_wait_time min_bytes response_max_bytes [topics] replica_id => INT32 max_wait_time => INT32 min_bytes => INT32 response_max_bytes => INT32 topics => topic [partitions] topic

Jenkins build is back to normal : kafka-trunk-jdk7 #1484

2016-08-19 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-74: Add FetchResponse size limit in bytes

2016-08-19 Thread Tom Crayford
+1 (non binding) On Fri, Aug 19, 2016 at 6:20 AM, Manikumar Reddy wrote: > +1 (non-binding) > > This feature help us control memory footprint and allows consumer to > progress on fetching large messages. > > On Fri, Aug 19, 2016 at 10:32 AM, Gwen Shapira

[jira] [Commented] (KAFKA-4066) NullPointerException in Kafka consumer due to unsafe access to findCoordinatorFuture

2016-08-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427988#comment-15427988 ] ASF GitHub Bot commented on KAFKA-4066: --- GitHub user rajinisivaram opened a pull request:

[GitHub] kafka pull request #1763: KAFKA-4066: Fix NPE in consumer due to multi-threa...

2016-08-19 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/1763 KAFKA-4066: Fix NPE in consumer due to multi-threaded updates You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafka

[jira] [Created] (KAFKA-4066) NullPointerException in Kafka consumer due to unsafe access to findCoordinatorFuture

2016-08-19 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-4066: - Summary: NullPointerException in Kafka consumer due to unsafe access to findCoordinatorFuture Key: KAFKA-4066 URL: https://issues.apache.org/jira/browse/KAFKA-4066

[jira] [Created] (KAFKA-4065) Property missing in ProcuderConfig.java - KafkaProducer API 0.9.0.0

2016-08-19 Thread manzar (JIRA)
manzar created KAFKA-4065: - Summary: Property missing in ProcuderConfig.java - KafkaProducer API 0.9.0.0 Key: KAFKA-4065 URL: https://issues.apache.org/jira/browse/KAFKA-4065 Project: Kafka Issue

[DISCUSS] KIP-76: Improve Kafka Streams Join Semantics

2016-08-19 Thread Matthias J. Sax
Hi, we have created KIP-76: Improve Kafka Streams Join Semantics https://cwiki.apache.org/confluence/display/KAFKA/KIP-76%3A+Improve+Kafka+Streams+Join+Semantics Please give feedback. Thanks. -Matthias signature.asc Description: OpenPGP digital signature

Re: [ANNOUNCE] New Kafka PMC member Gwen Shapira

2016-08-19 Thread Matthias J. Sax
Congrats Gwen! :) On 08/18/2016 08:31 PM, Harsha Chintalapani wrote: > Congrats Gwen. > -Harsha > > On Thu, Aug 18, 2016 at 10:59 AM Mayuresh Gharat > wrote: > >> Congrats Gwen :) >> >> Thanks, >> >> Mayuresh >> >> On Thu, Aug 18, 2016 at 10:27 AM, Gwen Shapira

Re: [DISCUSS] KIP-55: Secure quotas for authenticated users

2016-08-19 Thread Rajini Sivaram
The PR for this KIP is ready for review. JIRA is https://issues.apache.org/jira/browse/KAFKA-3492, PR is https://github.com/apache/kafka/pull/1753. Thanks, Rajini On Tue, Aug 9, 2016 at 1:06 PM, Rajini Sivaram wrote: > Hi Tom, > > Have updated the KIP wiki. Will

[jira] [Work started] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-08-19 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4058 started by Matthias J. Sax. -- > Failure in >

[jira] [Commented] (KAFKA-4051) Strange behavior during rebalance when turning the OS clock back

2016-08-19 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427840#comment-15427840 ] Rajini Sivaram commented on KAFKA-4051: --- [~ijuma] [~gwenshap] Thank you both for the feedback. I

Jenkins build is back to normal : kafka-trunk-jdk8 #823

2016-08-19 Thread Apache Jenkins Server
See

[VOTE] KIP-73 - Replication Quotas

2016-08-19 Thread Ben Stopford
I’d like to initiate the voting process for KIP-73: https://cwiki.apache.org/confluence/display/KAFKA/KIP-73+Replication+Quotas Ben

[GitHub] kafka pull request #1745: KAFKA-4042: prevent DistributedHerder thread from ...

2016-08-19 Thread shikhar
GitHub user shikhar reopened a pull request: https://github.com/apache/kafka/pull/1745 KAFKA-4042: prevent DistributedHerder thread from dying from connector/task lifecycle exceptions - `worker.startConnector()` and `worker.startTask()` can throw (e.g. `ClassNotFoundException`,

[GitHub] kafka pull request #1745: KAFKA-4042: prevent DistributedHerder thread from ...

2016-08-19 Thread shikhar
Github user shikhar closed the pull request at: https://github.com/apache/kafka/pull/1745 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-3204) ConsumerConnector blocked on Authenticated by SASL Failed.

2016-08-19 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy resolved KAFKA-3204. Resolution: Won't Fix > ConsumerConnector blocked on Authenticated by SASL Failed. >