[VOTE] 0.10.0.0 RC4

2016-05-09 Thread Gwen Shapira
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 0.10.0.0. This is a major release that includes: (1) New message format including timestamps (2) client interceptor API (3) Kafka Streams. Since this is a major release, we will give

Re: KIP-57: Interoperable LZ4 Framing

2016-05-09 Thread Gwen Shapira
Agree. On Fri, May 6, 2016 at 3:14 PM, Ismael Juma wrote: > On Fri, May 6, 2016 at 11:07 PM, Dana Powers wrote: > >> Updated: >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-57+-+Interoperable+LZ4+Framing >> >> Should I restart the vote? >> > >

Re: [VOTE] KIP-45: Standardize KafkaConsumer API to use Collection

2016-05-09 Thread Gwen Shapira
We need to conclude this discussion in order to unblock the release. If I understand correctly, we have 3 options on the table: 1. Add the missing APIs as "deprecated". Pros: Conceptually, the right way to get rid of an API without breaking Storm Cons: Users of the new API will get ugly

Re: [VOTE] 0.10.0.0 RC3

2016-05-09 Thread Gwen Shapira
KAFKA-3669 > > On Thu, May 5, 2016 at 1:46 PM, Gwen Shapira <g...@confluent.io> wrote: > >> Hello Kafka users, developers and client-developers, >> >> This is the fourth candidate for release of Apache Kafka 0.10.0.0. >> >> This is a major release that i

[jira] [Commented] (KAFKA-3656) Avoid stressing system more when already under stress

2016-05-05 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273477#comment-15273477 ] Gwen Shapira commented on KAFKA-3656: - The fix is pretty trivial (remove a log line). If one of you

[jira] [Commented] (KAFKA-3587) LogCleaner fails due to incorrect offset map computation on a replica

2016-05-05 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273313#comment-15273313 ] Gwen Shapira commented on KAFKA-3587: - [~alekar] Thanks for the patch! In general, Apache Kafka

[VOTE] 0.10.0.0 RC3

2016-05-05 Thread Gwen Shapira
Hello Kafka users, developers and client-developers, This is the fourth candidate for release of Apache Kafka 0.10.0.0. This is a major release that includes: (1) New message format including timestamps (2) client interceptor API (3) Kafka Streams. Since this is a major release, we will give

[jira] [Commented] (KAFKA-3525) max.reserved.broker.id off-by-one error

2016-05-04 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271527#comment-15271527 ] Gwen Shapira commented on KAFKA-3525: - This will wait for the next release. The max reserved is very

[jira] [Updated] (KAFKA-3525) max.reserved.broker.id off-by-one error

2016-05-04 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3525: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > max.reserved.broker.id off-by-

[jira] [Assigned] (KAFKA-3653) expose the queue size in ControllerChannelManager

2016-05-03 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira reassigned KAFKA-3653: --- Assignee: Gwen Shapira > expose the queue size in ControllerChannelMana

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-05-03 Thread Gwen Shapira
> > need infinite lifetime on the token even for long running clients. >> > > > >> > > > 3) The token password are generated using a master key. The master >> key >> > > > should also be periodically changed. In Hadoop, the default renewal

[jira] [Updated] (KAFKA-3479) Add new consumer metrics documentation

2016-05-03 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3479: Assignee: Kaufman Ng > Add new consumer metrics documentat

[jira] [Commented] (KAFKA-3585) Shutdown slow when there is only one broker which is controller

2016-05-03 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268984#comment-15268984 ] Gwen Shapira commented on KAFKA-3585: - Try creating a topic with 100 partitions. This should slow

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-05-03 Thread Gwen Shapira
Are we planning on updating the security section in Kafka documentation? On Tue, May 3, 2016 at 12:18 AM, Rajini Sivaram wrote: > Magnus, > > Yes, you are absolutely right. I have fixed the wiki page. Thank you for > pointing it out. > > Regards, > > Rajini > > On

[jira] [Resolved] (KAFKA-3640) Reduce the latency of topic metadata requests

2016-05-02 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-3640. - Resolution: Fixed Issue resolved by pull request 1303 [https://github.com/apache/kafka/pull/1303

Re: [VOTE] 0.10.0.0 RC2

2016-05-02 Thread Gwen Shapira
> > On Mon, May 2, 2016 at 5:44 AM, Ismael Juma <ism...@juma.me.uk> wrote: >> On second thought, will people be able to test the binary packages if they >> can't start the broker? >> >> Ismael >> >> On Mon, May 2, 2016 at 5:43 AM, Ismael Juma <ism...@ju

Re: [VOTE] 0.10.0.0 RC2

2016-05-02 Thread Gwen Shapira
y the same state as pre KIP-41 (i.e. > the implementation for KIP-41 is currently incorrect). > > -Ewen > > On Sat, Apr 30, 2016 at 6:16 PM, Gwen Shapira <g...@confluent.io> wrote: > >> Thanks for the correction :) >> >> On Sat, Apr 30, 2016 at 2

[jira] [Commented] (KAFKA-3585) Shutdown slow when there is only one broker which is controller

2016-05-01 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15266141#comment-15266141 ] Gwen Shapira commented on KAFKA-3585: - Thanks for volunteering [~firstprayer]. I added you

[jira] [Updated] (KAFKA-3585) Shutdown slow when there is only one broker which is controller

2016-05-01 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3585: Assignee: Taiyuan Zhang > Shutdown slow when there is only one broker which is control

[jira] [Commented] (KAFKA-3646) Console producer using new producer should set timestamp

2016-05-01 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15266140#comment-15266140 ] Gwen Shapira commented on KAFKA-3646: - Keep in mind that the console producer also defaults to empty

Re: [VOTE] 0.10.0.0 RC2

2016-04-30 Thread Gwen Shapira
e RC effort. > > Regards, > > Ben > > On Sat, Apr 30, 2016 at 1:01 AM, Gwen Shapira <g...@confluent.io> wrote: > >> Hello Kafka users, developers and client-developers, >> >> This is the first candidate for release of Apache Kafka 0.10.0.0. This

[jira] [Updated] (KAFKA-3644) Use Boolean protocol type for StopReplicaRequest delete_partitions

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3644: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[VOTE] 0.10.0.0 RC2

2016-04-29 Thread Gwen Shapira
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 0.10.0.0. This is a major release that includes: (1) New message format including timestamps (2) client interceptor API (3) Kafka Streams. (4) Configurable SASL authentication mechanisms

[jira] [Updated] (KAFKA-3549) Close consumers instantiated in consumer tests

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3549: Fix Version/s: 0.10.0.0 > Close consumers instantiated in consumer te

[jira] [Updated] (KAFKA-3439) Document possible exception thrown in public APIs

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3439: Fix Version/s: 0.10.0.0 > Document possible exception thrown in public A

[jira] [Updated] (KAFKA-3618) Handle ApiVersionRequest before SASL handshake

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3618: Fix Version/s: 0.10.0.0 > Handle ApiVersionRequest before SASL handsh

[jira] [Updated] (KAFKA-3490) Multiple version support for ducktape performance tests

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3490: Fix Version/s: 0.10.0.0 > Multiple version support for ducktape performance te

[jira] [Updated] (KAFKA-2693) Run relevant ducktape tests with SASL/PLAIN and multiple mechanisms

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2693: Fix Version/s: 0.10.0.0 > Run relevant ducktape tests with SASL/PLAIN and multiple mechani

[jira] [Updated] (KAFKA-3526) REST APIs return object representation instead of string for config values, default values and recommended values

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3526: Fix Version/s: 0.10.0.0 > REST APIs return object representation instead of string for con

[jira] [Updated] (KAFKA-3382) Add system test for ReplicationVerificationTool

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3382: Fix Version/s: 0.10.0.0 > Add system test for ReplicationVerificationT

[jira] [Updated] (KAFKA-2479) Add CopycatExceptions to indicate transient and permanent errors in a connector/task

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2479: Fix Version/s: 0.10.0.0 > Add CopycatExceptions to indicate transient and permanent err

[jira] [Updated] (KAFKA-3597) Enable query ConsoleConsumer and VerifiableProducer if they shutdown cleanly

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3597: Fix Version/s: 0.10.0.0 > Enable query ConsoleConsumer and VerifiableProducer if they shutd

[jira] [Updated] (KAFKA-2658) Implement SASL/PLAIN

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2658: Fix Version/s: 0.10.0.0 > Implement SASL/PLAIN > > >

[jira] [Updated] (KAFKA-3529) Transient kafka.api.PlaintextConsumerTest.testAsyncCommit failures

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3529: Fix Version/s: 0.10.0.0 > Transient kafka.api.PlaintextConsumerTest.testAsyncCommit failu

[jira] [Updated] (KAFKA-3459) Returning zero task configurations from a connector does not properly clean up existing tasks

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3459: Fix Version/s: 0.10.0.0 > Returning zero task configurations from a connector does not prope

[jira] [Updated] (KAFKA-3615) Exclude test jars in CLASSPATH of kafka-run-class.sh

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3615: Fix Version/s: 0.10.0.0 > Exclude test jars in CLASSPATH of kafka-run-class

[jira] [Updated] (KAFKA-2547) Make DynamicConfigManager to use the ZkNodeChangeNotificationListener introduced as part of KAFKA-2211

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2547: Fix Version/s: 0.10.0.0 > Make DynamicConfigManager to use the ZkNodeChangeNotificationListe

[jira] [Updated] (KAFKA-3307) Add ApiVersion request/response and server side handling.

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3307: Fix Version/s: 0.10.0.0 > Add ApiVersion request/response and server side handl

[jira] [Updated] (KAFKA-2800) Update outdated dependencies

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2800: Fix Version/s: 0.10.0.0 > Update outdated dependenc

[jira] [Updated] (KAFKA-3569) commitAsync() sometimes fails with errors

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3569: Fix Version/s: 0.10.0.0 > commitAsync() sometimes fails with err

[jira] [Updated] (KAFKA-3548) Locale is not handled properly in kafka-consumer

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3548: Fix Version/s: 0.10.0.0 > Locale is not handled properly in kafka-consu

[jira] [Updated] (KAFKA-3418) Add section on detecting consumer failures in new consumer javadoc

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3418: Fix Version/s: 0.10.0.0 > Add section on detecting consumer failures in new consumer java

[jira] [Updated] (KAFKA-3461) Fix typos in Kafka web documentations

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3461: Fix Version/s: 0.10.0.0 > Fix typos in Kafka web documentati

[jira] [Updated] (KAFKA-3611) Remove WARNs when using reflections

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3611: Fix Version/s: 0.10.0.0 > Remove WARNs when using reflecti

[jira] [Updated] (KAFKA-3558) Add compression_type parameter to benchmarks in benchmark_test.py

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3558: Fix Version/s: 0.10.0.0 > Add compression_type parameter to benchmarks in benchmark_test

[jira] [Updated] (KAFKA-3563) Maintain MessageAndMetadata constructor compatibility

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3563: Fix Version/s: 0.10.0.0 > Maintain MessageAndMetadata constructor compatibil

[jira] [Updated] (KAFKA-3358) Only request metadata updates once we have topics or a pattern subscription

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3358: Fix Version/s: 0.10.0.0 > Only request metadata updates once we have topics or a patt

[jira] [Updated] (KAFKA-3306) Change metadata response to include required additional fields

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3306: Fix Version/s: 0.10.0.0 > Change metadata response to include required additional fie

[jira] [Updated] (KAFKA-3506) Kafka Connect Task Restart API

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3506: Fix Version/s: 0.10.0.0 > Kafka Connect Task Restart

[jira] [Updated] (KAFKA-2370) Add pause/unpause connector support

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2370: Fix Version/s: 0.10.0.0 > Add pause/unpause connector supp

[jira] [Updated] (KAFKA-1236) Change producer performance tool to optionally use the new producer

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1236: Fix Version/s: 0.10.0.0 > Change producer performance tool to optionally use the new produ

[jira] [Updated] (KAFKA-1554) Corrupt index found on clean startup

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1554: Fix Version/s: 0.10.0.0 > Corrupt index found on clean star

[jira] [Updated] (KAFKA-665) Outgoing responses delayed on a busy Kafka broker

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-665: --- Fix Version/s: 0.10.0.0 > Outgoing responses delayed on a busy Kafka bro

[jira] [Updated] (KAFKA-3605) Connector REST endpoint allows incorrectly overriding the connector name

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3605: Fix Version/s: 0.10.0.0 > Connector REST endpoint allows incorrectly overriding the connector n

[jira] [Updated] (KAFKA-3421) Update docs with new connector features

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3421: Fix Version/s: 0.10.0.0 > Update docs with new connector featu

[jira] [Updated] (KAFKA-3641) Fix RecordMetadata constructor backward compatibility

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3641: Fix Version/s: 0.10.0.0 > Fix RecordMetadata constructor backward compatibil

[jira] [Updated] (KAFKA-3578) Allow cross origin HTTP requests on all HTTP methods

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3578: Fix Version/s: 0.10.0.0 > Allow cross origin HTTP requests on all HTTP meth

[jira] [Updated] (KAFKA-3644) Use Boolean protocol type for StopReplicaRequest delete_partitions

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3644: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Use Boolean protocol t

[jira] [Updated] (KAFKA-3575) Use console consumer access topic that does not exist, can not use "Control + C" to exit process

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3575: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Use console consumer access to

[jira] [Updated] (KAFKA-3634) Add ducktape tests for upgrade with SASL

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3634: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Add ducktape tests for upgr

[jira] [Updated] (KAFKA-3600) Enhance java clients to use ApiVersion Req/Resp to check if the broker they are talking to supports required api versions

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3600: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Enhance java clients to

[jira] [Updated] (KAFKA-3128) Add metrics for ZooKeeper events

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3128: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Add metrics for ZooKeeper eve

[jira] [Updated] (KAFKA-3042) updateIsr should stop after failed several times due to zkVersion issue

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3042: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > updateIsr should stop after fai

[jira] [Updated] (KAFKA-3186) KIP-50: Move Authorizer and related classes to separate package.

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3186: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > KIP-50: Move Authori

[jira] [Updated] (KAFKA-3592) System tests - don't hardcode paths to scripts

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3592: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > System tests - don't hardc

[jira] [Updated] (KAFKA-3517) Document configuration of SASL/PLAIN and multiple mechanisms

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3517: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Document configuration of S

[jira] [Updated] (KAFKA-3520) System tests of config validate and list connectors REST APIs

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3520: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > System tests of config valid

[jira] [Updated] (KAFKA-2955) Add Prompt to kafka-console-producer

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2955: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > Add Prompt to kafka-cons

[jira] [Updated] (KAFKA-3500) KafkaOffsetBackingStore set method needs to handle null

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3500: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > KafkaOffsetBackingStore set met

[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index to Kafka

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3163: Fix Version/s: (was: 0.10.0.0) 0.10.1.0 > KIP-33 - Add a time based

[jira] [Commented] (KAFKA-3173) Error while moving some partitions to OnlinePartition state

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264904#comment-15264904 ] Gwen Shapira commented on KAFKA-3173: - This is marked as critical. [~fpj] and [~ijuma] - are you

[jira] [Commented] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264905#comment-15264905 ] Gwen Shapira commented on KAFKA-3565: - This is marked as critical. [~becket_qin] and [~ijuma

[RELEASE] Final merge of trunk into 0.10.0

2016-04-29 Thread Gwen Shapira
Hi, I just merged trunk into 0.10.0 branch and pushed. 0.10.0 is updated as of commit d0dedc6 (KAFKA-3459: Returning zero task configurations from a connector does not properly clean up existing tasks). Committers: Please cherry-pick only critical bug fixes and/or low-risk changes (preferably

[jira] [Updated] (KAFKA-3641) Fix RecordMetadata constructor backward compatibility

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3641: Resolution: Fixed Fix Version/s: (was: 0.10.0.0) 0.10.1.0

[jira] [Commented] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264627#comment-15264627 ] Gwen Shapira commented on KAFKA-3209: - Thank you Nisarg. I believe [~ewencp] already started working

[jira] [Updated] (KAFKA-3618) Handle ApiVersionRequest before SASL handshake

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3618: Resolution: Fixed Fix Version/s: (was: 0.10.0.0) 0.10.1.0

[jira] [Updated] (KAFKA-3597) Enable query ConsoleConsumer and VerifiableProducer if they shutdown cleanly

2016-04-29 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3597: Resolution: Fixed Fix Version/s: (was: 0.10.0.0) 0.10.1.0

[jira] [Commented] (KAFKA-1880) Add support for checking binary/source compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263347#comment-15263347 ] Gwen Shapira commented on KAFKA-1880: - It is useful already! Thank you for this cool contribution

Re: [Release] Status update

2016-04-28 Thread Gwen Shapira
e: > Thanks for the update Gwen. Looking at that list, it seems to me that the > community did very well in a relatively short period of time (and it > doesn't include the large number of bug fixes, test and documentation > improvements). > > Ismael > > On Thu, Apr 28, 2016 a

[jira] [Comment Edited] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262756#comment-15262756 ] Gwen Shapira edited comment on KAFKA-3633 at 4/28/16 7:04 PM: -- It doesn't

[jira] [Commented] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262756#comment-15262756 ] Gwen Shapira commented on KAFKA-3633: - It doesn't cause immediate issues, but it makes the API more

[Release] Status update

2016-04-28 Thread Gwen Shapira
Hi Team Kafka, Here's a short status update before I am merging trunk into 0.10.0 branch and creating a new release candidate, tomorrow morning. KIPs included in the release: KIP-28 Kafka Streams KIP-31 Relative offsets in compressed messages KIP-32 Add timestamps to messages KIP-36 Rack

[jira] [Commented] (KAFKA-3633) Kafka Consumer API breaking backward compatibility

2016-04-28 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262593#comment-15262593 ] Gwen Shapira commented on KAFKA-3633: - I completely understand the pain that this change will cause

[jira] [Commented] (KAFKA-3631) Recent addition of "nullable array" to MetadataRequest is breaking MirrorMaker system tests

2016-04-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261069#comment-15261069 ] Gwen Shapira commented on KAFKA-3631: - More important, our network processor got that NPE: {code

[jira] [Updated] (KAFKA-3631) Recent addition of "nullable array" to MetadataRequest is breaking MirrorMaker system tests

2016-04-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3631: Assignee: Grant Henke > Recent addition of "nullable array" to MetadataReques

[jira] [Created] (KAFKA-3631) Recent addition of "nullable array" to MetadataRequest is breaking MirrorMaker system tests

2016-04-27 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-3631: --- Summary: Recent addition of "nullable array" to MetadataRequest is breaking MirrorMaker system tests Key: KAFKA-3631 URL: https://issues.apache.org/jira/browse/

Re: [VOTE] KIP-56 Allow cross origin HTTP requests on all HTTP methods

2016-04-27 Thread Gwen Shapira
+1 On Thu, Apr 21, 2016 at 10:30 AM, Liquan Pei wrote: > Hi > > I would like to start vote on KIP-56. > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-56%3A+Allow+cross+origin+HTTP+requests+on+all+HTTP+methods > > Thanks, > > -- > Liquan Pei > Software Engineer,

[jira] [Updated] (KAFKA-3307) Add ApiVersion request/response and server side handling.

2016-04-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3307: Resolution: Fixed Fix Version/s: (was: 0.10.0.0) 0.10.1.0

[jira] [Updated] (KAFKA-3306) Change metadata response to include required additional fields

2016-04-26 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3306: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

Re: [ANNOUNCE] New committer: Ismael Juma

2016-04-26 Thread Gwen Shapira
Congratulations, very well deserved. On Apr 25, 2016 10:53 PM, "Neha Narkhede" wrote: > The PMC for Apache Kafka has invited Ismael Juma to join as a committer and > we are pleased to announce that he has accepted! > > Ismael has contributed 121 commits >

Re: [VOTE] KIP-57: Interoperable LZ4 Framing

2016-04-25 Thread Gwen Shapira
+1 On Mon, Apr 25, 2016 at 2:26 PM, Dana Powers wrote: > Hi all, > > Initiating a vote thread because the KIP-57 proposal is specific to > the 0.10 release. > > KIP-57 can be accessed here: >

Re: KIP-57: Interoperable LZ4 Framing

2016-04-25 Thread Gwen Shapira
Hi Dana, Thank you for proposing this fix. It looks great to me (and LinkedIn, who are running trunk confirmed that they did not use LZ4 yet). Since for 0.10.0 time is of essence, do you mind starting a voting thread in parallel? Gwen On Mon, Apr 25, 2016 at 9:30 AM, Dana Powers

Re: [VOTE] KIP-50: Move Authorizer to o.a.k.common package - Round 2

2016-04-25 Thread Gwen Shapira
+1 On Mon, Apr 25, 2016 at 10:04 AM, Ashish Singh wrote: > Hey Guys, > > I would like to re-initiate the voting process for KIP-50: Move Authorizer > to o.a.k.common package. KIP-50 is available here >

[jira] [Updated] (KAFKA-3605) Connector REST endpoint allows incorrectly overriding the connector name

2016-04-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3605: Resolution: Fixed Fix Version/s: (was: 0.10.0.0) 0.10.1.0

Re: [VOTE] KIP-35: Retrieve protocol version - Round 2

2016-04-21 Thread Gwen Shapira
+1 On Thu, Apr 21, 2016 at 4:48 PM, Ashish Singh wrote: > Hey Guys, > > I would like to re-initiate the voting process for *KIP-35: Retrieve > protocol version*. > > KIP-35 can be accessed here >

Re: [DISCUSS] KIP-50 - Enhance Authorizer interface to be aware of supported Principal Types

2016-04-21 Thread Gwen Shapira
orizer jar would make sense. But in the >> current approach I think the authorizer stuff would be most consistent as a >> public package in common. It is true that this means you build against more >> stuff then needed but I'm not sure this has any negative implicat

Re: [DISCUSS] KIP-35 - Retrieve protocol version

2016-04-21 Thread Gwen Shapira
Lets start a vote immediately? We are short of time toward the release. On Thu, Apr 21, 2016 at 2:57 PM, Ashish Singh wrote: > Hey Guys, > > KIP-35 > > has been updated based on latest

Re: [DISCUSS] KIP-50 - Enhance Authorizer interface to be aware of supported Principal Types

2016-04-20 Thread Gwen Shapira
horizer stuff would be most consistent as a >> public package in common. It is true that this means you build against more >> stuff then needed but I'm not sure this has any negative implications in >> practice. >> >> -Jay >> >> On Wed, Apr 20, 2016 at 4:17

[jira] [Updated] (KAFKA-3548) Locale is not handled properly in kafka-consumer

2016-04-20 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-3548: Resolution: Fixed Fix Version/s: (was: 0.10.0.0) 0.10.1.0

[jira] [Commented] (KAFKA-3480) Autogenerate metrics documentation

2016-04-20 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251080#comment-15251080 ] Gwen Shapira commented on KAFKA-3480: - Sorry for the delay James. I'm a bit busy at the moment

<    3   4   5   6   7   8   9   10   11   12   >