[jira] [Updated] (KAFKA-3802) log mtimes reset on broker restart

2016-06-15 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-3802: --- Status: Patch Available (was: Open) > log mtimes reset on broker restart >

Jenkins build is back to normal : kafka-trunk-jdk8 #699

2016-06-15 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332996#comment-15332996 ] Jason Gustafson commented on KAFKA-3144: [~junrao], [~vahid] Another helpful feature would be to

[jira] [Commented] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332964#comment-15332964 ] ASF GitHub Bot commented on KAFKA-3850: --- GitHub user hachikuji reopened a pull request:

[jira] [Commented] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332963#comment-15332963 ] ASF GitHub Bot commented on KAFKA-3850: --- Github user hachikuji closed the pull request at:

[jira] [Updated] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3850: --- Status: Patch Available (was: Open) > WorkerSinkTask should retry commits if woken up during

[GitHub] kafka pull request #1511: KAFKA-3850: WorkerSinkTask commit prior to rebalan...

2016-06-15 Thread hachikuji
Github user hachikuji closed the pull request at: https://github.com/apache/kafka/pull/1511 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-3850) WorkerSinkTask should retry commits if woken up during rebalance or shutdown

2016-06-15 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3850: -- Summary: WorkerSinkTask should retry commits if woken up during rebalance or shutdown Key: KAFKA-3850 URL: https://issues.apache.org/jira/browse/KAFKA-3850

[GitHub] kafka pull request #1511: KAFKA-3850: WorkerSinkTask commit prior to rebalan...

2016-06-15 Thread hachikuji
GitHub user hachikuji reopened a pull request: https://github.com/apache/kafka/pull/1511 KAFKA-3850: WorkerSinkTask commit prior to rebalance should be retried on wakeup You can merge this pull request into a Git repository by running: $ git pull

[jira] [Updated] (KAFKA-2720) Periodic purging groups in the coordinator

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2720: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[jira] [Commented] (KAFKA-2720) Periodic purging groups in the coordinator

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332949#comment-15332949 ] ASF GitHub Bot commented on KAFKA-2720: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1427: KAFKA-2720: expire group metadata when all offsets...

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-06-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332913#comment-15332913 ] ASF GitHub Bot commented on KAFKA-3443: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1477: KAFKA-3443 [Kafka Stream] support for adding sourc...

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1477 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3443: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

Build failed in Jenkins: kafka-trunk-jdk8 #698

2016-06-15 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3753: Add approximateNumEntries() method to KeyValueStore -- [...truncated 12519 lines...] org.apache.kafka.connect.runtime.WorkerTest > testAddConnectorByAlias

[GitHub] kafka pull request #1511: KAFKA-XXXX: WorkerSinkTask commit prior to rebalan...

2016-06-15 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1511 KAFKA-: WorkerSinkTask commit prior to rebalance should be retried on wakeup You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request #1486: KAFKA-3753: Add approximateNumEntries() method to ...

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1486 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

RE: Embedding zookeeper and kafka in java process.

2016-06-15 Thread Subhash Agrawal
Thanks for quick response. I started zookeeper via zookeeper-server-start.bat and started kafka via my java process and I saw same error. But if I start zookeeper via java process and start kafka via kafka-server-start.bat, t works fine. It means it is not caused due to both getting started in

[jira] [Commented] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332801#comment-15332801 ] Vahid Hashemian commented on KAFKA-3818: [~granthenke] I believe the problem you mentioned still

[jira] [Comment Edited] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332798#comment-15332798 ] Jason Gustafson edited comment on KAFKA-3818 at 6/15/16 11:04 PM: --

[jira] [Commented] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332798#comment-15332798 ] Jason Gustafson commented on KAFKA-3818: [~granthenke] Good question. The round robin assignor

Re: Embedding zookeeper and kafka in java process.

2016-06-15 Thread Guozhang Wang
It seems "scala.MatchError: null" are not related to the settings that ZK and Kafka is embedded in the same process, and the only case that I can think of related is this: https://issues.apache.org/jira/browse/KAFKA-940. Could you clarify if you start these two services on two processes, the

Re: Embedding zookeeper and kafka in java process.

2016-06-15 Thread Flavio Junqueira
> On 15 Jun 2016, at 21:56, Subhash Agrawal wrote: > > [2016-06-15 13:39:39,808] DEBUG [ZkClient-EventThread-24-localhost:2181] > [Channel manager on controller 0]: Controller 0 trying to connect to broker 0 > (kafka.controller.ControllerChannelManager) The controller

Re: Memory consumption of Kafka-examples Kafka-streams around 1.5 GB

2016-06-15 Thread Philippe Derome
Guozhang, No two in particular, at first it was simply the last two that the target would choose: SumLambdaIntegrationTest and WordCountLambdaIntegrationTest . I tried another couple to exclude and it was fine as well. There's one Scala test that is included in the run and I run it as well as 7/9

[jira] [Commented] (KAFKA-3536) ReplicaFetcherThread should not log errors when leadership changes

2016-06-15 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332767#comment-15332767 ] Jason Rosenberg commented on KAFKA-3536: which version are you seeing this in (I'm seeing it just

Re: Complexe Event Processing on top of KafkaStreams

2016-06-15 Thread Guozhang Wang
Hello Florian, Thanks for your interests! As mentioned in our release notes we are considering to add the SQL support (e.g. using Calcite) on top of Kafka Streams as a near-term future work. My own experience with CEP originates completely from a research project called "Cayuga" from my grad

Re: Memory consumption of Kafka-examples Kafka-streams around 1.5 GB

2016-06-15 Thread Guozhang Wang
Hello Phillippe, I used to run the "SimpleBenchmark" on my laptop with 4GB also, and it usually used close to, but less than 1GB. https://www.codatlas.com/github.com/apache/kafka/HEAD/streams/src/test/java/org/apache/kafka/streams/perf/SimpleBenchmark.java Note that I need to bootstrap a real

[jira] [Commented] (KAFKA-3822) Kafka Consumer close() hangs indefinitely if Kafka Broker shutdown while connected

2016-06-15 Thread Alexander Cook (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332736#comment-15332736 ] Alexander Cook commented on KAFKA-3822: --- I got to try this out today, and you are correct. This only

[jira] [Created] (KAFKA-3849) Make consumer poll time in MirrorMaker configurable.

2016-06-15 Thread Ashish K Singh (JIRA)
Ashish K Singh created KAFKA-3849: - Summary: Make consumer poll time in MirrorMaker configurable. Key: KAFKA-3849 URL: https://issues.apache.org/jira/browse/KAFKA-3849 Project: Kafka Issue

[jira] [Commented] (KAFKA-3693) Race condition between highwatermark-checkpoint thread and handleLeaderAndIsrRequest at broker start-up

2016-06-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332684#comment-15332684 ] Jun Rao commented on KAFKA-3693: [~maysamyabandeh], that by itself may not be a bad idea. We will have to

[jira] [Commented] (KAFKA-3059) ConsumerGroupCommand should allow resetting offsets for consumer groups

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332660#comment-15332660 ] Guozhang Wang commented on KAFKA-3059: -- Chiming in here since Streams may need this feature as well

Jenkins build is back to normal : kafka-trunk-jdk8 #697

2016-06-15 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3059) ConsumerGroupCommand should allow resetting offsets for consumer groups

2016-06-15 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332649#comment-15332649 ] Henry Cai commented on KAFKA-3059: -- We would like to have the capability to move the offset to a certain

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-15 Thread Jun Rao
Hi, Rajini, Thanks for the updated wiki. Overall, I like the new approach. It covers the common use cases now, is extensible, and is backward compatible. A few comments below. 1. It would be useful to describe a bit at the high level, how the new approach works. I think this can be summarized as

[jira] [Commented] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

2016-06-15 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332632#comment-15332632 ] Bharat Viswanadham commented on KAFKA-3837: --- Hi Simon, I will update the code to print thread

[jira] [Updated] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

2016-06-15 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-3837: -- Status: Open (was: Patch Available) > Report the name of the blocking thread when

[jira] [Work started] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

2016-06-15 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3837 started by Bharat Viswanadham. - > Report the name of the blocking thread when throwing >

[jira] [Commented] (KAFKA-3693) Race condition between highwatermark-checkpoint thread and handleLeaderAndIsrRequest at broker start-up

2016-06-15 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332618#comment-15332618 ] Maysam Yabandeh commented on KAFKA-3693: Thinking more about this, the complexity seems to stem

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332583#comment-15332583 ] James Cheng commented on KAFKA-3848: Better documentation might help. Unfortunately, setting

Re: [DISCUSS] KIP-4 Create Topic Schema

2016-06-15 Thread Grant Henke
Turns out we already have an InvalidRequestException: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/network/RequestChannel.scala#L75-L98 We just don't map it in Errors.java so it results in an UNKNOWN error when sent back to the client. I will migrate the

Embedding zookeeper and kafka in java process.

2016-06-15 Thread Subhash Agrawal
Hi All, I am embedding Kafka 0.10.0 and corresponding zookeeper in java process. In this process, I start zookeeper first and then wait for 10 seconds and then start kafka. These are all running in the same process. Toward the end of kafka startup, I see following exception. It seems zookeeper

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Clarke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332534#comment-15332534 ] James Clarke commented on KAFKA-3848: - Thanks for the quick rely. I think you might be right with

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332529#comment-15332529 ] James Cheng commented on KAFKA-3848: Somewhat related to

[jira] [Commented] (KAFKA-3818) Change Mirror Maker default assignment strategy to round robin

2016-06-15 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332524#comment-15332524 ] Grant Henke commented on KAFKA-3818: A few older threads mention that its possible to get clumping

[jira] [Commented] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332480#comment-15332480 ] James Cheng commented on KAFKA-3848: This behavior may be related to the value of auto.offset.reset.

Jenkins build is back to normal : kafka-trunk-jdk7 #1362

2016-06-15 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #696

2016-06-15 Thread Apache Jenkins Server
See Changes: [harsha] KAFKA-3830; getTGT() debug logging exposes confidential information -- [...truncated 12504 lines...] org.apache.kafka.connect.runtime.WorkerTest > testAddConnectorByAlias

Re: [DISCUSS] KIP-4 Create Topic Schema

2016-06-15 Thread Dana Powers
On Wed, Jun 15, 2016 at 12:19 PM, Ismael Juma wrote: > Hi Grant, > > Comments below. > > On Wed, Jun 15, 2016 at 6:52 PM, Grant Henke wrote: >> >> The one thing I want to avoid is to many super specific error codes. I am >> not sure how much of a problem

[jira] [Created] (KAFKA-3848) Mirror Maker sometimes fails to mirror first batch of messages

2016-06-15 Thread James Clarke (JIRA)
James Clarke created KAFKA-3848: --- Summary: Mirror Maker sometimes fails to mirror first batch of messages Key: KAFKA-3848 URL: https://issues.apache.org/jira/browse/KAFKA-3848 Project: Kafka

Re: [DISCUSS] KIP-4 Create Topic Schema

2016-06-15 Thread Ismael Juma
Hi Grant, Comments below. On Wed, Jun 15, 2016 at 6:52 PM, Grant Henke wrote: > > The one thing I want to avoid is to many super specific error codes. I am > not sure how much of a problem it really is but in the case of wire > protocol errors like multiple instances of the

[GitHub] kafka pull request #1501: MINOR: Expose window store sequence number

2016-06-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1501 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-3753) Add approximateNumEntries() to the StateStore interface for metrics reporting

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3753: - Assignee: Jeff Klukas (was: Guozhang Wang) > Add approximateNumEntries() to the StateStore

[jira] [Updated] (KAFKA-3701) Expose KafkaStreams metrics in public API

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3701: - Assignee: (was: Guozhang Wang) > Expose KafkaStreams metrics in public API >

[jira] [Updated] (KAFKA-3836) KStreamReduce and KTableReduce should not pass nulls to Deserializers

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3836: - Assignee: (was: Guozhang Wang) > KStreamReduce and KTableReduce should not pass nulls to

[jira] [Updated] (KAFKA-3535) Add metrics ability for streams serde components

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3535: - Assignee: (was: Guozhang Wang) > Add metrics ability for streams serde components >

[jira] [Updated] (KAFKA-3545) Generalized Serdes for List/Map

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3545: - Assignee: (was: Guozhang Wang) > Generalized Serdes for List/Map >

[jira] [Updated] (KAFKA-3545) Generalized Serdes for List/Map

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3545: - Labels: api newbie (was: api) > Generalized Serdes for List/Map >

[jira] [Updated] (KAFKA-3595) Add capability to specify replication compact option for stream store

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3595: - Assignee: (was: Guozhang Wang) > Add capability to specify replication compact option for

[jira] [Updated] (KAFKA-3752) Provide a way for KStreams to recover from unclean shutdown

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3752: - Assignee: (was: Guozhang Wang) > Provide a way for KStreams to recover from unclean shutdown

[jira] [Updated] (KAFKA-3576) Unify KStream and KTable API

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3576: - Assignee: Damian Guy (was: Guozhang Wang) > Unify KStream and KTable API >

[jira] [Updated] (KAFKA-3741) KStream config for changelog min.in.sync.replicas

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3741: - Assignee: (was: Guozhang Wang) > KStream config for changelog min.in.sync.replicas >

[jira] [Updated] (KAFKA-3770) KStream job should be able to specify linger.ms

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3770: - Assignee: Greg Fodor (was: Guozhang Wang) > KStream job should be able to specify linger.ms >

[jira] [Updated] (KAFKA-3708) Rethink exception handling in KafkaStreams

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3708: - Assignee: (was: Guozhang Wang) > Rethink exception handling in KafkaStreams >

[jira] [Updated] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3729: - Labels: api newbie (was: api) > Auto-configure non-default SerDes passed alongside the topology

[jira] [Updated] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3729: - Assignee: (was: Guozhang Wang) > Auto-configure non-default SerDes passed alongside the

[jira] [Updated] (KAFKA-3543) Allow a variant of transform() which can emit multiple values

2016-06-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3543: - Assignee: (was: Guozhang Wang) > Allow a variant of transform() which can emit multiple

[jira] [Created] (KAFKA-3847) Connect tasks should not share a producer

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3847: Summary: Connect tasks should not share a producer Key: KAFKA-3847 URL: https://issues.apache.org/jira/browse/KAFKA-3847 Project: Kafka

[jira] [Updated] (KAFKA-3400) Topic stop working / can't describe topic

2016-06-15 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-3400: -- Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) Resolving this as

[jira] [Updated] (KAFKA-3820) Provide utilities for tracking source offsets

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3820: - Labels: needs-kip (was: ) > Provide utilities for tracking source offsets >

[jira] [Updated] (KAFKA-2483) Add support for batch/scheduled Copycat connectors

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2483: - Labels: needs-kip (was: ) > Add support for batch/scheduled Copycat connectors >

[jira] [Updated] (KAFKA-3819) Provide utilities for polling source connectors

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3819: - Labels: needs-kip (was: ) > Provide utilities for polling source connectors >

[jira] [Updated] (KAFKA-3815) Support command line arguments in Kafka Connect distributed worker

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3815: - Labels: needs-kip (was: ) > Support command line arguments in Kafka Connect

[jira] [Updated] (KAFKA-2378) Add Copycat embedded API

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2378: - Labels: needs-kip (was: ) > Add Copycat embedded API >

[jira] [Updated] (KAFKA-3254) Add Connect storage topic prefix for easier configuration

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3254: - Labels: needs-kip (was: ) > Add Connect storage topic prefix for easier

[jira] [Updated] (KAFKA-2376) Add Copycat metrics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2376: - Labels: needs-kip (was: ) > Add Copycat metrics > --- > >

[jira] [Updated] (KAFKA-3813) Let SourceConnector implementations access the offset reader

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3813: - Labels: needs-kip (was: ) > Let SourceConnector implementations access the

[jira] [Updated] (KAFKA-3821) Allow Kafka Connect source tasks to produce offset without writing to topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3821: - Labels: needs-kip (was: ) > Allow Kafka Connect source tasks to produce offset

[jira] [Updated] (KAFKA-3073) KafkaConnect should support regular expression for topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3073: - Labels: needs-kip (was: ) > KafkaConnect should support regular expression for

[jira] [Updated] (KAFKA-3487) Support per-connector/per-task classloaders in Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3487: - Labels: needs-kip (was: ) > Support per-connector/per-task classloaders in

[jira] [Updated] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3209: - Labels: needs-kip (was: ) > Support single message transforms in Kafka Connect >

[jira] [Created] (KAFKA-3846) Connect record types should include timestamps

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3846: Summary: Connect record types should include timestamps Key: KAFKA-3846 URL: https://issues.apache.org/jira/browse/KAFKA-3846 Project: Kafka

[jira] [Created] (KAFKA-3845) Support per-connector converters

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3845: Summary: Support per-connector converters Key: KAFKA-3845 URL: https://issues.apache.org/jira/browse/KAFKA-3845 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-3845) Support per-connector converters

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3845: - Issue Type: Improvement (was: Bug) > Support per-connector converters >

[jira] [Updated] (KAFKA-3351) Kafka Connect Rest restarts all connectors on POST or DELETE

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3351: - Fix Version/s: (was: 0.10.1.0) > Kafka Connect Rest restarts all connectors

[jira] [Updated] (KAFKA-2483) Add support for batch/scheduled Copycat connectors

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2483: - Fix Version/s: (was: 0.10.1.0) > Add support for batch/scheduled Copycat

[jira] [Updated] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3209: - Priority: Critical (was: Major) > Support single message transforms in Kafka

[jira] [Updated] (KAFKA-3832) Kafka Connect's JSON Converter never outputs a null value

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3832: - Fix Version/s: 0.10.1.0 > Kafka Connect's JSON Converter never outputs a null

[jira] [Comment Edited] (KAFKA-2925) NullPointerException if FileStreamSinkTask is stopped before initialization finishes

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332159#comment-15332159 ] Ewen Cheslack-Postava edited comment on KAFKA-2925 at 6/15/16 5:38 PM:

[jira] [Commented] (KAFKA-2925) NullPointerException if FileStreamSinkTask is stopped before initialization finishes

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332159#comment-15332159 ] Ewen Cheslack-Postava commented on KAFKA-2925: -- [~hachikuji] Can you remember if we've gotten

[jira] [Updated] (KAFKA-2941) Docs for key/value converter in Kafka connect are unclear

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2941: - Fix Version/s: 0.10.1.0 > Docs for key/value converter in Kafka connect are

[jira] [Updated] (KAFKA-2941) Docs for key/value converter in Kafka connect are unclear

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2941: - Priority: Blocker (was: Minor) Bumping up the priority here as there's a

[jira] [Updated] (KAFKA-3054) Connect Herder fail forever if sent a wrong connector config or task config

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3054: - Priority: Blocker (was: Major) Fix Version/s: 0.10.1.0 We improved

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-15 Thread Rajini Sivaram
Harsha, The sample configuration under https://cwiki.apache.org/confluence/display/KAFKA/KIP-55%3A+Secure+Quotas+for+Authenticated+Users#KIP-55:SecureQuotasforAuthenticatedUsers-QuotaConfiguration shows the Zookeeper data for different scenarios. - *user1* (/users/user1 in ZK) has only

[jira] [Updated] (KAFKA-3008) Connect should parallelize task start/stop

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3008: - Priority: Minor (was: Major) > Connect should parallelize task start/stop >

[jira] [Updated] (KAFKA-3209) Support single message transforms in Kafka Connect

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3209: - Fix Version/s: 0.10.1.0 > Support single message transforms in Kafka Connect >

[jira] [Updated] (KAFKA-2378) Add Copycat embedded API

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2378: - Fix Version/s: (was: 0.10.1.0) > Add Copycat embedded API >

[jira] [Updated] (KAFKA-3073) KafkaConnect should support regular expression for topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3073: - Issue Type: Improvement (was: Bug) > KafkaConnect should support regular

[jira] [Updated] (KAFKA-3073) KafkaConnect should support regular expression for topics

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3073: - Fix Version/s: 0.10.1.0 > KafkaConnect should support regular expression for

[jira] [Updated] (KAFKA-3816) Provide more context in Kafka Connect log messages

2016-06-15 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3816: - Priority: Critical (was: Major) > Provide more context in Kafka Connect log

  1   2   >