[jira] [Updated] (KAFKA-4517) Remove kafka-consumer-offset-checker.sh script since already deprecated in Kafka 9

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4517: - Priority: Blocker (was: Minor) > Remove kafka-consumer-offset-checker.sh scr

[jira] [Commented] (KAFKA-4517) Remove kafka-consumer-offset-checker.sh script since already deprecated in Kafka 9

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788842#comment-15788842 ] Ewen Cheslack-Postava commented on KAFKA-4517: -- Upgraded to blocker

[jira] [Updated] (KAFKA-4517) Remove kafka-consumer-offset-checker.sh script since already deprecated in Kafka 9

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4517: - Fix Version/s: 0.11.0.0 > Remove kafka-consumer-offset-checker.sh script si

[jira] [Resolved] (KAFKA-4530) cant stop kafka server

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4530. -- Resolution: Duplicate Assignee: Ewen Cheslack-Postava > cant stop ka

[jira] [Commented] (KAFKA-4531) Rationalise client configuration validation

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788707#comment-15788707 ] Ewen Cheslack-Postava commented on KAFKA-4531: -- Could we bake this

[jira] [Updated] (KAFKA-3856) Move inner classes accessible only functions in TopologyBuilder out of public APIs

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3856: - Assignee: Matthias J. Sax (was: Jeyhun Karimov) > Move inner classes accessi

[jira] [Commented] (KAFKA-3856) Move inner classes accessible only functions in TopologyBuilder out of public APIs

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788683#comment-15788683 ] Ewen Cheslack-Postava commented on KAFKA-3856: -- [~mjsax] 6mo seems

[jira] [Commented] (KAFKA-3135) Unexpected delay before fetch response transmission

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788679#comment-15788679 ] Ewen Cheslack-Postava commented on KAFKA-3135: -- Also, /cc [~hachikuji] s

[jira] [Commented] (KAFKA-3135) Unexpected delay before fetch response transmission

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788677#comment-15788677 ] Ewen Cheslack-Postava commented on KAFKA-3135: -- [~jeffwidman] I'v

[jira] [Updated] (KAFKA-3135) Unexpected delay before fetch response transmission

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3135: - Affects Version/s: 0.10.1.0 0.9.0.1

[jira] [Commented] (KAFKA-3539) KafkaProducer.send() may block even though it returns the Future

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788664#comment-15788664 ] Ewen Cheslack-Postava commented on KAFKA-3539: -- http://

[jira] [Commented] (KAFKA-4550) current trunk unstable

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788627#comment-15788627 ] Ewen Cheslack-Postava commented on KAFKA-4550: -- One of the failures repo

[jira] [Commented] (KAFKA-4550) current trunk unstable

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788626#comment-15788626 ] Ewen Cheslack-Postava commented on KAFKA-4550: -- Seems like the second i

[jira] [Commented] (KAFKA-4514) Add Codec for ZStandard Compression

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788615#comment-15788615 ] Ewen Cheslack-Postava commented on KAFKA-4514: -- How broadly is zstd b

[jira] [Commented] (KAFKA-4556) unordered messages when multiple topics are combined in single topic through stream

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788347#comment-15788347 ] Ewen Cheslack-Postava commented on KAFKA-4556: -- Can you be more spec

Re: Please add my wiki username contributor permission list

2016-12-30 Thread Ewen Cheslack-Postava
I've granted you permissions, you should now be able to edit the main KIP page and add a new KIP. -Ewen On Fri, Dec 30, 2016 at 2:58 PM, Aarti Gupta wrote: > Hey devs, > > My jira username is aartigupta > and my wiki username happens to be aartiguptaa > (not sure how that happened) > > I alrea

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

2016-12-30 Thread Ewen Cheslack-Postava
g implemented by > > > > connectors in divergent ways: RegexRouter, Insert, Replace, > > > HoistToStruct, > > > > ExtractFromStruct > > > > > > > > On Wed, Dec 14, 2016 at 6:00 PM Gwen Shapira > > wrote: > > > > >

[jira] [Commented] (KAFKA-4572) Kafka connect for windows is missing

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788234#comment-15788234 ] Ewen Cheslack-Postava commented on KAFKA-4572: -- [~vahid] The versio

[jira] [Commented] (KAFKA-3297) More optimally balanced partition assignment strategy (new consumer)

2016-12-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788229#comment-15788229 ] Ewen Cheslack-Postava commented on KAFKA-3297: -- Yeah, part of

[jira] [Updated] (KAFKA-2196) remove roundrobin identical topic constraint in consumer coordinator

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2196: - Fix Version/s: 0.9.0.0 > remove roundrobin identical topic constraint in consu

[jira] [Commented] (KAFKA-2196) remove roundrobin identical topic constraint in consumer coordinator

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786960#comment-15786960 ] Ewen Cheslack-Postava commented on KAFKA-2196: -- Based on git history, l

[jira] [Commented] (KAFKA-3297) More optimally balanced partition assignment strategy (new consumer)

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786948#comment-15786948 ] Ewen Cheslack-Postava commented on KAFKA-3297: -- [~jeffwidman] I don

[jira] [Updated] (KAFKA-3297) More optimally balanced partition assignment strategy (new consumer)

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3297: - Component/s: consumer > More optimally balanced partition assignment strat

[jira] [Commented] (KAFKA-3502) Build is killed during kafka streams tests due to `pure virtual method called` error

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786941#comment-15786941 ] Ewen Cheslack-Postava commented on KAFKA-3502: -- I've seen this in

[jira] [Commented] (KAFKA-2019) Old consumer RoundRobinAssignor clusters by consumer

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786931#comment-15786931 ] Ewen Cheslack-Postava commented on KAFKA-2019: -- [~jeffwidman] I updated

[jira] [Updated] (KAFKA-2019) Old consumer RoundRobinAssignor clusters by consumer

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2019: - Summary: Old consumer RoundRobinAssignor clusters by consumer (was

[jira] [Commented] (KAFKA-2331) Kafka does not spread partitions in a topic among all consumers evenly

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786920#comment-15786920 ] Ewen Cheslack-Postava commented on KAFKA-2331: -- This seems like a sepa

[jira] [Updated] (KAFKA-2331) Kafka does not spread partitions in a topic among all consumers evenly

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2331: - Component/s: (was: core) consumer clients

[jira] [Comment Edited] (KAFKA-4567) Connect Producer and Consumer ignore ssl parameters configured for worker

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786745#comment-15786745 ] Ewen Cheslack-Postava edited comment on KAFKA-4567 at 12/30/16 3:1

[jira] [Commented] (KAFKA-4567) Connect Producer and Consumer ignore ssl parameters configured for worker

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786745#comment-15786745 ] Ewen Cheslack-Postava commented on KAFKA-4567: -- Given some future secu

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786719#comment-15786719 ] Ewen Cheslack-Postava commented on KAFKA-2260: -- [~wwarshaw] That so

[jira] [Commented] (KAFKA-4570) How to transfer extended fields in producing or consuming requests.

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786713#comment-15786713 ] Ewen Cheslack-Postava commented on KAFKA-4570: -- [~zander] You'r

[jira] [Commented] (KAFKA-4571) Consumer fails to retrieve messages if started before producer

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786707#comment-15786707 ] Ewen Cheslack-Postava commented on KAFKA-4571: -- Since another consumer g

[jira] [Updated] (KAFKA-4115) Grow default heap settings for distributed Connect from 256M to 1G

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4115: - Fix Version/s: 0.10.2.0 > Grow default heap settings for distributed Connect f

[jira] [Commented] (KAFKA-3947) kafka-reassign-partitions.sh should support dumping current assignment

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786244#comment-15786244 ] Ewen Cheslack-Postava commented on KAFKA-3947: -- [~kawamuray] Any progres

[jira] [Updated] (KAFKA-4404) Add knowledge of sign to numeric schema types

2016-12-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4404: - Fix Version/s: 0.10.2.0 Status: Patch Available (was: Open) >

[jira] [Resolved] (KAFKA-4092) retention.bytes should not be allowed to be less than segment.bytes

2016-12-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4092. -- Resolution: Fixed Reviewer: Ewen Cheslack-Postava Fix Version/s

[jira] [Updated] (KAFKA-4551) StreamsSmokeTest.test_streams intermittent failure

2016-12-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4551: - Labels: system-test-failure (was: ) > StreamsSmokeTest.test_streams intermitt

[jira] [Updated] (KAFKA-4551) StreamsSmokeTest.test_streams intermittent failure

2016-12-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4551: - Assignee: Damian Guy > StreamsSmokeTest.test_streams intermittent fail

[jira] [Commented] (KAFKA-4551) StreamsSmokeTest.test_streams intermittent failure

2016-12-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15779574#comment-15779574 ] Ewen Cheslack-Postava commented on KAFKA-4551: -- Another case of this t

[jira] [Updated] (KAFKA-4551) StreamsSmokeTest.test_streams intermittent failure

2016-12-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4551: - Fix Version/s: 0.10.1.2 > StreamsSmokeTest.test_streams intermittent fail

[jira] [Commented] (KAFKA-4558) throttling_test fails if the producer starts too fast.

2016-12-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15776893#comment-15776893 ] Ewen Cheslack-Postava commented on KAFKA-4558: -- And this is also happe

[jira] [Resolved] (KAFKA-4527) Transient failure of ConnectDistributedTest.test_pause_and_resume_sink where paused connector produces messages

2016-12-24 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4527. -- Resolution: Fixed Reviewer: Ewen Cheslack-Postava > Transient failure

[jira] [Commented] (KAFKA-4558) throttling_test fails if the producer starts too fast.

2016-12-23 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773299#comment-15773299 ] Ewen Cheslack-Postava commented on KAFKA-4558: -- There's another

[jira] [Updated] (KAFKA-4553) Connect's round robin assignment produces undesirable distribution of connectors/tasks

2016-12-17 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4553: - Status: Patch Available (was: Open) > Connect's round robin assignment

[jira] [Created] (KAFKA-4553) Connect's round robin assignment produces undesirable distribution of connectors/tasks

2016-12-17 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4553: Summary: Connect's round robin assignment produces undesirable distribution of connectors/tasks Key: KAFKA-4553 URL: https://issues.apache.org/jira/browse/

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

2016-12-15 Thread Ewen Cheslack-Postava
ng, both options > end > > up > > > looking pretty similar (in terms of how transformations are implemented > > and > > > the runtime initializes and uses them) and I'm starting to lean towards > > not > > > adding a new interface into the mix. >

Re: [DISCUSS] KIP-102 - Add close with timeout for consumers

2016-12-15 Thread Ewen Cheslack-Postava
Rajini, Thanks for this KIP, I'd definitely like to see this. Connect has had a long-standing TODO around stopping sink tasks where we can't properly manage the rebalance process (which involves stopping consumers) because we lack a timeout here. Not a huge problem in practice, but would be nice t

[jira] [Created] (KAFKA-4527) Transient failure of ConnectDistributedTest.test_pause_and_resume_sink where paused connector produces messages

2016-12-12 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4527: Summary: Transient failure of ConnectDistributedTest.test_pause_and_resume_sink where paused connector produces messages Key: KAFKA-4527 URL: https

[jira] [Commented] (KAFKA-4526) Transient failure in ThrottlingTest.test_throttled_reassignment

2016-12-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743246#comment-15743246 ] Ewen Cheslack-Postava commented on KAFKA-4526: -- re: related test fail

[jira] [Created] (KAFKA-4526) Transient failure in ThrottlingTest.test_throttled_reassignment

2016-12-12 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4526: Summary: Transient failure in ThrottlingTest.test_throttled_reassignment Key: KAFKA-4526 URL: https://issues.apache.org/jira/browse/KAFKA-4526

[jira] [Resolved] (KAFKA-4140) Update system tests to allow running tests in parallel

2016-12-11 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4140. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

2016-12-11 Thread Ewen Cheslack-Postava
throw new IllegalArgumentException( > > String.format("Tombstone must be true if null > value")); > > } > > this.topic = topic; > > this.partition = partition; > > this.tombstone = tombstone; > >

Re: [VOTE] KIP-100 - Relax Type constraints in Kafka Streams API

2016-12-11 Thread Ewen Cheslack-Postava
+1 (binding) My only concern was around compatibility. It seems like the one case it is incompatible would be, at worst, an extremely unusual edge case (and I *think* can be restricted further to "not source compatible for anyone extending the affected classes / interfaces and override affected me

Re: [DISCUSS] KIP-66 Kafka Connect Transformers for messages

2016-12-10 Thread Ewen Cheslack-Postava
e/display/KAFKA/ > Connect+Transforms+-+Proposed+Design > > I'd welcome your feedback and comments. > > Thanks, > > Shikhar > > On Tue, Aug 2, 2016 at 7:21 PM Ewen Cheslack-Postava > wrote: > > On Thu, Jul 28, 2016 at 11:58 PM, Shikhar Bhushan > wrote: > >

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2016-12-10 Thread Ewen Cheslack-Postava
+1 (binding) The AdminClient piece will probably need follow up, but given that it's defined in the context of incomplete KIP-4 design, I'm kind of assuming it's still up for further discussion once we hit the implementation of that class (where I think a wholistic view of the API is needed). Vah

Re: [DISCUSS] KIP-95: Incremental Batch Processing for Kafka Streams

2016-12-10 Thread Ewen Cheslack-Postava
A few thoughts: > introduce a Streams metadata topic (single partitioned and log compacted; one for each application-ID) I would consider whether the single partition is a strict requirement. A single partition increases the likelihood of outages. This is something I'd like to see changed in Conn

Re: [VOTE]: KIP-97: The client compatibility KIP

2016-12-10 Thread Ewen Cheslack-Postava
+1 (binding) -Ewen On Sat, Dec 10, 2016 at 2:41 PM, Jay Kreps wrote: > +1 (binding) > > -Jay > > On Wed, Dec 7, 2016 at 9:17 AM, Colin McCabe wrote: > > > Hi all, > > > > I heard that the VOTE and DISCUSS threads for the KIP-97 discussion > > appeared to be in the same email thread for some pe

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

2016-12-10 Thread Ewen Cheslack-Postava
It seemed like this was addressed in the migration section, wasn't it? The V2 vs V3 requests and the fact that the broker will downgrade the message format (losing zero copy) if you issues a V2 request to a broker using V3 format handles compatibility, does it not? The existing consumers won't see

Re: [DISCUSS] KIP-97: Improved Kafka Client RPC Compatibility Policy

2016-12-10 Thread Ewen Cheslack-Postava
On Sat, Dec 10, 2016 at 5:23 PM, Sven Ludwig wrote: > Hi, > > as a user I find this concept interesting, but not important enough. I > just want to share my personal thoughts, potentially leaning myself > somewhat out of the window, that came to my mind during reading: > > - I think it is of utmo

Re: [VOTE] KIP-94: Session Windows

2016-12-06 Thread Ewen Cheslack-Postava
+1 binding -Ewen On Tue, Dec 6, 2016 at 3:21 PM, Bill Bejeck wrote: > +1 > > On Tue, Dec 6, 2016 at 4:55 PM, Guozhang Wang wrote: > > > +1 (binding) > > > > On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax > > wrote: > > > > > +1 > > > > > > On 12/6/16 7:40 AM, Eno Thereska wrote: > > > > +1 (

[jira] [Resolved] (KAFKA-4154) Kafka Connect fails to shutdown if it has not completed startup

2016-12-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4154. -- Resolution: Fixed Reviewer: Ewen Cheslack-Postava Fix Version/s

[jira] [Resolved] (KAFKA-4306) Connect workers won't shut down if brokers are not available

2016-12-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4306. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-4161) Decouple flush and offset commits

2016-12-01 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4161. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request

[jira] [Resolved] (KAFKA-3008) Connect should parallelize task start/stop

2016-12-01 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3008. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request

Re: [VOTE] KIP-93: Improve invalid timestamp handling in Kafka Streams

2016-11-29 Thread Ewen Cheslack-Postava
+1 (binding). Also, see my notes in discussion thread around future compatibility discussions for breaking plugin interface changes like this. -Ewen On Tue, Nov 29, 2016 at 3:54 PM, Guozhang Wang wrote: > +1. > > On Tue, Nov 29, 2016 at 11:05 AM, Bill Bejeck wrote: > > > +1 (non-binding) > >

Re: [DISCUSS] KIP-93: Improve invalid timestamp handling in Kafka Streams

2016-11-29 Thread Ewen Cheslack-Postava
I think this looks reasonable, but just a more general note on compatibility -- I think it's worth trying to clarify what types of compatibility we're trying to achieve. Guozhang's 1 & 2 give an important breakdown (compile vs runtime compatibility). For the type of change described here, I think i

[jira] [Resolved] (KAFKA-4397) Refactor Connect backing stores for thread-safety

2016-11-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4397. -- Resolution: Fixed Issue resolved by pull request 2123 [https://github.com

[jira] [Updated] (KAFKA-4345) Run ducktape test for each pull request

2016-11-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4345: - Summary: Run ducktape test for each pull request (was: Run decktape test for

[jira] [Reopened] (KAFKA-4345) Run decktape test for each pull request

2016-11-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava reopened KAFKA-4345: -- > Run decktape test for each pull requ

[jira] [Updated] (KAFKA-4450) Add missing 0.10.1.x upgrade tests and ensure ongoing compatibility checks

2016-11-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4450: - Fix Version/s: (was: 0.10.1.1) > Add missing 0.10.1.x upgrade tests

[jira] [Commented] (KAFKA-4450) Add missing 0.10.1.x upgrade tests and ensure ongoing compatibility checks

2016-11-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15705874#comment-15705874 ] Ewen Cheslack-Postava commented on KAFKA-4450: -- Yeah, that makes s

[jira] [Commented] (KAFKA-4007) Improve fetch pipelining for low values of max.poll.records

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699134#comment-15699134 ] Ewen Cheslack-Postava commented on KAFKA-4007: -- [~enothereska] prefetc

[jira] [Created] (KAFKA-4450) Add missing 0.10.1.x upgrade tests and ensure ongoing compatibility checks

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4450: Summary: Add missing 0.10.1.x upgrade tests and ensure ongoing compatibility checks Key: KAFKA-4450 URL: https://issues.apache.org/jira/browse/KAFKA-4450

[jira] [Commented] (KAFKA-3959) __consumer_offsets wrong number of replicas at startup

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698985#comment-15698985 ] Ewen Cheslack-Postava commented on KAFKA-3959: -- [~toddpalino] That'

Re: KafkaProducer.java topics() call?

2016-11-26 Thread Ewen Cheslack-Postava
Generally the producer knows the set of topics it wants to produce to because it is fixed by the application (even if dynamic, there isn't commonly much use in exposing this functionality). You're right it could be implemented, but the use cases seem limited. If you have a good use case, please fo

Re: Reg: DefaultParititioner in Kafka

2016-11-26 Thread Ewen Cheslack-Postava
When a key is available, you generally include it because you want all messages with the same key to always end up in the same partition. This allows all messages with the same key to be processed by the same consumer (e.g. allowing you to aggregate all data for a single user if you key on user ID)

[jira] [Updated] (KAFKA-3963) Missing messages from the controller to brokers

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3963: - Fix Version/s: (was: 0.10.1.0) > Missing messages from the controller

[jira] [Commented] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15698784#comment-15698784 ] Ewen Cheslack-Postava commented on KAFKA-4449: -- [~habren] We actually tr

[jira] [Updated] (KAFKA-3400) Topic stop working / can't describe topic

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3400: - Fix Version/s: (was: 0.10.1.0) > Topic stop working / can't descri

[jira] [Updated] (KAFKA-4063) Add support for infinite endpoints for range queries in Kafka Streams KV stores

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4063: - Fix Version/s: (was: 0.10.1.0) > Add support for infinite endpoints for ra

[jira] [Updated] (KAFKA-3775) Throttle maximum number of tasks assigned to a single KafkaStreams

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3775: - Fix Version/s: (was: 0.10.1.0) > Throttle maximum number of tasks assigned

[jira] [Updated] (KAFKA-4449) Add Serializer/Deserializer for POJO

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4449: - Fix Version/s: (was: 0.10.1.0) > Add Serializer/Deserializer for P

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4316: - Fix Version/s: (was: 0.10.1.0) > Kafka Streams 0.10.0.1 does not run

[jira] [Updated] (KAFKA-4156) Not able to download tests jar of kafka and kafka-streams from maven repo.

2016-11-26 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4156: - Fix Version/s: (was: 0.10.0.1) (was: 0.10.0.0) >

[jira] [Updated] (KAFKA-4403) Update KafkaBasedLog to use new endOffsets consumer API

2016-11-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4403: - Assignee: Balint Molnar (was: Ewen Cheslack-Postava) > Update KafkaBasedLog

[jira] [Commented] (KAFKA-4403) Update KafkaBasedLog to use new endOffsets consumer API

2016-11-25 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696374#comment-15696374 ] Ewen Cheslack-Postava commented on KAFKA-4403: -- Absolutely, I've

[jira] [Resolved] (KAFKA-4417) Update build dependencies for 0.10.2 cycle

2016-11-17 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4417. -- Resolution: Fixed Issue resolved by pull request 2144 [https://github.com

[jira] [Commented] (KAFKA-4404) Add knowledge of sign to numeric schema types

2016-11-14 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664439#comment-15664439 ] Ewen Cheslack-Postava commented on KAFKA-4404: -- What is the motivation

[jira] [Commented] (KAFKA-3959) __consumer_offsets wrong number of replicas at startup

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662738#comment-15662738 ] Ewen Cheslack-Postava commented on KAFKA-3959: -- [~granthenke] [~onurkar

[jira] [Resolved] (KAFKA-3967) Excessive Network IO between Kafka brokers

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3967. -- Resolution: Invalid [~Krishna82] Closing this for now since we haven't

[jira] [Commented] (KAFKA-4021) system tests need to enable trace level logging for controller and state-change log

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662381#comment-15662381 ] Ewen Cheslack-Postava commented on KAFKA-4021: -- [~junrao] Is this actu

Re: Upgrading from kafka-0.8.1.1 to kafka-0.9.0.1

2016-11-13 Thread Ewen Cheslack-Postava
The errors you're seeing sound like an issue where you updated the artifact but didn't recompile against the newer Scala version. Did you recompile or just replace the Kafka jar with a newer one? -Ewen On Wed, Nov 9, 2016 at 4:31 PM, Divyajothi Baskaran wrote: > Hi, > For the past 6 months,I am

[jira] [Commented] (KAFKA-4402) Kafka Producer's DefaultPartitioner is actually not round robin as said in the code comments "If no partition or key is present choose a partition in a round-robin fash

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662197#comment-15662197 ] Ewen Cheslack-Postava commented on KAFKA-4402: -- [~Jun Yao] Sorry, mi

[jira] [Commented] (KAFKA-4402) Kafka Producer's DefaultPartitioner is actually not round robin as said in the code comments "If no partition or key is present choose a partition in a round-robin fash

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662198#comment-15662198 ] Ewen Cheslack-Postava commented on KAFKA-4402: -- [~Jun Yao] Sorry, mi

[jira] [Created] (KAFKA-4403) Update KafkaBasedLog to use new endOffsets consumer API

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4403: Summary: Update KafkaBasedLog to use new endOffsets consumer API Key: KAFKA-4403 URL: https://issues.apache.org/jira/browse/KAFKA-4403 Project: Kafka

[jira] [Commented] (KAFKA-4402) Kafka Producer's DefaultPartitioner is actually not round robin as said in the code comments "If no partition or key is present choose a partition in a round-robin fash

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662153#comment-15662153 ] Ewen Cheslack-Postava commented on KAFKA-4402: -- [~Jun Yao] Which code

[jira] [Commented] (KAFKA-4401) Change the KafkaServerTestHarness and IntegrationTestHarness from trait to abstract class.

2016-11-13 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662147#comment-15662147 ] Ewen Cheslack-Postava commented on KAFKA-4401: -- [~becket_qin] We'v

[jira] [Resolved] (KAFKA-3829) Warn that kafka-connect group.id must not conflict with connector names

2016-11-12 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3829. -- Resolution: Fixed Fix Version/s: (was: 0.10.1.1

Re: [VOTE] KIP-89: Allow sink connectors to decouple flush and offset commit

2016-11-11 Thread Ewen Cheslack-Postava
+1 (binding) -Ewen On Wed, Nov 9, 2016 at 2:16 PM, Shikhar Bhushan wrote: > Hi, > > I would like to initiate a vote on KIP-89 > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 89%3A+Allow+sink+connectors+to+decouple+flush+and+offset+commit > > Best, > > Shikhar > -- Thanks, Ewen

<    2   3   4   5   6   7   8   9   10   11   >