[jira] [Created] (KAFKA-4656) Improve test coverage of CompositeReadOnlyKeyValueStore

Damian Guy created KAFKA-4656: - Summary: Improve test coverage of CompositeReadOnlyKeyValueStore Key: KAFKA-4656 URL: https://issues.apache.org/jira/browse/KAFKA-4656 Project: Kafka Issue Type

[jira] [Created] (KAFKA-4655) Improve test coverage of CompositeReadOnlySessionStore

Damian Guy created KAFKA-4655: - Summary: Improve test coverage of CompositeReadOnlySessionStore Key: KAFKA-4655 URL: https://issues.apache.org/jira/browse/KAFKA-4655 Project: Kafka Issue Type

[jira] [Created] (KAFKA-4654) Improve test coverage MemoryLRUCache

Damian Guy created KAFKA-4654: - Summary: Improve test coverage MemoryLRUCache Key: KAFKA-4654 URL: https://issues.apache.org/jira/browse/KAFKA-4654 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4653) Improve test coverage of RocksDBStore

Damian Guy created KAFKA-4653: - Summary: Improve test coverage of RocksDBStore Key: KAFKA-4653 URL: https://issues.apache.org/jira/browse/KAFKA-4653 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4652) Improve test coverage KStreamBuilder

Damian Guy created KAFKA-4652: - Summary: Improve test coverage KStreamBuilder Key: KAFKA-4652 URL: https://issues.apache.org/jira/browse/KAFKA-4652 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4651) Improve test coverage of Stores

Damian Guy created KAFKA-4651: - Summary: Improve test coverage of Stores Key: KAFKA-4651 URL: https://issues.apache.org/jira/browse/KAFKA-4651 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4650) Improve test coverage org.apache.kafka.streams.kstream.internals

Damian Guy created KAFKA-4650: - Summary: Improve test coverage org.apache.kafka.streams.kstream.internals Key: KAFKA-4650 URL: https://issues.apache.org/jira/browse/KAFKA-4650 Project: Kafka

[jira] [Created] (KAFKA-4649) Improve test coverage GlobalStateManagerImpl

Damian Guy created KAFKA-4649: - Summary: Improve test coverage GlobalStateManagerImpl Key: KAFKA-4649 URL: https://issues.apache.org/jira/browse/KAFKA-4649 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4648) Improve test coverage StreamTask

Damian Guy created KAFKA-4648: - Summary: Improve test coverage StreamTask Key: KAFKA-4648 URL: https://issues.apache.org/jira/browse/KAFKA-4648 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4647) Improve test coverage of GlobalStreamThread

Damian Guy created KAFKA-4647: - Summary: Improve test coverage of GlobalStreamThread Key: KAFKA-4647 URL: https://issues.apache.org/jira/browse/KAFKA-4647 Project: Kafka Issue Type: Sub-task

[jira] [Updated] (KAFKA-4647) Improve test coverage of GlobalStreamThread

[ https://issues.apache.org/jira/browse/KAFKA-4647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4647: -- Priority: Minor (was: Major) > Improve test coverage of GlobalStreamThr

[jira] [Reopened] (KAFKA-4646) Improve test coverage AbstractProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reopened KAFKA-4646: --- Exception paths in {{register}}, {{topic}}, {{partition}}, {{offset}}, {{timestamp}} > Improve t

[jira] [Updated] (KAFKA-4646) Improve test coverage AbstractProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4646: -- Summary: Improve test coverage AbstractProcessorContext (was: Improve Streams unit test coverage

[jira] [Created] (KAFKA-4646) Improve Streams unit test coverage

Damian Guy created KAFKA-4646: - Summary: Improve Streams unit test coverage Key: KAFKA-4646 URL: https://issues.apache.org/jira/browse/KAFKA-4646 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-4646) Improve Streams unit test coverage

[ https://issues.apache.org/jira/browse/KAFKA-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4646. --- Resolution: Duplicate > Improve Streams unit test cover

[jira] [Created] (KAFKA-4645) Improve test coverage of ProcessorTopology

Damian Guy created KAFKA-4645: - Summary: Improve test coverage of ProcessorTopology Key: KAFKA-4645 URL: https://issues.apache.org/jira/browse/KAFKA-4645 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4644) Improve test coverage of StreamsPartitionAssignor

Damian Guy created KAFKA-4644: - Summary: Improve test coverage of StreamsPartitionAssignor Key: KAFKA-4644 URL: https://issues.apache.org/jira/browse/KAFKA-4644 Project: Kafka Issue Type: Sub

[jira] [Created] (KAFKA-4643) Improve test coverage of StreamsKafkaClient

Damian Guy created KAFKA-4643: - Summary: Improve test coverage of StreamsKafkaClient Key: KAFKA-4643 URL: https://issues.apache.org/jira/browse/KAFKA-4643 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4642) Improve test coverage of ProcessorStateManager

Damian Guy created KAFKA-4642: - Summary: Improve test coverage of ProcessorStateManager Key: KAFKA-4642 URL: https://issues.apache.org/jira/browse/KAFKA-4642 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4641) Improve test coverage of StreamsThread

Damian Guy created KAFKA-4641: - Summary: Improve test coverage of StreamsThread Key: KAFKA-4641 URL: https://issues.apache.org/jira/browse/KAFKA-4641 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-4640) Improve Streams unit test coverage

Damian Guy created KAFKA-4640: - Summary: Improve Streams unit test coverage Key: KAFKA-4640 URL: https://issues.apache.org/jira/browse/KAFKA-4640 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-114: KTable materialization and improved semantics

Hi Eno, Thanks for the KIP. Some comments: 1. I'd probably rename materialized to materialize. 2. I don't think the addition of the new Log compaction mechanism is necessary for this KIP, i.e, the KIP is useful without it. Maybe that should be a different KIP? 3. What will happen

[jira] [Work started] (KAFKA-4588) QueryableStateIntegrationTest.shouldNotMakeStoreAvailableUntilAllStoresAvailable is occasionally failing on jenkins

[ https://issues.apache.org/jira/browse/KAFKA-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4588 started by Damian Guy. - > QueryableStateIntegrationTest.shouldNotMakeStoreAvailableUntilAllStoresAvaila

[jira] [Updated] (KAFKA-4588) QueryableStateIntegrationTest.shouldNotMakeStoreAvailableUntilAllStoresAvailable is occasionally failing on jenkins

[ https://issues.apache.org/jira/browse/KAFKA-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4588: -- Status: Patch Available (was: In Progress

[jira] [Created] (KAFKA-4628) Support KTable/GlobalKTable Joins

Damian Guy created KAFKA-4628: - Summary: Support KTable/GlobalKTable Joins Key: KAFKA-4628 URL: https://issues.apache.org/jira/browse/KAFKA-4628 Project: Kafka Issue Type: Sub-task

Re: [ANNOUNCE] New committer: Grant Henke

Congratulations! On Thu, 12 Jan 2017 at 03:35 Jun Rao wrote: > Grant, > > Thanks for all your contribution! Congratulations! > > Jun > > On Wed, Jan 11, 2017 at 2:51 PM, Gwen Shapira wrote: > > > The PMC for Apache Kafka has invited Grant Henke to join as

[jira] [Created] (KAFKA-4609) KTable/KTable join followed by groupBy and aggregate/count can result in incorrect results

Damian Guy created KAFKA-4609: - Summary: KTable/KTable join followed by groupBy and aggregate/count can result in incorrect results Key: KAFKA-4609 URL: https://issues.apache.org/jira/browse/KAFKA-4609

[jira] [Assigned] (KAFKA-4588) QueryableStateIntegrationTest.shouldNotMakeStoreAvailableUntilAllStoresAvailable is occasionally failing on jenkins

[ https://issues.apache.org/jira/browse/KAFKA-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4588: - Assignee: Damian Guy

Re: [DISCUSS] KIP-104: Granular Sensors for Streams

Eno - I'm +1 on this change. Thanks, Damian On Sun, 8 Jan 2017 at 20:45 Eno Thereska wrote: > I can see the point that all of a sudden exposing the internal Metrics > class might be too big a bite to take in this KIP, since the Metrics class > might have to be cleaned up

Re: [VOTE] KIP-104: Granular Sensors for Streams

+1 On Fri, 6 Jan 2017 at 09:37 Eno Thereska wrote: > The discussion points for KIP-104 are addressed. At this point we'd like > to start the vote for it: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-104%3A+Granular+Sensors+for+Streams > < >

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

+1 On Fri, 6 Jan 2017 at 10:48 Ismael Juma wrote: > Thanks for the KIP, +1 (binding). > > Ismael > > On Fri, Jan 6, 2017 at 10:37 AM, Eno Thereska > wrote: > > > The discussion points for KIP-105 are addressed. At this point we'd like > > to start the

Re: [VOTE] KIP-99: Add Global Tables to Kafka Streams

; > > > On Tue, Jan 3, 2017 at 11:16 AM, Gwen Shapira <g...@confluent.io> > wrote: > > > > > > > +1 > > > > > > > > I'm glad this super-common use-case will become more performant now. > > > > > > > > On Mon, Dec 12,

[jira] [Created] (KAFKA-4588) QueryableStateIntegrationTest.shouldNotMakeStoreAvailableUntilAllStoresAvailable is occasionally failing on jenkins

Damian Guy created KAFKA-4588: - Summary: QueryableStateIntegrationTest.shouldNotMakeStoreAvailableUntilAllStoresAvailable is occasionally failing on jenkins Key: KAFKA-4588 URL: https://issues.apache.org/jira/browse

[jira] [Updated] (KAFKA-4588) QueryableStateIntegrationTest.shouldNotMakeStoreAvailableUntilAllStoresAvailable is occasionally failing on jenkins

[ https://issues.apache.org/jira/browse/KAFKA-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4588: -- Description: org.apache.kafka.streams.integration.QueryableStateIntegrationTest

Re: [VOTE] KIP-99: Add Global Tables to Kafka Streams

.com> wrote: > > > +1 > > > > On Mon, Dec 12, 2016 at 12:29 PM, Matthias J. Sax <matth...@confluent.io > > > > wrote: > > > > > +1 > > > > > > On 12/12/16 3:45 AM, Damian Guy wrote: > > > > Hi all, > > > > > >

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

is interface sooner than later. > > 4/6. OK. > > > Guozhang > > > On Tue, Dec 20, 2016 at 2:16 PM, Damian Guy <damian@gmail.com> wrote: > > > Hi Guozhang, > > > > Thanks for your input. Answers below, but i'm thinking we should remove > >

Re: [VOTE] KIP-90 Remove zkClient dependency from Streams

+1 On Tue, 20 Dec 2016 at 21:16 Sriram Subramanian wrote: > +1 > > On Tue, Dec 20, 2016 at 1:13 PM, Guozhang Wang wrote: > > > +1. Thanks! > > > > On Tue, Dec 20, 2016 at 1:01 PM, Hojjat Jafarpour > > wrote: > > > > > Hi all, > > > >

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

can still avoid thread-synchronization while making the logic more clear > > (ideally the standby restoration do not really need to be in part of the > > stream thread's main loops). > > > > 5. Also for the global table's state directory, I'm assuming it will not > > be u

[jira] [Updated] (KAFKA-4561) Ordering of operations in StreamThread.shutdownTasksAndState may void at-least-once guarantees

[ https://issues.apache.org/jira/browse/KAFKA-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4561: -- Status: Patch Available (was: In Progress) > Ordering of operati

[jira] [Work started] (KAFKA-4561) Ordering of operations in StreamThread.shutdownTasksAndState may void at-least-once guarantees

[ https://issues.apache.org/jira/browse/KAFKA-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4561 started by Damian Guy. - > Ordering of operations in StreamThread.shutdownTasksAndState may void > at

[jira] [Created] (KAFKA-4561) Ordering of operations in StreamThread.shutdownTasksAndState may void at-least-once guarantees

Damian Guy created KAFKA-4561: - Summary: Ordering of operations in StreamThread.shutdownTasksAndState may void at-least-once guarantees Key: KAFKA-4561 URL: https://issues.apache.org/jira/browse/KAFKA-4561

[jira] [Updated] (KAFKA-4540) Suspended tasks that are not assigned to the StreamThread need to be closed before new active and standby tasks are created

[ https://issues.apache.org/jira/browse/KAFKA-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4540: -- Status: Patch Available (was: Open) > Suspended tasks that are not assigned to the StreamThread n

[jira] [Commented] (KAFKA-4540) Suspended tasks that are not assigned to the StreamThread need to be closed before new active and standby tasks are created

[ https://issues.apache.org/jira/browse/KAFKA-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749549#comment-15749549 ] Damian Guy commented on KAFKA-4540: --- This issue isn't resolved. The problem here is that say i

[jira] [Created] (KAFKA-4540) Suspended tasks that are not assigned to the StreamThread need to be closed before new active and standby tasks are created

Damian Guy created KAFKA-4540: - Summary: Suspended tasks that are not assigned to the StreamThread need to be closed before new active and standby tasks are created Key: KAFKA-4540 URL: https://issues.apache.org/jira

[jira] [Updated] (KAFKA-4539) StreamThread is not correctly creating StandbyTasks

[ https://issues.apache.org/jira/browse/KAFKA-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4539: -- Description: Fails because {{createStandbyTask(..)}} can return null fi the topology for the {{TaskId

[jira] [Updated] (KAFKA-4539) StreamThread is not correctly creating StandbyTasks

[ https://issues.apache.org/jira/browse/KAFKA-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4539: -- Summary: StreamThread is not correctly creating StandbyTasks (was: NPE in StreamThread when creating

[jira] [Updated] (KAFKA-4539) NPE in StreamThread when creating StandbyTasks

[ https://issues.apache.org/jira/browse/KAFKA-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4539: -- Status: Patch Available (was: In Progress) > NPE in StreamThread when creating StandbyTa

[jira] [Work started] (KAFKA-4539) NPE in StreamThread when creating StandbyTasks

[ https://issues.apache.org/jira/browse/KAFKA-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4539 started by Damian Guy. - > NPE in StreamThread when creating StandbyTa

[jira] [Created] (KAFKA-4539) NPE in StreamThread when creating StandbyTasks

Damian Guy created KAFKA-4539: - Summary: NPE in StreamThread when creating StandbyTasks Key: KAFKA-4539 URL: https://issues.apache.org/jira/browse/KAFKA-4539 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-4537) StreamPartitionAssignor incorrectly adds standby partitions to the partitionsByHostState map

Damian Guy created KAFKA-4537: - Summary: StreamPartitionAssignor incorrectly adds standby partitions to the partitionsByHostState map Key: KAFKA-4537 URL: https://issues.apache.org/jira/browse/KAFKA-4537

[jira] [Updated] (KAFKA-4534) StreamPartitionAssignor only ever updates the partitionsByHostState and metadataWithInternalTopics once.

[ https://issues.apache.org/jira/browse/KAFKA-4534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4534: -- Status: Patch Available (was: Open) > StreamPartitionAssignor only ever upda

[jira] [Updated] (KAFKA-4473) RecordCollector should handle retriable exceptions more strictly

[ https://issues.apache.org/jira/browse/KAFKA-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4473: -- Status: Patch Available (was: In Progress) > RecordCollector should handle retriable exceptions m

[jira] [Created] (KAFKA-4534) StreamPartitionAssignor only ever updates the partitionsByHostState and metadataWithInternalTopics once.

Damian Guy created KAFKA-4534: - Summary: StreamPartitionAssignor only ever updates the partitionsByHostState and metadataWithInternalTopics once. Key: KAFKA-4534 URL: https://issues.apache.org/jira/browse/KAFKA-4534

[jira] [Updated] (KAFKA-4532) StateStores can be connected to the wrong source topic resulting in incorrect metadata returned from IQ

[ https://issues.apache.org/jira/browse/KAFKA-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4532: -- Description: When building a topology with tables and StateStores, the StateStores are mapped

[jira] [Updated] (KAFKA-4532) StateStores can be connected to the wrong source topic resulting in incorrect metadata returned from IQ

[ https://issues.apache.org/jira/browse/KAFKA-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4532: -- Description: When building a topology with tables and StateStores, the StateStores are mapped

[jira] [Updated] (KAFKA-4532) StateStores can be connected to the wrong source topic resulting in incorrect metadata returned from IQ

[ https://issues.apache.org/jira/browse/KAFKA-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4532: -- Summary: StateStores can be connected to the wrong source topic resulting in incorrect metadata

[jira] [Work started] (KAFKA-4532) StateStores can be connected to the wrong source topic

[ https://issues.apache.org/jira/browse/KAFKA-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4532 started by Damian Guy. - > StateStores can be connected to the wrong source to

[jira] [Created] (KAFKA-4532) StateStores can be connected to the wrong source topic

Damian Guy created KAFKA-4532: - Summary: StateStores can be connected to the wrong source topic Key: KAFKA-4532 URL: https://issues.apache.org/jira/browse/KAFKA-4532 Project: Kafka Issue Type

[jira] [Work started] (KAFKA-4473) RecordCollector should handle retriable exceptions more strictly

[ https://issues.apache.org/jira/browse/KAFKA-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4473 started by Damian Guy. - > RecordCollector should handle retriable exceptions more stric

[jira] [Assigned] (KAFKA-4473) RecordCollector should handle retriable exceptions more strictly

[ https://issues.apache.org/jira/browse/KAFKA-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4473: - Assignee: Damian Guy > RecordCollector should handle retriable exceptions more stric

[jira] [Updated] (KAFKA-4490) Add Global Table support to Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4490: -- Status: Patch Available (was: Open) > Add Global Table support to Kafka Stre

[VOTE] KIP-99: Add Global Tables to Kafka Streams

Hi all, I'd like to start the vote for KIP-99: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=67633649 There is a PR for it here: https://github.com/apache/kafka/pull/2244 Thanks, Damian

[jira] [Updated] (KAFKA-4516) When a CachingStateStore is closed it should clear its associated NamedCache. Subsequent queries should throw InvalidStateStoreException

[ https://issues.apache.org/jira/browse/KAFKA-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4516: -- Status: Patch Available (was: Open) > When a CachingStateStore is closed it should clear

[jira] [Resolved] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4492. --- Resolution: Fixed > java.lang.IllegalStateException: Attempting to put a clean entry for

[jira] [Created] (KAFKA-4516) When a CachingStateStore is closed it should clear its associated NamedCache. Subsequent queries should throw InvalidStateStoreException

Damian Guy created KAFKA-4516: - Summary: When a CachingStateStore is closed it should clear its associated NamedCache. Subsequent queries should throw InvalidStateStoreException Key: KAFKA-4516 URL: https

Re: [VOTE] KIP-94: Session Windows

> > > > > > > > > +1 (binding) > > > > > > > > > > On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax < > > matth...@confluent.io > > > > > > > > > wrote: > > > > >

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

o add > it in the future. > > > Best, > Michael > > > > > > > On Thu, Dec 8, 2016 at 6:31 PM, Damian Guy <damian@gmail.com> wrote: > > > Hi Michael, > > > > I don't see how that helps? > > > > Lets say we have tables

Re: Improvements to Jenkins pull request builder

Cool - thanks Ismael! On Thu, 8 Dec 2016 at 18:22 Guozhang Wang wrote: > Thanks Ismael, this is sper helpful! > > > Guozhang > > On Thu, Dec 8, 2016 at 5:24 AM, Ismael Juma wrote: > > > Hi everyone, > > > > Given the recent availability of the

Re: [DISCUSS] KIP-100 - Relax Type constraints in Kafka Streams API

Hi Xavier, The KIP looks good - thanks! Damian On Thu, 8 Dec 2016 at 18:12 Xavier Léauté wrote: > I recently filed https://issues.apache.org/jira/browse/KAFKA-4481, which > Guozhang agreed was a bug. However fixing this will require some minor > changes to the existing

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

> The key type returned by both KeyValueMappers (in the current trunk > version, that type is named `R`) would need to be the same for this to > work. > > > On Wed, Dec 7, 2016 at 4:46 PM, Damian Guy <damian@gmail.com> wrote: > > > Michael, > > > > We

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

fied as easily > because Streams must know two mappers, t1->t2 plus t2->t1 -- otherwise the > outer join won't work. > > > > > > On Wed, Dec 7, 2016 at 3:04 PM, Damian Guy <damian@gmail.com> wrote: > > > Hi Michael, > > > > Sure. Say we have 2

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

for example, > we swapped the call from leftTable.join(rightTable) to > rightTable.join(leftTable), that join would work, too. Perhaps I am > missing something though. :-) > > > > > On Wed, Dec 7, 2016 at 10:39 AM, Damian Guy <damian@gmail.com> wrote: > > >

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

at this never > finishes if the application fails before bootstrapping finishes and new > data gets written at the same time? Do we need to guard against this > (seems to be a very rare corner case, so maybe not required)? > > > -Matthias > > > On 12/6/16 2:09 AM, Damian G

[jira] [Updated] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4492: -- Description: This follows on from https://issues.apache.org/jira/browse/KAFKA-4311 The exception seems

[jira] [Resolved] (KAFKA-4495) ThreadCache.maybeEvict can become an infinite loop

[ https://issues.apache.org/jira/browse/KAFKA-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4495. --- Resolution: Invalid > ThreadCache.maybeEvict can become an infinite l

[jira] [Created] (KAFKA-4495) ThreadCache.maybeEvict can become an infinite loop

Damian Guy created KAFKA-4495: - Summary: ThreadCache.maybeEvict can become an infinite loop Key: KAFKA-4495 URL: https://issues.apache.org/jira/browse/KAFKA-4495 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4492: -- Description: This follows on from https://issues.apache.org/jira/browse/KAFKA-4311 The exception seems

[VOTE] KIP-94: Session Windows

Hi all, I'd like to start the vote for KIP-94: https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows There is a PR for it here: https://github.com/apache/kafka/pull/2166 Thanks, Damian

[jira] [Updated] (KAFKA-4490) Add Global Table support to Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4490: -- Description: As per KIP-99 https://cwiki.apache.org/confluence/display/KAFKA/KIP-99%3A+Add+Global

[jira] [Created] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

Damian Guy created KAFKA-4492: - Summary: java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache Key: KAFKA-4492 URL: https://issues.apache.org/jira/browse/KAFKA-4492

[jira] [Updated] (KAFKA-4490) Add Global Table support to Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4490: -- Environment: (was: As per KIP-99 https://cwiki.apache.org/confluence/display/KAFKA/KIP-99%3A+Add

[jira] [Created] (KAFKA-4490) Add Global Table support to Kafka Streams

Damian Guy created KAFKA-4490: - Summary: Add Global Table support to Kafka Streams Key: KAFKA-4490 URL: https://issues.apache.org/jira/browse/KAFKA-4490 Project: Kafka Issue Type: New Feature

[DISCUSS] KIP-99: Add Global Tables to Kafka Streams

Hi all, I would like to start the discussion on KIP-99: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=67633649 Looking forward to your feedback. Thanks, Damian

[jira] [Work started] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

[ https://issues.apache.org/jira/browse/KAFKA-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4488 started by Damian Guy. - > UnsupportedOperationException during initialization of StandbyT

[jira] [Created] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

Damian Guy created KAFKA-4488: - Summary: UnsupportedOperationException during initialization of StandbyTask Key: KAFKA-4488 URL: https://issues.apache.org/jira/browse/KAFKA-4488 Project: Kafka

Re: [DISCUSS] KIP-94: Session Windows

have > alternative aggregation operator implementations where both an aggregator > V, T -> T and a merger T, T -> T could be provided by users. > > > Guozhang > > > On Wed, Nov 30, 2016 at 2:42 AM, Damian Guy <damian@gmail.com> wrote: > > > Thanks Matthias. &

Re: Suppressing redundant KTable forwards

Hi Mathieu, You are correct in that the de-duping only occurs within the commit interval. I can understand and appreciate the use-case you have. So I think the right approach for this is to create a KIP with your suggested changes and put it to the community. Are you happy to do that? Thanks,

[jira] [Commented] (KAFKA-4322) StateRestoreCallback begin and end indication

[ https://issues.apache.org/jira/browse/KAFKA-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715322#comment-15715322 ] Damian Guy commented on KAFKA-4322: --- My only concern with adding the extra methods is that it breaks

Re: [DISCUSS] KIP-95: Incremental Batch Processing for Kafka Streams

I think the KIP looks good. I also think we need the metadata topic in-order to provide sane guarantees on what data will be processed. As Matthias has outlined in the KIP we need to know when to stop consuming from intermediate topics, i.e, topics that are part of the same application but are

Re: [VOTE] KIP-93: Improve invalid timestamp handling in Kafka Streams

+1 On Wed, 30 Nov 2016 at 05:58 Ewen Cheslack-Postava wrote: > +1 (binding). > > Also, see my notes in discussion thread around future compatibility > discussions for breaking plugin interface changes like this. > > -Ewen > > On Tue, Nov 29, 2016 at 3:54 PM, Guozhang Wang

Re: [DISCUSS] KIP-94: Session Windows

> some getters in you code that are not part of the KIP (not sure how > important this is) > > > -Matthias > > > > On 11/24/16 7:59 AM, Damian Guy wrote: > > Hi all, > > > > I would like to start the discussion on KIP-94: > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows > > > > Thanks, > > Damian > > > >

[jira] [Updated] (KAFKA-3452) Support session windows

[ https://issues.apache.org/jira/browse/KAFKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-3452: -- Status: Patch Available (was: In Progress) > Support session wind

[jira] [Updated] (KAFKA-3452) Support session windows

[ https://issues.apache.org/jira/browse/KAFKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-3452: -- Summary: Support session windows (was: Support session windows besides time interval windows

[jira] [Updated] (KAFKA-3452) Support session windows besides time interval windows

[ https://issues.apache.org/jira/browse/KAFKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-3452: -- Description: The Streams DSL currently does not provide session window as in the DataFlow model. We

[DISCUSS] KIP-94: Session Windows

Hi all, I would like to start the discussion on KIP-94: https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows Thanks, Damian

[jira] [Commented] (KAFKA-4270) ClassCast for Agregation

[ https://issues.apache.org/jira/browse/KAFKA-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684523#comment-15684523 ] Damian Guy commented on KAFKA-4270: --- Hi, I still don't really follow what the issue is. Have you tried

[jira] [Comment Edited] (KAFKA-4270) ClassCast for Agregation

[ https://issues.apache.org/jira/browse/KAFKA-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677990#comment-15677990 ] Damian Guy edited comment on KAFKA-4270 at 11/18/16 10:41 PM: -- Hi Mykola

[jira] [Commented] (KAFKA-4270) ClassCast for Agregation

[ https://issues.apache.org/jira/browse/KAFKA-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677990#comment-15677990 ] Damian Guy commented on KAFKA-4270: --- Hi Mykola, I'm not entirely sure i follow what you are saying. I

[jira] [Assigned] (KAFKA-4270) ClassCast for Agregation

[ https://issues.apache.org/jira/browse/KAFKA-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-4270: - Assignee: Damian Guy > ClassCast for Agregat

[jira] [Commented] (KAFKA-4394) Processor API does not receive timestamp and/or ConsumerRecord

[ https://issues.apache.org/jira/browse/KAFKA-4394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651233#comment-15651233 ] Damian Guy commented on KAFKA-4394: --- The record timestamp is available via {{ProcessorContext.timestamp

<    1   2   3   4   5   6   7   8   >