Re: Suppressing redundant KTable forwards

Hi Eno, I'm not sure. My understanding is that the cache would prevent two immediate updates for the same key from being forwarded, but that only applies when records arrive within commit.interval.ms of each other. Is that understanding correct? filterRedundant compares the newValue & oldValue

Re: [DISCUSS] KIP-95: Incremental Batch Processing for Kafka Streams

A couple of remaining questions: - it says in the KIP: "because the metadata topic must be consumed by all instances, we need to assign the topic’s partitions manually and do not commit offsets -- we also need to seekToBeginning() each time we consume the metadata topic)" . How big of a change

Re: Suppressing redundant KTable forwards

Hi Mathieu, Thanks for the suggestion. Wouldn't the cache introduced in KIP-63 do some of this for you, in that it dedups records with the same key and prevents them from being forwarded downstream? Eno > On 4 Dec 2016, at 04:13, Mathieu Fenniak wrote: > > Hey

Re: Suppressing redundant KTable forwards

Hi Mathieu, You are correct in that the de-duping only occurs within the commit interval. I can understand and appreciate the use-case you have. So I think the right approach for this is to create a KIP with your suggested changes and put it to the community. Are you happy to do that? Thanks,

[jira] [Updated] (KAFKA-4205) NullPointerException in fetchOffsetsBefore

[ https://issues.apache.org/jira/browse/KAFKA-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4205: --- Resolution: Fixed Status: Resolved (was: Patch Available) > NullPointerException in

[jira] [Commented] (KAFKA-4486) Kafka Streams - exception in process still commits offsets

[ https://issues.apache.org/jira/browse/KAFKA-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15721213#comment-15721213 ] Guozhang Wang commented on KAFKA-4486: -- [~joel.lundell] Thanks for reporting your use case, which

[jira] [Commented] (KAFKA-4205) NullPointerException in fetchOffsetsBefore

[ https://issues.apache.org/jira/browse/KAFKA-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15720401#comment-15720401 ] ASF GitHub Bot commented on KAFKA-4205: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2204: KAFKA-4205; KafkaApis: fix NPE caused by conversio...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2204 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is back to normal : kafka-0.10.1-jdk7 #99

See

[jira] [Commented] (KAFKA-4039) Exit Strategy: using exceptions instead of inline invocation of exit/halt

[ https://issues.apache.org/jira/browse/KAFKA-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15721224#comment-15721224 ] Maysam Yabandeh commented on KAFKA-4039: I am afraid I do not have much free cycles left to work

Build failed in Jenkins: kafka-trunk-jdk7 #1729

See Changes: [wangguoz] KAFKA-4205; KafkaApis: fix NPE caused by conversion to array -- [...truncated 14187 lines...] org.apache.kafka.streams.processor.TopologyBuilderTest >

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hi Apurva, Thanks for taking the time to reply. You make excellent points, and it sounds like the right tradeoff. It would be great if the coordinator code could be shared with the consumer API, hope that's actually the case. Daniel Schierbeck On Thu, 1 Dec 2016 at 18.34 Apurva Mehta

[jira] [Commented] (KAFKA-4434) KafkaProducer configuration is logged twice

[ https://issues.apache.org/jira/browse/KAFKA-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15720878#comment-15720878 ] huxi commented on KAFKA-4434: - already assigned to you. > KafkaProducer configuration is logged twice >

Build failed in Jenkins: kafka-trunk-jdk8 #1078

See Changes: [wangguoz] KAFKA-4205; KafkaApis: fix NPE caused by conversion to array -- [...truncated 14349 lines...] org.apache.kafka.streams.kstream.TimeWindowsTest >

[jira] [Updated] (KAFKA-4434) KafkaProducer configuration is logged twice

[ https://issues.apache.org/jira/browse/KAFKA-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4434: Assignee: kevin.chen > KafkaProducer configuration is logged twice > --- >

[jira] [Commented] (KAFKA-4451) Recovering empty replica yields negative offsets in index of compact partitions

[ https://issues.apache.org/jira/browse/KAFKA-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15720715#comment-15720715 ] ASF GitHub Bot commented on KAFKA-4451: --- GitHub user michaelschiff opened a pull request:

[GitHub] kafka pull request #2210: KAFKA-4451

GitHub user michaelschiff opened a pull request: https://github.com/apache/kafka/pull/2210 KAFKA-4451 Fix OffsetIndex overflow when replicating a highly compacted topic. You can merge this pull request into a Git repository by running: $ git pull