Re: [VOTE] KIP-328: Ability to suppress updates for KTables

2019-04-16 Thread John Roesler
Hi again, all, Casey Green pointed out that we overlooked the scala api when we added Suppress. He was kind enough to send https://github.com/apache/kafka/pull/6314 to correct this, and we also updated the KIP. Since it's essentially just copying the existing Java API over to Scala, we didn't

Re: Request KIP Permissions

2019-04-16 Thread Bill Bejeck
You're all set now! I look forward to your KIP. Thanks, Bill On Tue, Apr 16, 2019 at 1:15 AM Jukka Karvanen wrote: > Hi, > > Could you please grant me write access to KIP proposals? > I am planning to make KIP for KAFKA-8233: Helper class to make it simpler > to write test logic with

Re: [DISCUSS] KIP-449: Add connector contexts to Connect worker logs

2019-04-16 Thread Jeremy Custenborder
Chris is correct the examples are mixed but it's pretty easy to follow. From what I have gathered it looks like manipulation of the context would be handled by the framework and not necessarily for the connector developer. I'm not sure what benefit a connector developer would have to manipulate

Jenkins build is back to normal : kafka-trunk-jdk11 #439

2019-04-16 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-7875) Add KStream#flatTransformValues

2019-04-16 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-7875. Resolution: Fixed > Add KStream#flatTransformValues > --- > >

Re: [DISCUSS] KIP-450: Sliding Window Aggregations in the DSL

2019-04-16 Thread Guozhang Wang
Regarding 4): yes I agree with you that invertibility is not a common property for agg-functions. Just to be clear about our current APIs: for stream.aggregate we only require a single Adder function, whereas for table.aggregate we require both Adder and Subtractor, but these are not used to

[jira] [Created] (KAFKA-8242) Exception in ReplicaFetcher blocks replication of all other partitions

2019-04-16 Thread Nevins Bartolomeo (JIRA)
Nevins Bartolomeo created KAFKA-8242: Summary: Exception in ReplicaFetcher blocks replication of all other partitions Key: KAFKA-8242 URL: https://issues.apache.org/jira/browse/KAFKA-8242

KIP-457: Add DISCONNECTED state to Kafka Streams

2019-04-16 Thread Richard Yu
Hi all, I like to propose a small KIP on adding a new state to KafkaStreams#state(). It is very simple, so this should pass relatively quickly! Here is the discussion link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-457%3A+Add+DISCONNECTED+status+to+Kafka+Streams Cheers, Richard

Build failed in Jenkins: kafka-1.1-jdk7 #257

2019-04-16 Thread Apache Jenkins Server
See Changes: [bill] KAFKA-8209: Wrong link for KStreams DSL in core concepts doc (#6564) -- [...truncated 1.51 MB...] W extends Window declared in method

Build failed in Jenkins: kafka-2.1-jdk8 #161

2019-04-16 Thread Apache Jenkins Server
See Changes: [bill] KAFKA-8208: Change paper link directly to ASM (#6572) -- [...truncated 255.85 KB...] kafka.server.KafkaMetricReporterClusterIdTest > testClusterIdPresent

[jira] [Created] (KAFKA-8243) Flaky Test RequestQuotaTest#testResponseThrottleTimeWhenBothProduceAndRequestQuotasViolated

2019-04-16 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8243: -- Summary: Flaky Test RequestQuotaTest#testResponseThrottleTimeWhenBothProduceAndRequestQuotasViolated Key: KAFKA-8243 URL: https://issues.apache.org/jira/browse/KAFKA-8243

Build failed in Jenkins: kafka-trunk-jdk11 #440

2019-04-16 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7778: document scala suppress API (#6586) -- [...truncated 2.38 MB...] org.apache.kafka.connect.transforms.CastTest >

Build failed in Jenkins: kafka-2.0-jdk8 #248

2019-04-16 Thread Apache Jenkins Server
See Changes: [bill] KAFKA-8210: Fix link for streams table duality (#6573) -- [...truncated 437.53 KB...] kafka.controller.PartitionStateMachineTest >

Jenkins build is back to normal : kafka-trunk-jdk8 #3558

2019-04-16 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-450: Sliding Window Aggregations in the DSL

2019-04-16 Thread Matthias J. Sax
Thanks Sophie! Regarding (4), I am in favor to support both. Not sure if we can reuse existing window store (with enabling to store duplicates) for this case or not though, or if we need to design a new store to keep all raw records? Btw: for holistic aggregations, like media, we would need to

Re: KIP-457: Add DISCONNECTED state to Kafka Streams

2019-04-16 Thread Matthias J. Sax
Thanks for the initiative. In the motivation you mention that you want to use DISCONNECT to indicate that the application was killed. What is the difference to existing state DEAD? Also, the backing JIRA seems to have a different motivation to add a DISCONNECT state. There, the Kafka Streams

Re: KIP-457: Add DISCONNECTED state to Kafka Streams

2019-04-16 Thread Richard Yu
Oh, I probably misunderstood the difference between DISCONNECTED and DEAD. I will update the KIP accordingly. Thanks for pointing that out! On Tue, Apr 16, 2019 at 3:13 PM Matthias J. Sax wrote: > Thanks for the initiative. > > In the motivation you mention that you want to use DISCONNECT to >

Build failed in Jenkins: kafka-1.1-jdk7 #259

2019-04-16 Thread Apache Jenkins Server
See Changes: [matthias] MINOR: code cleanup TopologyTestDriverTest (#6504) -- [...truncated 1.51 MB...]

[jira] [Created] (KAFKA-8245) Flaky Test DeleteConsumerGroupsTest#testDeleteCmdAllGroups

2019-04-16 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8245: -- Summary: Flaky Test DeleteConsumerGroupsTest#testDeleteCmdAllGroups Key: KAFKA-8245 URL: https://issues.apache.org/jira/browse/KAFKA-8245 Project: Kafka

Re: [DISCUSSION] KIP-421: Automatically resolve external configurations.

2019-04-16 Thread Colin McCabe
Thanks, Tejal. Looks good overall. > This KIP will enable all the components broker, connect, producer, consumer, > admin client, > and so forth. to automatically resolve the external configurations. It would be nice to spell out that these components all automatically resolve external

Build failed in Jenkins: kafka-trunk-jdk8 #3561

2019-04-16 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-2.1-jdk8 #163

2019-04-16 Thread Apache Jenkins Server
See Changes: [matthias] MINOR: fixed missing close of Iterator, used try-with-resource where -- [...truncated 762.76 KB...] > Task :connect:file:spotbugsMain > Task

Build failed in Jenkins: kafka-1.1-jdk7 #258

2019-04-16 Thread Apache Jenkins Server
See Changes: [matthias] MINOR: fixed missing close of Iterator, used try-with-resource where -- [...truncated 1.51 MB...] public void print(final Serde keySerde,

Build failed in Jenkins: kafka-trunk-jdk8 #3560

2019-04-16 Thread Apache Jenkins Server
See -- Started by an SCM change Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Jenkins build is back to normal : kafka-trunk-jdk11 #441

2019-04-16 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-446: Add changelog topic configuration to KTable suppress

2019-04-16 Thread John Roesler
Thanks all, for your comments! I'm on board with the consensus, so it sounds like your KIP is fine as-is, Maarten. Would you like to start the vote thread? (just look at the mailing list for other examples) Thanks, -John On Sat, Apr 13, 2019 at 5:26 PM Matthias J. Sax wrote: > > Are you sure

Build failed in Jenkins: kafka-2.0-jdk8 #249

2019-04-16 Thread Apache Jenkins Server
See Changes: [matthias] MINOR: fixed missing close of Iterator, used try-with-resource where [matthias] MINOR: code cleanup TopologyTestDriverTest (#6504) -- [...truncated

Build failed in Jenkins: kafka-trunk-jdk8 #3562

2019-04-16 Thread Apache Jenkins Server
See Changes: [colin] KAFKA-7466: Add IncrementalAlterConfigs API (KIP-339) (#6247) [mjsax] MINOR: fixed missing close of Iterator, used try-with-resource where --

Build failed in Jenkins: kafka-2.1-jdk8 #162

2019-04-16 Thread Apache Jenkins Server
See Changes: [bill] KAFKA-8209: Wrong link for KStreams DSL in core concepts doc (#6564) [bill] KAFKA-8210: Fix link for streams table duality (#6573) -- [...truncated

[jira] [Resolved] (KAFKA-7466) Implement KIP-339: Create a new IncrementalAlterConfigs API

2019-04-16 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7466. -- Resolution: Fixed Reviewer: Colin P. McCabe Fix Version/s: 2.3.0 > Implement KIP-339:

[jira] [Created] (KAFKA-8244) Flaky Test GroupAuthorizerIntegrationTest#shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessDuringSend

2019-04-16 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8244: -- Summary: Flaky Test GroupAuthorizerIntegrationTest#shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessDuringSend Key: KAFKA-8244 URL:

Re: KIP-457: Add DISCONNECTED state to Kafka Streams

2019-04-16 Thread Richard Yu
Hi all, Considering that this is a simple KIP, I would probably start the voting tomorrow. I think it would be good if we could get this in fast. On Tue, Apr 16, 2019 at 3:31 PM Richard Yu wrote: > Oh, I probably misunderstood the difference between DISCONNECTED and DEAD. > I will update the

[jira] [Created] (KAFKA-8246) refactor topic/group instance id validation condition

2019-04-16 Thread Boyang Chen (JIRA)
Boyang Chen created KAFKA-8246: -- Summary: refactor topic/group instance id validation condition Key: KAFKA-8246 URL: https://issues.apache.org/jira/browse/KAFKA-8246 Project: Kafka Issue Type:

Build failed in Jenkins: kafka-trunk-jdk8 #3557

2019-04-16 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7778: Add KTable.suppress to Scala API (#6314) [vahid.hashemian] KAFKA-7471: Multiple Consumer Group Management Feature (#5726) --

[jira] [Created] (KAFKA-8239) Flaky Test PlaintextConsumerTest#testAutoCommitIntercept

2019-04-16 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8239: -- Summary: Flaky Test PlaintextConsumerTest#testAutoCommitIntercept Key: KAFKA-8239 URL: https://issues.apache.org/jira/browse/KAFKA-8239 Project: Kafka

[jira] [Created] (KAFKA-8240) Source.equals() can fail with NPE

2019-04-16 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8240: -- Summary: Source.equals() can fail with NPE Key: KAFKA-8240 URL: https://issues.apache.org/jira/browse/KAFKA-8240 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-8241) Dynamic update of keystore fails on listener without truststore

2019-04-16 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-8241: - Summary: Dynamic update of keystore fails on listener without truststore Key: KAFKA-8241 URL: https://issues.apache.org/jira/browse/KAFKA-8241 Project: Kafka

[jira] [Resolved] (KAFKA-8235) NoSuchElementException when restoring state after a clean shutdown of a Kafka Streams application

2019-04-16 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8235. Resolution: Invalid Closing this as "invalid" because the reported issue is part of a PR