Jenkins build is back to normal : kafka-trunk-jdk11 #1072

2020-01-10 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #4150

2020-01-10 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Remove `updatePartitionReplicaAssignment` from -- [...truncated 2.81 MB...] org.apache.kafka.streams.MockTimeTest > shouldGetNanosAsMillis

Re: [DISCUSS] KIP-550: Mechanism to Delete Stray Partitions on Broker

2020-01-10 Thread Nikhil Bhatia
Thanks Dhruvil, the proposal looks reasonable to me. is there a potential of a race between a new topic being assigned to the same node that is still performing a cleanup of the stray partition ? Topic ID will definitely solve this issue. Thanks Nikhil On 2020/01/06 04:30:20, Dhruvil Shah

[KAFKA-557] Add emit on change support for Kafka Streams

2020-01-10 Thread Richard Yu
Hi everybody! I'd like to propose a change that we probably should've added for a long time now. The key benefit of this KIP would be reduced traffic in Kafka Streams since a lot of no-op results would no longer be sent downstream. Here is the KIP for reference.

Jenkins build is back to normal : kafka-trunk-jdk8 #4149

2020-01-10 Thread Apache Jenkins Server
See

[DISCUSS] KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions

2020-01-10 Thread am
Hello, I would like to re-restart the discussion of KIP-399 https://cwiki.apache.org/confluence/display/KAFKA/KIP-399%3A+Extend+ProductionExceptionHandler+to+cover+serialization+exceptions The last conversation centered on if this KIP should address the issues around state store/change log

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

2020-01-10 Thread Mitchell
I"m very pro this. The sooner we can make people aware that zookeeper is going away the better. -mitch On Fri, Jan 10, 2020 at 4:37 PM Jose Garcia Sancio wrote: > > Comments below. > > On Thu, Jan 9, 2020 at 5:03 PM Colin McCabe wrote: > > > That's a good question. The current plan is for the

Re: [DISCUSS] KIP-515: Enable ZK client to use the new TLS supported authentication

2020-01-10 Thread Zhou, Thomas
Hi Pere, It is a very meaningful KIP to make kafka broker -> ZK connection secured. In the meanwhile, there is another KIP under discussion talking about making SSLContext pluggle on broker side - https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=128650952. Instead of putting

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

2020-01-10 Thread Jose Garcia Sancio
Comments below. On Thu, Jan 9, 2020 at 5:03 PM Colin McCabe wrote: > That's a good question. The current plan is for the 3.x releases to still > require ZooKeeper. What we will drop in 3.x is direct ZK access in > command-line administrative tools (unless those tools are specifically > about

Re: [VOTE] KIP-551: Expose disk read and write metrics

2020-01-10 Thread Jose Garcia Sancio
+1, LGTM. On Fri, Jan 10, 2020 at 2:19 PM Gwen Shapira wrote: > +1, thanks for driving this > > On Fri, Jan 10, 2020 at 2:17 PM Colin McCabe wrote: > > > > Hi all, > > > > I'd like to start the vote on KIP-551: Expose disk read and write > metrics. > > > > KIP:

Re: [VOTE] KIP-551: Expose disk read and write metrics

2020-01-10 Thread Gwen Shapira
+1, thanks for driving this On Fri, Jan 10, 2020 at 2:17 PM Colin McCabe wrote: > > Hi all, > > I'd like to start the vote on KIP-551: Expose disk read and write metrics. > > KIP: https://cwiki.apache.org/confluence/x/sotSC > > Discussion thread: >

[VOTE] KIP-551: Expose disk read and write metrics

2020-01-10 Thread Colin McCabe
Hi all, I'd like to start the vote on KIP-551: Expose disk read and write metrics. KIP: https://cwiki.apache.org/confluence/x/sotSC Discussion thread: https://lists.apache.org/thread.html/cfaac4426455406abe890464a7f4ae23a5c69a39afde66fe6eb3d696%40%3Cdev.kafka.apache.org%3E cheers, Colin

Build failed in Jenkins: kafka-trunk-jdk11 #1071

2020-01-10 Thread Apache Jenkins Server
See Changes: [github] MINOR: JavaDoc cleanup (#7873) -- [...truncated 1.51 MB...] kafka.server.AbstractFetcherThreadTest > testFollowerFetchOutOfRangeLow PASSED

[jira] [Created] (KAFKA-9399) Flaky Test BranchedMultiLevelRepartitionConnectedTopologyTest.testTopologyBuild

2020-01-10 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-9399: -- Summary: Flaky Test BranchedMultiLevelRepartitionConnectedTopologyTest.testTopologyBuild Key: KAFKA-9399 URL: https://issues.apache.org/jira/browse/KAFKA-9399

[jira] [Resolved] (KAFKA-6571) KafkaProducer.close(0) should be non-blocking

2020-01-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6571. Resolution: Duplicate KIP-367 add `close(Duration)` with new non-blocking semantics: 

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2020-01-10 Thread Vinoth Chandar
+1 on a streams config to control this behavior. I have no strong opinions on the default, but I would pick allowing to query if standbys are enabled else throw the exception.. But we can keep it simpler, throw exception by default and have a flag to turn it off, as you suggest as well. On Thu,

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

2020-01-10 Thread Colin McCabe
Hi Ron, Good question. Fortunately, kafka-configs.sh already supports --bootstrap-server. It should have full functionality now without --zookeeper. best, Colin On Fri, Jan 10, 2020, at 05:02, Ron Dagostino wrote: > Hi Colin. Will there be replacement/alternate connectivity for >

Re: [VOTE] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2020-01-10 Thread Gwen Shapira
Sorry for the super late reply, but since the vote thread showed up, I've read the KIP and have a concern. The concern was raised by Matthias Sax earlier, but I didn't see it addressed. Basically the current iteration of the KIP unifies deserialization errors with corruption. As was pointed out,

[jira] [Created] (KAFKA-9398) Kafka Streams main thread may not exit even after close timeout has passed

2020-01-10 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-9398: -- Summary: Kafka Streams main thread may not exit even after close timeout has passed Key: KAFKA-9398 URL: https://issues.apache.org/jira/browse/KAFKA-9398 Project: Kafka

Jenkins build is back to normal : kafka-trunk-jdk11 #1070

2020-01-10 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #4148

2020-01-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9188; Fix flaky test -- [...truncated 2.81 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldNotUpdateStoreForSmallerValue[Eos

Re: [DISCUSS] KIP-555: Deprecate Direct Zookeeper access in Kafka Administrative Tools

2020-01-10 Thread Ron Dagostino
Hi Colin. Will there be replacement/alternate connectivity for kafka-configs.sh? Deprecating ZooKeeper access alone without adding "--bootstrap-server" (for example) would be insufficient, right? Ron On Thu, Jan 9, 2020 at 7:45 PM Jose Garcia Sancio wrote: > Thanks Colin, > > For the tools

Build failed in Jenkins: kafka-2.4-jdk8 #126

2020-01-10 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Disable JmxTool in kafkatest console-consumer by default (#7785) -- [...truncated 5.49 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: kafka-trunk-jdk8 #4147

2020-01-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9294: Add tests for Named parameter (#7874) [github] KAFKA-8421: Still return data during rebalance (#7312) [jason] MINOR: Disable JmxTool in kafkatest console-consumer by default

[jira] [Resolved] (KAFKA-9188) Flaky Test SslAdminClientIntegrationTest.testSynchronousAuthorizerAclUpdatesBlockRequestThreads

2020-01-10 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9188. --- Fix Version/s: 2.5.0 Reviewer: Manikumar Resolution: Fixed > Flaky Test >

Build failed in Jenkins: kafka-trunk-jdk11 #1069

2020-01-10 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Disable JmxTool in kafkatest console-consumer by default (#7785) [jason] KAFKA-8617: Use automated protocol for `EndTxn` API (#7029) --