[jira] [Created] (KAFKA-7688) Allow byte array class for Decimal Logical Types to fix Debezium Issues

2018-11-29 Thread Eric C Abis (JIRA)
Eric C Abis created KAFKA-7688: -- Summary: Allow byte array class for Decimal Logical Types to fix Debezium Issues Key: KAFKA-7688 URL: https://issues.apache.org/jira/browse/KAFKA-7688 Project: Kafka

[jira] [Created] (KAFKA-7687) Print batch level information in DumpLogSegments when deep iterating

2018-11-29 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-7687: -- Summary: Print batch level information in DumpLogSegments when deep iterating Key: KAFKA-7687 URL: https://issues.apache.org/jira/browse/KAFKA-7687 Project:

[jira] [Created] (KAFKA-7689) Add Commit/List Offsets Operations to AdminClient

2018-11-29 Thread Mickael Maison (JIRA)
Mickael Maison created KAFKA-7689: - Summary: Add Commit/List Offsets Operations to AdminClient Key: KAFKA-7689 URL: https://issues.apache.org/jira/browse/KAFKA-7689 Project: Kafka Issue

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-11-29 Thread Ryanne Dolan
Sönke, thanks for the feedback! > the renaming policy [...] can be disabled [...] The KIP itself does not mention this Good catch. I've updated the KIP to call this out. > "MirrorMaker clusters" I am not sure I fully understand the issue you are trying to solve MirrorMaker today is not

Re: [DISCUSS] KIP-394: Require member.id for initial join group request

2018-11-29 Thread Matthias J. Sax
Thanks! Makes sense. I missed that fact, that the `member.id` is added on the second joinGroup request that contains the `member.id`. However, it seems there is another race condition for this design: If two consumers join at the same time, it it possible that the broker assigns the same

Build failed in Jenkins: kafka-trunk-jdk8 #3228

2018-11-29 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7660: fix parentSensors memory leak (#5953) -- [...truncated 2.63 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [DISCUSS] KIP-388 Add observer interface to record request and response

2018-11-29 Thread Lincong Li
Hi everyone, Thanks for all feedback on this KIP. I have had some lengthy offline discussions with Dong, Joel and other insightful developers. I updated KIP 388 and proposed a

Build failed in Jenkins: kafka-trunk-jdk8 #3227

2018-11-29 Thread Apache Jenkins Server
See Changes: [manikumar.reddy] MINOR: Fix ProducerPerformance bug when numRecords > Integer.MAX (#5956) -- [...truncated 2.59 MB...]

Re: [DISCUSS] KIP-360: Improve handling of unknown producer

2018-11-29 Thread Jason Gustafson
Hey Guozhang, To clarify, the broker does not actually use the ApiVersion API for inter-broker communications. The use of an API and its corresponding version is controlled by `inter.broker.protocol.version`. Nevertheless, it sounds like we're on the same page about removing

Re: [DISCUSS] KIP-252: Extend ACLs to allow filtering based on ip ranges and subnets

2018-11-29 Thread Sönke Liebau
This has been dormant for a while now, can I interest anybody in chiming in here? I think we need to come up with an idea of how to handle changes to ACLs going forward, i.e. some sort of versioning scheme. Not necessarily what I proposed in my previous mail, but something. Currently this fairly

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

2018-11-29 Thread John Roesler
Actually, I've been thinking more about my feedback #1 on the method name, and I'm not so sure it's a good idea. Following SQL, the existing join methods are named according to handedness (inner/outer/left). All these joins are the same cardinality (1:1 joins). I think it would be a mistake to

kafka Build fail - jdk 8 - #18041

2018-11-29 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi All, Facing below build failure. 20:19:43 20:19:43 > Task :streams:test-utils:integrationTest 20:19:43 > Task :streams:upgrade-system-tests-0100:integrationTest 20:19:43 > Task :streams:upgrade-system-tests-0101:integrationTest 20:19:43 > Task

[jira] [Created] (KAFKA-7690) Change disk allocation policy for multiple partitions on a broker when topic is created

2018-11-29 Thread haiyangyu (JIRA)
haiyangyu created KAFKA-7690: Summary: Change disk allocation policy for multiple partitions on a broker when topic is created Key: KAFKA-7690 URL: https://issues.apache.org/jira/browse/KAFKA-7690

Re: kafka Build fail - jdk 8 - #18041

2018-11-29 Thread Manikumar
HI Srinivas, They are mostly transient test failures. We can rerun the test to confirm the failures. You can re-trigger the jenkins tests by commenting "retest this please" in PR comments. On Fri, Nov 30, 2018 at 12:04 PM Srinivas, Kaushik (Nokia - IN/Bangalore) < kaushik.srini...@nokia.com>

Build failed in Jenkins: kafka-trunk-jdk8 #3229

2018-11-29 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Bump Gradle version to 5.0 (#5964) -- [...truncated 2.65 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Resolved] (KAFKA-7259) Remove deprecated ZKUtils usage from ZkSecurityMigrator

2018-11-29 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7259. -- Resolution: Fixed Issue resolved by pull request 5480 [https://github.com/apache/kafka/pull/5480] >

[jira] [Resolved] (KAFKA-7551) Refactor to create both producer & consumer in Worker

2018-11-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7551. -- Resolution: Fixed Merged [https://github.com/apache/kafka/pull/5842,] my bad

Build failed in Jenkins: kafka-trunk-jdk8 #3230

2018-11-29 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7660: Fix child sensor memory leak (#5974) -- [...truncated 2.64 MB...] kafka.utils.SchedulerTest > testRestart STARTED

kafka jenkins build fail - JDK 8 and Scala 2.11

2018-11-29 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi All, Have created a pull request with changes to kafka performance producer java code. But Build has failed with below errors for JDK 8 and Scala 2.11, kafka.api.SaslSslAdminClientIntegrationTest > testMinimumRequestTimeouts FAILED 19:20:31 java.lang.AssertionError: Expected an

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-29 Thread Boyang Chen
In fact I feel that it's more convenient for user to specify a list of instance id prefixes. Because for general consumer application we couldn't always find a proper prefix to remove a list of consumers. So we are either adding list[instanceid prefix], or we could add two fields: instanceid

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-11-29 Thread Sönke Liebau
Hi Ryanne, first of all, thanks for the KIP, great work overall and much needed I think! I have a small comment on the renaming policy, in one of the mails on this thread you mention that this can be disabled (to replicate topic1 in cluster A as topic1 on cluster B I assume). The KIP itself does

Requesting permission to create KIP

2018-11-29 Thread Brandon Kirchner
Hello, Could you please grant me (brandon.kirchner) permission to create a KIP? Thanks! Brandon K.

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

2018-11-29 Thread John Roesler
Hi all, Sorry that this discussion petered out... I think the 2.1 release caused an extended distraction that pushed it off everyone's radar (which was precisely Adam's concern). Personally, I've also had some extend distractions of my own that kept (and continue to keep) me preoccupied.

I'd like permissions to publish a KIP

2018-11-29 Thread Noa Resare
Greetings friends, I have a proposal for a tiny change that would alter configuration semantics slightly, so it seems like something that should be handled through the KIP process. Could I get permission? My account on cwiki is ‘noa’ cheers noa

Re: Requesting permission to create KIP

2018-11-29 Thread Manikumar
Thanks for your interest. I have given you the permissions. On Thu, Nov 29, 2018 at 8:24 PM Brandon Kirchner wrote: > Hello, > > Could you please grant me (brandon.kirchner) permission to create a KIP? > > Thanks! > Brandon K. >

Re: I'd like permissions to publish a KIP

2018-11-29 Thread Manikumar
Thanks for your interest. I have given you the wiki permissions. On Thu, Nov 29, 2018 at 10:03 PM Noa Resare wrote: > Greetings friends, > > I have a proposal for a tiny change that would alter configuration > semantics slightly, so it seems like something that should be handled > through the