[GitHub] [kafka-site] miguno commented on pull request #334: KAFKA-12393: Document multi-tenancy considerations

2021-03-01 Thread GitBox
miguno commented on pull request #334: URL: https://github.com/apache/kafka-site/pull/334#issuecomment-788696584 @bbejeck wrote in https://github.com/apache/kafka-site/pull/334#pullrequestreview-600990037: > Also, @miguno, can you create an identical PR to go against docs in AK trunk?

[jira] [Created] (KAFKA-12399) Add log4j2 Appender

2021-03-01 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-12399: --- Summary: Add log4j2 Appender Key: KAFKA-12399 URL: https://issues.apache.org/jira/browse/KAFKA-12399 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-12398) Fix flaky test `ConsumerBounceTest.testClose`

2021-03-01 Thread dengziming (Jira)
dengziming created KAFKA-12398: -- Summary: Fix flaky test `ConsumerBounceTest.testClose` Key: KAFKA-12398 URL: https://issues.apache.org/jira/browse/KAFKA-12398 Project: Kafka Issue Type:

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #100

2021-03-01 Thread Apache Jenkins Server
See Changes: [Randall Hauch] KAFKA-10340: Proactively close producer when cancelling source tasks (#10016) -- [...truncated 6.35 MB...]

[jira] [Created] (KAFKA-12397) Error:KeeperErrorCode = BadVersion for /brokers/topics

2021-03-01 Thread Sachin (Jira)
Sachin created KAFKA-12397: -- Summary: Error:KeeperErrorCode = BadVersion for /brokers/topics Key: KAFKA-12397 URL: https://issues.apache.org/jira/browse/KAFKA-12397 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-03-01 Thread Matthias J. Sax
> but the user should > not rely on all tasks being returned at any given time to begin with since > it's possible we are in between revoking and re-assigning a partition. Exactly. That is what I meant: the "hand off" phase of partitions during a rebalance. During this phase, some tasks are

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-03-01 Thread Walker Carlson
I updated to use Optional, good idea Mathias. For the localThreadMetadata, it could already be called running a rebalance. Also I mention that they return the highest value they had seen so far for any tasks they have assigned to them. I thought it would be useful to see the TaskMetadata while

Re: [VOTE] KIP-715: Expose Committed offset in streams

2021-03-01 Thread Guozhang Wang
Thanks Walker for the updated KIP, +1 (binding) Guozhang On Mon, Mar 1, 2021 at 3:47 PM Sophie Blee-Goldman wrote: > Thanks for the KIP! +1 (binding) > > Sophie > > On Mon, Mar 1, 2021 at 10:04 AM Leah Thomas wrote: > > > Hey Walker, > > > > Thanks for leading this discussion. +1 from me,

Re: [VOTE] KIP-715: Expose Committed offset in streams

2021-03-01 Thread Sophie Blee-Goldman
Thanks for the KIP! +1 (binding) Sophie On Mon, Mar 1, 2021 at 10:04 AM Leah Thomas wrote: > Hey Walker, > > Thanks for leading this discussion. +1 from me, non-binding > > Leah > > On Mon, Mar 1, 2021 at 12:37 AM Boyang Chen > wrote: > > > Thanks Walker for the proposal, +1 (binding) from

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-03-01 Thread Sophie Blee-Goldman
Can you clarify your second question Matthias? If this is queried during a cooperative rebalance, it should return the tasks as usual. If the user is using eager rebalancing then this will not return any tasks, but the user should not rely on all tasks being returned at any given time to begin

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #526

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove stack trace of the lock exception in a debug log4j (#10231) [github] KAFKA-12323 Follow-up: Refactor the unit test a bit (#10205)

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #556

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12323 Follow-up: Refactor the unit test a bit (#10205) -- [...truncated 3.65 MB...] ControllerChannelManagerTest >

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #45

2021-03-01 Thread Apache Jenkins Server
See Changes: [Guozhang Wang] KAFKA-12323 Follow-up: Refactor the unit test a bit (#10205) -- [...truncated 3.62 MB...] SocketServerTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #582

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] MINOR: Word count should account for extra whitespaces between words (#10229) [github] MINOR: Remove stack trace of the lock exception in a debug log4j (#10231) [github]

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #129

2021-03-01 Thread Apache Jenkins Server
See Changes: [Guozhang Wang] KAFKA-12323 Follow-up: Refactor the unit test a bit (#10205) -- [...truncated 3.45 MB...]

[jira] [Created] (KAFKA-12396) Dedicated exception for kstreams when null key received

2021-03-01 Thread Veniamin Kalegin (Jira)
Veniamin Kalegin created KAFKA-12396: Summary: Dedicated exception for kstreams when null key received Key: KAFKA-12396 URL: https://issues.apache.org/jira/browse/KAFKA-12396 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #555

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] MINOR; Small refactor in `GroupMetadata` (#10236) [github] MINOR: Word count should account for extra whitespaces between words (#10229) [github] MINOR: Remove stack trace

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

2021-03-01 Thread Bruno Cadonna
Thank Levani for the update on the KIP! The KIP looks good! I have just a couple of comments. 1. Could you try to formulate "The ideal distribution means there is no repeated client dimension amongst clients assigned to the active task and all standby tasks." a bit differently. I find it a

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #581

2021-03-01 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-12395) Drop topic mapKey in DeleteTopics response

2021-03-01 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12395: --- Summary: Drop topic mapKey in DeleteTopics response Key: KAFKA-12395 URL: https://issues.apache.org/jira/browse/KAFKA-12395 Project: Kafka Issue Type:

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #525

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] MINOR; Small refactor in `GroupMetadata` (#10236) [github] MINOR: Word count should account for extra whitespaces between words (#10229)

[jira] [Created] (KAFKA-12394) Consider topic id existence and authorization errors

2021-03-01 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12394: --- Summary: Consider topic id existence and authorization errors Key: KAFKA-12394 URL: https://issues.apache.org/jira/browse/KAFKA-12394 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #554

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10340: Proactively close producer when cancelling source tasks (#10016) -- [...truncated 7.33 MB...]

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

2021-03-01 Thread Matthias J. Sax
Thanks the updating the KIP Walker. About, `timeCurrentIdlingStarted()`: should we return an `Optional` instead of `-1` if a task is not idling. As we allow to call `localThreadMetadata()` any time, could it be that we report partial information during a rebalance? If yes, this should be

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #128

2021-03-01 Thread Apache Jenkins Server
See Changes: [Randall Hauch] KAFKA-10340: Proactively close producer when cancelling source tasks (#10016) -- [...truncated 3.45 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #524

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10340: Proactively close producer when cancelling source tasks (#10016) -- [...truncated 7.29 MB...] ReplicaStateMachineTest >

Re: [VOTE] KIP-715: Expose Committed offset in streams

2021-03-01 Thread Leah Thomas
Hey Walker, Thanks for leading this discussion. +1 from me, non-binding Leah On Mon, Mar 1, 2021 at 12:37 AM Boyang Chen wrote: > Thanks Walker for the proposal, +1 (binding) from me. > > On Fri, Feb 26, 2021 at 12:42 PM Walker Carlson > wrote: > > > Hello all, > > > > I would like to bring

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #580

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12329; kafka-reassign-partitions command should give a better error message when a topic does not exist (#10141) --

Re: [DISCUSS] Apache Kafka 2.8.0 release

2021-03-01 Thread Dhruvil Shah
Hi John, I would like to bring up https://issues.apache.org/jira/browse/KAFKA-12254 as a blocker candidate for 2.8.0. While this is not a regression, the issue could lead to data loss in certain cases. The fix is trivial so it may be worth bringing it into 2.8.0. Let me know what you think. -

[GitHub] [kafka-site] miguno commented on pull request #334: KAFKA-12393: Document multi-tenancy considerations

2021-03-01 Thread GitBox
miguno commented on pull request #334: URL: https://github.com/apache/kafka-site/pull/334#issuecomment-788089637 cc to committer @rajinisivaram as the SME on this subject, and who has the most context This is an automated

Re: [DISCUSS] KIP-567: Kafka Cluster Audit (new discussion)

2021-03-01 Thread Viktor Somogyi-Vass
Hey Everyone, Tried out a new format to get some attention and also to make understanding easier, so I recorded a 15 min long video about this KIP. https://www.youtube.com/watch?v=uOJTyAEJmB8=youtu.be Sorry for the sound quality but recording a video isn't a thing for me and also I look like

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #523

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12329; kafka-reassign-partitions command should give a better error message when a topic does not exist (#10141) --

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #553

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12329; kafka-reassign-partitions command should give a better error message when a topic does not exist (#10141) --

[GitHub] [kafka-site] miguno opened a new pull request #334: KAFKA-12393: Document multi-tenancy considerations

2021-03-01 Thread GitBox
miguno opened a new pull request #334: URL: https://github.com/apache/kafka-site/pull/334 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Created] (KAFKA-12393) Document multi-tenancy considerations

2021-03-01 Thread Michael G. Noll (Jira)
Michael G. Noll created KAFKA-12393: --- Summary: Document multi-tenancy considerations Key: KAFKA-12393 URL: https://issues.apache.org/jira/browse/KAFKA-12393 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-12329) kafka-reassign-partitions command should give a better error message when a topic does not exist

2021-03-01 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-12329. - Fix Version/s: 3.0.0 Resolution: Fixed > kafka-reassign-partitions command should give a

[DISCUSS] KIP-717: Deprecate batch-size config from console producer

2021-03-01 Thread Kamal Chandraprakash
Hi, Please take a look at KIP-717. Request for your comments. https://cwiki.apache.org/confluence/x/DB1RCg Thanks, Kamal

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #522

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12254: Ensure MM2 creates topics with source topic configs (#10217) -- [...truncated 3.65 MB...] LogValidatorTest >

[jira] [Created] (KAFKA-12392) Deprecate batch-size config from console producer

2021-03-01 Thread Kamal Chandraprakash (Jira)
Kamal Chandraprakash created KAFKA-12392: Summary: Deprecate batch-size config from console producer Key: KAFKA-12392 URL: https://issues.apache.org/jira/browse/KAFKA-12392 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #579

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12254: Ensure MM2 creates topics with source topic configs (#10217) -- [...truncated 3.67 MB...] UserQuotaTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #552

2021-03-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12254: Ensure MM2 creates topics with source topic configs (#10217) -- [...truncated 3.65 MB...] ControllerChannelManagerTest

Re: [VOTE] KIP-699: Update FindCoordinator to resolve multiple Coordinators at a time

2021-03-01 Thread Tom Bentley
+1 (non-binding), thanks Mickael. On Thu, Feb 25, 2021 at 6:32 PM Mickael Maison wrote: > Hi, > > I'd like to start a vote on KIP-699 to support resolving multiple > coordinators at a time: > >

[jira] [Created] (KAFKA-12391) Add an option to store arbitrary metadata to a SourceRecord

2021-03-01 Thread Luca Burgazzoli (Jira)
Luca Burgazzoli created KAFKA-12391: --- Summary: Add an option to store arbitrary metadata to a SourceRecord Key: KAFKA-12391 URL: https://issues.apache.org/jira/browse/KAFKA-12391 Project: Kafka

[jira] [Created] (KAFKA-12390) error when storing group assignment during SyncGroup

2021-03-01 Thread Andrey (Jira)
Andrey created KAFKA-12390: -- Summary: error when storing group assignment during SyncGroup Key: KAFKA-12390 URL: https://issues.apache.org/jira/browse/KAFKA-12390 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-12389) Upgrade of netty-codec due to CVE-2021-21290

2021-03-01 Thread Dominique Mongelli (Jira)
Dominique Mongelli created KAFKA-12389: -- Summary: Upgrade of netty-codec due to CVE-2021-21290 Key: KAFKA-12389 URL: https://issues.apache.org/jira/browse/KAFKA-12389 Project: Kafka