[jira] [Created] (KAFKA-12253) Add tests that cover all of all of the cases for ReplicatedLog::validateOffsetAndEpoch

2021-01-29 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-12253: -- Summary: Add tests that cover all of all of the cases for ReplicatedLog::validateOffsetAndEpoch Key: KAFKA-12253 URL:

[jira] [Created] (KAFKA-12258) Change the BatchAccumulator to split records into batches

2021-01-29 Thread Alok Nikhil (Jira)
Alok Nikhil created KAFKA-12258: --- Summary: Change the BatchAccumulator to split records into batches Key: KAFKA-12258 URL: https://issues.apache.org/jira/browse/KAFKA-12258 Project: Kafka

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-29 Thread Boyang Chen
This is a great proposal Jason, I already integrated KIP-691 with KIP-706 template to provide a new ProduceFailedException as well as a new Producer#produce API with CompletionStage as old send API replacement with a richer return type. Let me know if you are good with this, and whether Chia-Ping

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #422

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10604: Fix Streams default state.dir (#9420) -- [...truncated 7.12 MB...] LogValidatorTest >

[jira] [Resolved] (KAFKA-10866) Add fetched metadata to ConsumerRecords

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10866. - Resolution: Fixed > Add fetched metadata to ConsumerRecords >

[jira] [Resolved] (KAFKA-10091) Improve task idling

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10091. - Resolution: Fixed > Improve task idling > --- > > Key:

[jira] [Resolved] (KAFKA-10867) Implement improved semantics using the ConsumerRecords meta

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10867. - Resolution: Fixed > Implement improved semantics using the ConsumerRecords meta >

[jira] [Resolved] (KAFKA-10015) React Smartly to Unexpected Errors on Stream Threads

2021-01-29 Thread Walker Carlson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walker Carlson resolved KAFKA-10015. Resolution: Fixed > React Smartly to Unexpected Errors on Stream Threads >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #456

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] MINOR: Ensure `InterBrokerSendThread` closes `NetworkClient` (#) [github] KAFKA-10764: Add support for returning topic IDs on create, supplying topic IDs for delete

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #473

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12247: add timeout and static group rebalance to remove thread (#9984) [github] KAFKA-10761; Kafka Raft update log start offset (#9816)

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-29 Thread Jason Gustafson
Hi Boyang, Do you think it's necessary to deprecate the old `onCompletion` callback? I was thinking there's probably no harm leaving it around. Users might not care about the failure type. Other than that, it looks good to me. Thanks, Jason On Thu, Jan 28, 2021 at 6:58 PM Boyang Chen wrote: >

[jira] [Created] (KAFKA-12256) auto commit causes delays due to retribale UNKNOWN_TOPIC_OR_PARTITION

2021-01-29 Thread Ryan Leslie (Jira)
Ryan Leslie created KAFKA-12256: --- Summary: auto commit causes delays due to retribale UNKNOWN_TOPIC_OR_PARTITION Key: KAFKA-12256 URL: https://issues.apache.org/jira/browse/KAFKA-12256 Project: Kafka

[GitHub] [kafka-site] ableegoldman merged pull request #328: Add public key for Anna Sophie Blee-Goldman

2021-01-29 Thread GitBox
ableegoldman merged pull request #328: URL: https://github.com/apache/kafka-site/pull/328 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #455

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] MINOR: update docs for KIP-663, KIP-696, and KIP-671 (#9969) -- [...truncated 3.58 MB...] ControllerIntegrationTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #423

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] MINOR: update docs for KIP-663, KIP-696, and KIP-671 (#9969) [github] MINOR: Ensure `InterBrokerSendThread` closes `NetworkClient` (#) [github] KAFKA-10764: Add support

[jira] [Resolved] (KAFKA-10761) In Raft support nonzero start offset and SnapshotId for the Fetch request handling

2021-01-29 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10761. - Resolution: Fixed > In Raft support nonzero start offset and SnapshotId for the Fetch

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #472

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] MINOR: update docs for KIP-663, KIP-696, and KIP-671 (#9969) [github] MINOR: Ensure `InterBrokerSendThread` closes `NetworkClient` (#) [github] KAFKA-10764: Add support

Re: [DISCUSS] KIP-706: Add method "Producer#produce" to return CompletionStage instead of Future

2021-01-29 Thread Jason Gustafson
Hi Chia-Ping, I think this is a great idea. It is a pity that we cannot continue to use the `send` verb, but I don't see how we can. I know we considered `transmit` as another option which is closer to `send`. That would avoid the redundancy when people choose the common "producer" variable name.

[GitHub] [kafka-site] ableegoldman opened a new pull request #328: Add public key for Anna Sophie Blee-Goldman

2021-01-29 Thread GitBox
ableegoldman opened a new pull request #328: URL: https://github.com/apache/kafka-site/pull/328 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Created] (KAFKA-12255) Investigate allowing for Fetch request that are not validated

2021-01-29 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-12255: -- Summary: Investigate allowing for Fetch request that are not validated Key: KAFKA-12255 URL: https://issues.apache.org/jira/browse/KAFKA-12255

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-29 Thread Jason Gustafson
Hi Boyang, Ok, if we are going to ask all users to update their code anyway, maybe we can get more bang out of this. One of the remaining problems is that a user will only get the richer information if they are supplying a Callback. If they wait on the future, then they will get the usual

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #79

2021-01-29 Thread Apache Jenkins Server
See Changes: [A. Sophie Blee-Goldman] KAFKA-10793: move handling of FindCoordinatorFuture to fix race condition (#9671) -- [...truncated 6.33 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #471

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10604: Fix Streams default state.dir (#9420) -- [...truncated 7.14 MB...] ProducerFailureHandlingTest > testNonExistentTopic()

[jira] [Resolved] (KAFKA-10764) Add support for returning topic IDs on create, supplying topic IDs for delete

2021-01-29 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-10764. Resolution: Fixed > Add support for returning topic IDs on create, supplying topic IDs

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

2021-01-29 Thread Boyang Chen
Thanks Jason, my hope is that we could streamline the callback function signature, so that in the next major release (3.0), onCompletion(RecordMetadata metadata, SendFailure sendFailure) will become the only API to be implemented. On Fri, Jan 29, 2021 at 3:42 PM Jason Gustafson wrote: > Hi

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #424

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12247: add timeout and static group rebalance to remove thread (#9984) [github] KAFKA-10761; Kafka Raft update log start offset (#9816)

[jira] [Created] (KAFKA-12257) Consumer mishandles topics deleted and recreated with the same name

2021-01-29 Thread Ryan Leslie (Jira)
Ryan Leslie created KAFKA-12257: --- Summary: Consumer mishandles topics deleted and recreated with the same name Key: KAFKA-12257 URL: https://issues.apache.org/jira/browse/KAFKA-12257 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #457

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10761; Kafka Raft update log start offset (#9816) -- [...truncated 3.57 MB...] ControllerChannelManagerTest >

[jira] [Created] (KAFKA-12254) MirrorMaker 2.0 creates destination topic with default configs

2021-01-29 Thread Dhruvil Shah (Jira)
Dhruvil Shah created KAFKA-12254: Summary: MirrorMaker 2.0 creates destination topic with default configs Key: KAFKA-12254 URL: https://issues.apache.org/jira/browse/KAFKA-12254 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #474

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12238; Implement `DescribeProducers` API from KIP-664 (#9979) -- [...truncated 3.56 MB...] PlaintextConsumerTest > testSeek()

[jira] [Created] (KAFKA-12259) Consolidated Status endpoint return 500 whe config provider can't find a config

2021-01-29 Thread Magesh kumar Nandakumar (Jira)
Magesh kumar Nandakumar created KAFKA-12259: --- Summary: Consolidated Status endpoint return 500 whe config provider can't find a config Key: KAFKA-12259 URL:

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #458

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12238; Implement `DescribeProducers` API from KIP-664 (#9979) -- [...truncated 3.57 MB...] ControllerEventManagerTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #425

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12238; Implement `DescribeProducers` API from KIP-664 (#9979) -- [...truncated 3.47 MB...] LogValidatorTest >

[jira] [Created] (KAFKA-12251) Add topic ID support to StopReplica

2021-01-29 Thread dengziming (Jira)
dengziming created KAFKA-12251: -- Summary: Add topic ID support to StopReplica Key: KAFKA-12251 URL: https://issues.apache.org/jira/browse/KAFKA-12251 Project: Kafka Issue Type: Sub-task

Re: [VOTE] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

2021-01-29 Thread Bruno Cadonna
Thank you all for voting! This KIP is accepted with - 1 non-binding +1 (Leah) - 4 binding +1 (John, Sophie, Matthias, Guozhang) Best, Bruno On 28.01.21 18:13, Guozhang Wang wrote: +1 again from me. On Thu, Jan 28, 2021 at 8:06 AM John Roesler wrote: Thank you for the KIP, Bruno! I'm +1

[jira] [Created] (KAFKA-12252) Distributed herder tick thread loops rapidly when worker loses leadership

2021-01-29 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-12252: - Summary: Distributed herder tick thread loops rapidly when worker loses leadership Key: KAFKA-12252 URL: https://issues.apache.org/jira/browse/KAFKA-12252 Project:

[jira] [Reopened] (KAFKA-10873) Inaccurate "Ignoring stop request for unowned connector" log messages

2021-01-29 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reopened KAFKA-10873: --- Assignee: (was: Luke Chen) > Inaccurate "Ignoring stop request for unowned connector"

Re: [Connect] Different validation requirements for connector creation and update

2021-01-29 Thread Randall Hauch
Thanks for raising this issue, Gunnar. It is a shortcoming that Connect does not differentiate between starting for the first time and restarting, nor between validating prior to connector creation vs (re)validating a (potentially modified) connector configuration while the connector is running.

[jira] [Resolved] (KAFKA-6876) Sender exceptions ignored by WorkerSourceTask producer Callback causing data loss

2021-01-29 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-6876. -- Resolution: Duplicate > Sender exceptions ignored by WorkerSourceTask producer Callback

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #454

2021-01-29 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10604: Fix Streams default state.dir (#9420) -- [...truncated 3.57 MB...] ControllerChannelManagerTest >