Re: New Jenkins job for master and release branches

2021-04-05 Thread Luke Chen
Thanks Ismael! I love each JDK+Scala combination is built in parallel! Thanks. Luke On Mon, Apr 5, 2021 at 12:24 PM Gwen Shapira wrote: > W00t! This is super awesome. Thank you so much!!! > > On Sun, Apr 4, 2021 at 2:22 PM Ismael Juma wrote: > > > Hi all, > > > > As part of KAFKA-12614 < >

Re: Question on kafka connect's incremental rebalance algorithm

2021-04-05 Thread Luke Chen
Hi Ahmed, I think this bug KAFKA-12495 is the issue you described, which is under code review now. If not, please open another JIRA ticket to track it. Thanks. Luke On Tue, Apr 6, 2021 at 4:18 AM Thouqueer Ahmed < thouqueer.ah...@maplelabs.com>

[jira] [Resolved] (KAFKA-8924) Default grace period (-1) of TimeWindows causes suppress to emit events after 24h

2021-04-05 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-8924. --- Resolution: Duplicate > Default grace period (-1) of TimeWindows causes

Re: [DISCUSS] Please review 2.8.0 blog post

2021-04-05 Thread Sagar
Got it, Thanks for the explanation John! Thanks! Sagar. On Tue, Apr 6, 2021 at 8:16 AM John Roesler wrote: > Oh, my apologies, Sagar, > > That link will not resolve until the release. The release > notes that I prepared as part of the RC are available here: >

[jira] [Resolved] (KAFKA-6603) Kafka streams off heap memory usage does not match expected values from configuration

2021-04-05 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-6603. --- Resolution: Fixed > Kafka streams off heap memory usage does not match

[jira] [Resolved] (KAFKA-8165) Streams task causes Out Of Memory after connection issues and store restoration

2021-04-05 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-8165. --- Resolution: Fixed > Streams task causes Out Of Memory after connection

Re: [DISCUSS] Please review 2.8.0 blog post

2021-04-05 Thread John Roesler
Oh, my apologies, Sagar, That link will not resolve until the release. The release notes that I prepared as part of the RC are available here: https://home.apache.org/~vvcephei/kafka-2.8.0-rc0/RELEASE_NOTES.html I used the post-release link because I didn't want to forget it, but now I see how

Re: [VOTE] KIP-633: Drop 24 hour default of grace period in Streams

2021-04-05 Thread John Roesler
Thanks, Sophie, I’m +1 (binding) -John On Mon, Apr 5, 2021, at 21:34, Sophie Blee-Goldman wrote: > Hey all, > > I'd like to start the voting on KIP-633, to drop the awkward 24 hour grace > period and improve the API to raise visibility on an important concept in > Kafka Streams: grace period

Re: [VOTE] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

2021-04-05 Thread John Roesler
Thanks, Sagar! I’m +1 (binding) -John On Mon, Apr 5, 2021, at 21:35, Sophie Blee-Goldman wrote: > Thanks for the KIP! +1 (binding) from me > > Cheers, > Sophie > > On Mon, Apr 5, 2021 at 7:13 PM Sagar wrote: > > > Hi All, > > > > I would like to start voting on the following KIP: > > > >

Re: [VOTE] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

2021-04-05 Thread Sophie Blee-Goldman
Thanks for the KIP! +1 (binding) from me Cheers, Sophie On Mon, Apr 5, 2021 at 7:13 PM Sagar wrote: > Hi All, > > I would like to start voting on the following KIP: > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=177047930 > > Thanks! > Sagar. >

[VOTE] KIP-633: Drop 24 hour default of grace period in Streams

2021-04-05 Thread Sophie Blee-Goldman
Hey all, I'd like to start the voting on KIP-633, to drop the awkward 24 hour grace period and improve the API to raise visibility on an important concept in Kafka Streams: grace period nad out-of-order data handling. Here's the KIP:

Re: [DISCUSS] Please review 2.8.0 blog post

2021-04-05 Thread Sagar
Hi, I am not sure if others are experiencing it, but when I click on the Release notes link provided on the page, it keeps throwing 404: https://dist.apache.org/repos/dist/release/kafka/2.8.0/RELEASE_NOTES.html Not sure if its an issue but thought I will call it out :D Thanks! Sagar. On Mon,

[VOTE] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

2021-04-05 Thread Sagar
Hi All, I would like to start voting on the following KIP: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=177047930 Thanks! Sagar.

Jenkins build is back to normal : Kafka » kafka-2.6-jdk8 #114

2021-04-05 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #671

2021-04-05 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12294; forward auto topic request within envelope on behalf of clients (#10142) -- [...truncated 3.70 MB...] KafkaZkClientTest

[GitHub] [kafka-site] ableegoldman commented on pull request #345: Fix the formatting of example RocksDBConfigSetter

2021-04-05 Thread GitBox
ableegoldman commented on pull request #345: URL: https://github.com/apache/kafka-site/pull/345#issuecomment-813747095 Hey, thanks for the fix but please revert the 28 folder. For one thing, we don't want the 2.8 docs to go live until 2.8 is actually released. For another, this is just a

Build failed in Jenkins: Kafka » Kafka PR Builder » PR-10479 #2

2021-04-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 206153 lines...] [2021-04-06T00:35:39.709Z] > Task :streams:srcJar [2021-04-06T00:35:39.709Z] > Task :streams:processMessages UP-TO-DATE

[GitHub] [kafka-site] cc13ny opened a new pull request #345: Fix the formatting of example RocksDBConfigSetter

2021-04-05 Thread GitBox
cc13ny opened a new pull request #345: URL: https://github.com/apache/kafka-site/pull/345 https://issues.apache.org/jira/browse/KAFKA-12492 1. Fix the formatting of example RocksDBConfigSetter due to the un-arranged spaces within `` tag. 2. Update it in the folder 27 so that the

Re: [DISCUSS] KIP-718: Make KTable Join on Foreign key unopinionated

2021-04-05 Thread Guozhang Wang
Thanks Marco / John, I think the arguments for not piggy-backing on the existing Materialized makes sense; on the other hand, if we go this route should we just use a separate Materialized than using an extended / narrowed-scoped MaterializedSubscription since it seems we want to allow users to

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #670

2021-04-05 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12548; Propagate record error messages to application (#10445) -- [...truncated 7.37 MB...] BrokerEndPointTest >

Re: Known issues with time stepping

2021-04-05 Thread Adam Bellemare
Did you check the JIRAs? On Mon, Apr 5, 2021 at 6:58 PM Tirtha Chatterjee < tirtha.p.chatter...@gmail.com> wrote: > Hi team > > Are there any known issues with Kafka that can happen because of the system > time getting stepped forward or backward in one shot? This can happen > because of NTP

Known issues with time stepping

2021-04-05 Thread Tirtha Chatterjee
Hi team Are there any known issues with Kafka that can happen because of the system time getting stepped forward or backward in one shot? This can happen because of NTP time syncs. -- Regards Tirtha Chatterjee

[jira] [Resolved] (KAFKA-12294) Consider using the forwarding mechanism for metadata auto topic creation

2021-04-05 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12294. - Fix Version/s: 3.0.0 Resolution: Fixed > Consider using the forwarding mechanism

[jira] [Resolved] (KAFKA-8551) Comments for connectors() in Herder interface

2021-04-05 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8551. -- Resolution: Won't Fix Marking as won't fix, since the details are insufficient to try to

[jira] [Resolved] (KAFKA-8664) non-JSON format messages when streaming data from Kafka to Mongo

2021-04-05 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8664. -- Resolution: Won't Fix The reported problem is for a connector implementation that is not owned

[jira] [Resolved] (KAFKA-8867) Kafka Connect JDBC fails to create PostgreSQL table with default boolean value in schema

2021-04-05 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8867. -- Resolution: Won't Fix The reported problem is for the Confluent JDBC source/sink connector,

[jira] [Resolved] (KAFKA-8961) Unable to create secure JDBC connection through Kafka Connect

2021-04-05 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8961. -- Resolution: Won't Fix This is not a problem of the Connect framework, and is instead an issue

[jira] [Resolved] (KAFKA-10715) Support Kafka connect converter for AVRO

2021-04-05 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-10715. --- Resolution: Won't Do > Support Kafka connect converter for AVRO >

[jira] [Created] (KAFKA-12619) Ensure LeaderChange message is committed before initializing high watermark

2021-04-05 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12619: --- Summary: Ensure LeaderChange message is committed before initializing high watermark Key: KAFKA-12619 URL: https://issues.apache.org/jira/browse/KAFKA-12619

[jira] [Created] (KAFKA-12618) Convert LogManager (and other EasyMocks) in ReplicaManagerTest to Mockito

2021-04-05 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-12618: -- Summary: Convert LogManager (and other EasyMocks) in ReplicaManagerTest to Mockito Key: KAFKA-12618 URL: https://issues.apache.org/jira/browse/KAFKA-12618

Question on kafka connect's incremental rebalance algorithm

2021-04-05 Thread Thouqueer Ahmed
Hi, What would happen when new worker joins after the synchronization barrier ? As per code -> performTaskAssignment function of IncrementalAssignor -> Boolean canRevoke is false when it is called during the 2nd rebalance. Hence revocation is skipped and only assignment is done.

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #669

2021-04-05 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12614: Use Jenkinsfile for trunk and release branch builds (#10473) [github] KAFKA-12539; Refactor KafkaRaftCllient handleVoteRequest to reduce cyclomatic complexity

[jira] [Resolved] (KAFKA-12548) Invalid record error message is not getting sent to application

2021-04-05 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12548. - Resolution: Fixed > Invalid record error message is not getting sent to application >

contributor permission

2021-04-05 Thread Amuthan
Hi I would like to contribute to https://issues.apache.org/jira/browse/KAFKA-12559, Could you please give me contributor permission, here is my jira id: *simplyamuthan* Regards Amuthan.

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #91

2021-04-05 Thread Apache Jenkins Server
See Changes: [Ismael Juma] KAFKA-10759 Add ARM build stage (#9992) [Ismael Juma] KAFKA-12614: Use Jenkinsfile for trunk and release branch builds (#10473) --

[GitHub] [kafka-site] hachikuji merged pull request #344: Add Grab (https://www.grab.com/) to the list of the "Powered By ❤️"

2021-04-05 Thread GitBox
hachikuji merged pull request #344: URL: https://github.com/apache/kafka-site/pull/344 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #668

2021-04-05 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12615: Fix `Selector.clear()` javadoc typo (#10477) -- [...truncated 3.71 MB...] KafkaZkClientTest > testUpdateBrokerInfo()

[jira] [Created] (KAFKA-12617) Convert MetadataRequestTest to use ClusterTest

2021-04-05 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12617: --- Summary: Convert MetadataRequestTest to use ClusterTest Key: KAFKA-12617 URL: https://issues.apache.org/jira/browse/KAFKA-12617 Project: Kafka Issue

[jira] [Created] (KAFKA-12616) Convert integration tests to use ClusterTest

2021-04-05 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12616: --- Summary: Convert integration tests to use ClusterTest Key: KAFKA-12616 URL: https://issues.apache.org/jira/browse/KAFKA-12616 Project: Kafka Issue

[jira] [Resolved] (KAFKA-12604) Remove envelope handling from broker

2021-04-05 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12604. - Resolution: Won't Fix > Remove envelope handling from broker >

[jira] [Resolved] (KAFKA-12539) Move some logic in handleVoteRequest to EpochState

2021-04-05 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12539. - Resolution: Fixed > Move some logic in handleVoteRequest to EpochState >

Error Messages for Dell Boomi connector Kafka

2021-04-05 Thread Shree, Nikita
Hi Team, I am trying to connect to Kafka via Dell Boomi. IT is throwing error messages. Can I get the entire list of errors thrown by Kafka Connector to Dell Boomi platform. Regards, Nikita This message is for the designated recipient only and may contain

[jira] [Created] (KAFKA-12615) Correct comments for the method Selector.clear

2021-04-05 Thread HaiyuanZhao (Jira)
HaiyuanZhao created KAFKA-12615: --- Summary: Correct comments for the method Selector.clear Key: KAFKA-12615 URL: https://issues.apache.org/jira/browse/KAFKA-12615 Project: Kafka Issue Type:

Re: [DISCUSS] Please review 2.8.0 blog post

2021-04-05 Thread Adam Bellemare
Read it all. It looks good to me in terms of structure and content. I am not sufficiently up to date on all the features that are otherwise included in 2.8.0, but the ones listed seem very prominent! On Thu, Apr 1, 2021 at 4:39 PM John Roesler wrote: > Hello all, > > In the steady march

ACL source IP supports IP network segments

2021-04-05 Thread lobo xu
Dear all: Our users need our support to allow the use of IP network segments when adding ACL policies and specifying the host parameter. The current code does not support this feature, and I want to initiate a discussion on whether the community needs this feature. Best, Lobo