Build failed in Jenkins: kafka-2.4-jdk8 #130

See Changes: [rhauch] KAFKA-9083: Various fixes/improvements for Connect's Values class [rhauch] KAFKA-9024: Better error message when field specified does not exist --

Build failed in Jenkins: kafka-2.2-jdk8 #20

See Changes: [rhauch] MINOR: Embedded connect cluster should mask exit procedures by default [rhauch] KAFKA-9083: Various fixes/improvements for Connect's Values class [rhauch] KAFKA-9024: Better error message

Build failed in Jenkins: kafka-2.2-jdk8 #21

See Changes: [rhauch] KAFKA-9143: Log task reconfiguration error only when it happened (#7648) -- [...truncated 2.04 MB...] kafka.utils.CommandLineUtilsTest >

[jira] [Created] (KAFKA-9462) Correct exception message in DistributedHerder

Ted Yu created KAFKA-9462: - Summary: Correct exception message in DistributedHerder Key: KAFKA-9462 URL: https://issues.apache.org/jira/browse/KAFKA-9462 Project: Kafka Issue Type: Bug

Jenkins build is back to normal : kafka-trunk-jdk11 #1100

See

Re: [DISCUSS] KIP-501 Avoid out-of-sync or offline partitions when follower fetch requests not processed in time

Hi Jun, Can you please review the KIP and let us know your comments? If there are no comments/questions, we can start a vote thread. It looks like Yelp folks also encountered the same issue as mentioned in JIRA comment[1]. >> Flavien Raynaud added a comment - Yesterday We've seen offline

Enable both SASL & SSL authentication...

Hi, We want both SASL (oAuthBearer) & SSL authentication to be enabled. However based on the below doc, the SSL auth will be disabled if SASL is enabled. https://docs.confluent.io/current/kafka/authentication_ssl.html#brokers If any SASL authentication mechanisms are enabled for a given

Build failed in Jenkins: kafka-trunk-jdk8 #4176

See Changes: [rhauch] MINOR: log error message from Connect sink exception (#7555) [rhauch] KAFKA-9083: Various fixes/improvements for Connect's Values class [wangguoz] KAFKA-7204: Avoid clearing records for

Build failed in Jenkins: kafka-trunk-jdk11 #1101

See Changes: [jason] MINOR: Only update a request's local complete time in API handler if -- [...truncated 5.75 MB...]

[jira] [Created] (KAFKA-9463) Transient failure in KafkaAdminClientTest.testListOffsets

Ted Yu created KAFKA-9463: - Summary: Transient failure in KafkaAdminClientTest.testListOffsets Key: KAFKA-9463 URL: https://issues.apache.org/jira/browse/KAFKA-9463 Project: Kafka Issue Type: Test

Build failed in Jenkins: kafka-trunk-jdk8 #4177

See Changes: [jason] MINOR: Only update a request's local complete time in API handler if -- [...truncated 5.73 MB...] org.apache.kafka.streams.MockTimeTest >

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

Thanks Matthias. The KIP is about InvalidStateStoreException. I pick `StateStoreNotAvailableException` because it may be more intuitive than `StreamsNotRunningException`. No matter which one picked, it's good to me. --- Vito On Wed, Jan 22, 2020 at 7:44 AM Matthias J. Sax wrote: > Thanks

Re: [DISCUSS] : KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Thanks for the KIP. Overall it makes sense. Couple of minor comments/questions: 10) To me, it was initially quite unclear why we need this KIP. The motivation section does only talk about some performance issues (that are motivated by single key look-ups) -- however, all issues mentioned in the

Re: [VOTE] KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics

Got it. I was proposing that we do the "delayed async batch" but I think your argument for complexity and pushing it out of the scope is convincing, so instead I propose we do the synchronous mini batching still but obviously it is already there :) I'm +1 on the current proposal scope. Guozhang

Re: [DISCUSS] : KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Chiming in a bit late here.. +1 This is a very valid improvement. Avoiding doing gets on irrelevant partitions will improve performance and efficiency for IQs. As an incremental improvement to the current APIs, adding an option to filter out based on partitions makes sense On Mon, Jan

Re: [VOTE] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

+1 (non-binding) Ron On Tue, Jan 21, 2020 at 11:29 AM Manikumar wrote: > > +1 (binding). > > Thanks for the KIP. > > > On Tue, Jan 21, 2020 at 9:56 PM Ted Yu wrote: > > > +1 > > > > On Tue, Jan 21, 2020 at 8:24 AM Rajini Sivaram > > wrote: > > > > > +1 (binding) > > > > > > Thanks for the

Re: [DISCUSS] KIP-546: Add quota-specific APIs to the Admin Client, redux

Hi Brian, Thanks for the proposal! I have a couple comments/questions: 1. I'm having a hard time understanding the point of `QuotaEntity.Type`. It sounds like this might be just for convenience since the APIs are using string types. If so, I think it's a bit misleading to represent it as an

[jira] [Resolved] (KAFKA-9083) Various parsing issues in Values class

[ https://issues.apache.org/jira/browse/KAFKA-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9083. -- Reviewer: Randall Hauch Resolution: Fixed Merged to the `trunk`, `2.4`, `2.3`, and `2.2`

Re: [VOTE] KIP-558: Add Connect REST API endpoints to view the topics used by connectors in Kafka Connect

Thanks for the KIP Konstantine. This will be very useful for Connect. +1(binding) -Bill On Tue, Jan 21, 2020 at 2:12 PM Almog Gavra wrote: > Another thanks from me! +1 (non-binding) > > On Tue, Jan 21, 2020 at 11:04 AM Randall Hauch wrote: > > > Thanks again for the KIP and this improvement

Re: [VOTE] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

+1 (binding) Thanks On Tue, Jan 21, 2020 at 7:58 PM Ron Dagostino wrote: > > +1 (non-binding) > > Ron > > On Tue, Jan 21, 2020 at 11:29 AM Manikumar wrote: > > > > +1 (binding). > > > > Thanks for the KIP. > > > > > > On Tue, Jan 21, 2020 at 9:56 PM Ted Yu wrote: > > > > > +1 > > > > > > On

Build failed in Jenkins: kafka-2.2-jdk8-old #200

See Changes: [rhauch] MINOR: Embedded connect cluster should mask exit procedures by default [rhauch] KAFKA-9083: Various fixes/improvements for Connect's Values class [rhauch] KAFKA-9024: Better error

[jira] [Resolved] (KAFKA-9024) org.apache.kafka.connect.transforms.ValueToKey throws NPE

[ https://issues.apache.org/jira/browse/KAFKA-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9024. -- Reviewer: Randall Hauch Resolution: Fixed Merged to `trunk` and backported to the `2.4`,

Re: [VOTE] KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies

Hi David, Just one question. In addition to including the protocol type, I'm wondering if there is value in adding the protocol name to SyncGroup? This would potentially give you the ability to parse the "user data" field in the consumer group schema. Thanks, Jason On Tue, Jan 21, 2020 at 9:35

Build failed in Jenkins: kafka-2.3-jdk8 #163

See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H34 (ubuntu) in workspace

Re: [VOTE] KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies

Hi Jason, Thanks for your feedback. You have brought a good point. I did not consider this but your are right. It makes sense to add it as well in order to able to fully parse the SyncGroup request/response. Let me update the KIP. Thanks, David On Tue, Jan 21, 2020 at 12:52 PM Jason Gustafson

Re: [DISCUSS] KIP-565: Using AclCommand,avoid call the global method loadcache in SimpleAclAuthorizer

Hi Steven, Thanks for the KIP. A few questions/comments: 1) The command line option for AclCommand makes it the user's responsibility to determine whether cache should be loaded. That doesn't feel like a good idea. If you are listing ACLs, you need the cache. More importantly, you need the cache

[jira] [Created] (KAFKA-9457) Flaky test org.apache.kafka.common.network.SelectorTest.testGracefulClose

Rajini Sivaram created KAFKA-9457: - Summary: Flaky test org.apache.kafka.common.network.SelectorTest.testGracefulClose Key: KAFKA-9457 URL: https://issues.apache.org/jira/browse/KAFKA-9457 Project:

[jira] [Created] (KAFKA-9458) Kafka crashed in windows environment

hirik created KAFKA-9458: Summary: Kafka crashed in windows environment Key: KAFKA-9458 URL: https://issues.apache.org/jira/browse/KAFKA-9458 Project: Kafka Issue Type: Bug Environment:

[jira] [Created] (KAFKA-9459) MM2 sync topic config does work

Badai Aqrandista created KAFKA-9459: --- Summary: MM2 sync topic config does work Key: KAFKA-9459 URL: https://issues.apache.org/jira/browse/KAFKA-9459 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

Hello. KIP [1] updated. Only TLSv1.2 will be enabled by default, as Rajini suggested. Any objections to it? https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=142641956 > 17 янв. 2020 г., в 14:56, Николай Ижиков написал(а): > > Thanks, Rajini. > > Will do it, shortly. > >>

[jira] [Created] (KAFKA-9460) Enable TLSv1.2 by default and disable all others protocol versions

Nikolay Izhikov created KAFKA-9460: -- Summary: Enable TLSv1.2 by default and disable all others protocol versions Key: KAFKA-9460 URL: https://issues.apache.org/jira/browse/KAFKA-9460 Project: Kafka

Re: [DISCUSS] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

LGTM. The KIP freeze for 2.5 is officially upon us tomorrow, but hopefully this is such a simple and straightforward change with obvious security benefits that it can be added anyway. I would put it up for a vote very quickly — tomorrow at the latest. Ron > On Jan 21, 2020, at 7:38 AM,

Re: [DISCUSS] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

Hello, Ron. Let’s start vote right now. What do you think? > 21 янв. 2020 г., в 15:48, Ron Dagostino написал(а): > > LGTM. The KIP freeze for 2.5 is officially upon us tomorrow, but hopefully > this is such a simple and straightforward change with obvious security > benefits that it can be

Re: [DISCUSS] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

Sure, go for it. > On Jan 21, 2020, at 8:05 AM, Николай Ижиков wrote: > > Hello, Ron. > > Let’s start vote right now. > What do you think? > >> 21 янв. 2020 г., в 15:48, Ron Dagostino написал(а): >> >> LGTM. The KIP freeze for 2.5 is officially upon us tomorrow, but hopefully >> this is

[jira] [Created] (KAFKA-9461) Limit DEBUG statement size when logging failed record value

Nicolas Guyomar created KAFKA-9461: -- Summary: Limit DEBUG statement size when logging failed record value Key: KAFKA-9461 URL: https://issues.apache.org/jira/browse/KAFKA-9461 Project: Kafka

Call for presentations for ApacheCon North America 2020 now open

Dear Apache enthusiast, (You’re receiving this message because you are subscribed to one or more project mailing lists at the Apache Software Foundation.) The call for presentations for ApacheCon North America 2020 is now open at https://apachecon.com/acna2020/cfp ApacheCon will be held at

[jira] [Resolved] (KAFKA-9457) Flaky test org.apache.kafka.common.network.SelectorTest.testGracefulClose

[ https://issues.apache.org/jira/browse/KAFKA-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9457. --- Reviewer: Manikumar Resolution: Fixed > Flaky test

[VOTE] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

Hello. I would like to start vote for KIP-553: Disable all SSL protocols except TLSV1.2 by default. KIP - https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=142641956 Discussion thread -

Re: [DISCUSS] KIP-558: Track the set of actively used topics by connectors in Kafka Connect

Thanks, Konstantine. One minor request to clarify the following sentence: As soon as a worker detects the addition of a topic to a connector's set of active topics, the worker will cease to post update messages to the status.storage.topic for that connector. As it stands, it sounds like the

Re: [VOTE] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

+1 (binding) Thanks for the KIP! Regards, Rajini On Tue, Jan 21, 2020 at 3:43 PM Николай Ижиков wrote: > Hello. > > I would like to start vote for KIP-553: Disable all SSL protocols except > TLSV1.2 by default. > > KIP - >

Re: [VOTE] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

+1 On Tue, Jan 21, 2020 at 8:24 AM Rajini Sivaram wrote: > +1 (binding) > > Thanks for the KIP! > > Regards, > > Rajini > > > On Tue, Jan 21, 2020 at 3:43 PM Николай Ижиков > wrote: > > > Hello. > > > > I would like to start vote for KIP-553: Disable all SSL protocols except > > TLSV1.2 by

Re: [VOTE] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

+1 (binding). Thanks for the KIP. On Tue, Jan 21, 2020 at 9:56 PM Ted Yu wrote: > +1 > > On Tue, Jan 21, 2020 at 8:24 AM Rajini Sivaram > wrote: > > > +1 (binding) > > > > Thanks for the KIP! > > > > Regards, > > > > Rajini > > > > > > On Tue, Jan 21, 2020 at 3:43 PM Николай Ижиков > >

Fwd: Is there a way to auto scale topic partitions in kafka?

Hello Dev community, Got no response from user community on below query. Can you respond back on this please? -- Forwarded message - From: Pushkar Deole Date: Fri, Jan 17, 2020 at 1:46 PM Subject: Is there a way to auto scale topic partitions in kafka? To: Hello, I am

Re: Create KIP permission.

Username: ledostuff вт, 21 янв. 2020 г., 15:43 Игорь Мартемьянов : > Hello there. > I'd like to request permission to Kafka confluence page to be able to > create KIPs. >

Add to Dev mailing list

Hi, Can you please add me to the dev mailing list -- Deepak Goyal (+919502447100)

Create KIP permission.

Hello there. I'd like to request permission to Kafka confluence page to be able to create KIPs.

Re: Add to Dev mailing list

Hi Deepak, Subscription to the mailing lists is self service. See https://kafka.apache.org/contact Best, Bruno On Tue, Jan 21, 2020 at 8:35 AM Deepak Goyal wrote: > > Hi, > > Can you please add me to the dev mailing list > > -- > Deepak Goyal (+919502447100)

Re: [VOTE] KIP-558: Add Connect REST API endpoints to view the topics used by connectors in Kafka Connect

+1 (non-binding). Thanks for the KIP Konstantine. On Sat, Jan 18, 2020 at 2:18 AM Konstantine Karantasis < konstant...@confluent.io> wrote: > Hi all, > > I'd like to open the vote on KIP-558 that had a constructive flurry of > discussions in the past few days, in order to give this KIP the

Re: Is there a way to auto scale topic partitions in kafka?

There is no way to automatically scale it, but you could write a script to increase the partition count using the command line tools, and trigger it on certain metrics. One thing to consider is that any *keyed* events would need to be rewritten to topics that have their partition count increased.

Re: Create KIP permission.

Done. Thanks for your interest in Apache Kafka. -Bill On Tue, Jan 21, 2020 at 11:35 AM Игорь Мартемьянов wrote: > Username: ledostuff > > вт, 21 янв. 2020 г., 15:43 Игорь Мартемьянов : > > > Hello there. > > I'd like to request permission to Kafka confluence page to be able to > > create

Re: [VOTE] KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Hello Navinder, Thanks for brining up this proposal. I made a quick pass on that and overall I think I agree with your ideas. Just a few thoughts about the public APIs: 1) As we are adding a new overload to `KafkaStreams#store`, could we just add the storeName and queryableStoreType as part of

[VOTE] KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies

Hi all, I would like to start a vote on KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies. The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-559%3A+Make+the+Kafka+Protocol+Friendlier+with+L7+Proxies Thanks, David

Re: [VOTE] KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics

Hi Guozhang, Your understanding of the rationale is accurate, and what you suggest is completely plausible, however I have a slightly different take on the situation. When the KIP was originally drafted, making KafkaProducer#send asynchronous was one element of the changes (this is a little more

Re: [VOTE] KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics

Hi Brian, I think I buy the complexity and extra end-to-end-latency argument :) I'm fine with delaying the asynchronous tech fetching to future works and keep the current KIP's scope as-is for now. Under that case can we consider just a minor implementation detail (since it is not affecting

Re: [VOTE] KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics

Hi Guozhang, Ah, sorry, I misunderstood. Actually, this is solved for us today. How the producer works is that it maintains at most one inflight metadata fetch request at any time, where each request is tagged with the current (monotonically increasing) request version. This version is bumped

Re: [DISCUSS] KIP-558: Track the set of actively used topics by connectors in Kafka Connect

Thanks again Konstantine - really excited about this KIP! I'm about ready to +1 (non-binding) it with just one comment left: What do you think about changing the timestamp field to "discoverTimestamp" or something like that to indicate that it is the timestamp of the _first_ time we

Re: [VOTE] KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Thanks, Guozhang. I agree it makes total sense. I will make the edits.~Navinder  On Tuesday, 21 January, 2020, 11:00:32 pm IST, Guozhang Wang wrote: Hello Navinder, Thanks for brining up this proposal. I made a quick pass on that and overall I think I agree with your ideas. Just a

Re: [DISCUSS] KIP-558: Track the set of actively used topics by connectors in Kafka Connect

Randall, I updated the KIP to add your suggestion above and better explain the few points that were outstanding since last week. Almog, I agree that 'timestamp' was too generic. I'm ok with 'discoverTimestamp'. I updated the KIP with your naming suggestion. Best, Konstantine On Tue, Jan 21,

Re: [VOTE] KIP-558: Add Connect REST API endpoints to view the topics used by connectors in Kafka Connect

Thanks again for the KIP and this improvement for Connect. +1 (binding) Randall On Tue, Jan 21, 2020 at 10:45 AM Tom Bentley wrote: > +1 (non-binding). Thanks for the KIP Konstantine. > > On Sat, Jan 18, 2020 at 2:18 AM Konstantine Karantasis < > konstant...@confluent.io> wrote: > > > Hi all,

Build failed in Jenkins: kafka-trunk-jdk8 #4174

See Changes: [github] MINOR: Update AclCommand help message to match implementation (#7990) -- [...truncated 5.72 MB...]

Re: [VOTE] KIP-558: Add Connect REST API endpoints to view the topics used by connectors in Kafka Connect

Another thanks from me! +1 (non-binding) On Tue, Jan 21, 2020 at 11:04 AM Randall Hauch wrote: > Thanks again for the KIP and this improvement for Connect. > > +1 (binding) > > Randall > > On Tue, Jan 21, 2020 at 10:45 AM Tom Bentley wrote: > > > +1 (non-binding). Thanks for the KIP

Build failed in Jenkins: kafka-trunk-jdk11 #1098

See Changes: [github] MINOR: Update AclCommand help message to match implementation (#7990) -- [...truncated 5.75 MB...]

Re: [VOTE] KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies

Thanks, +1 On Tue, Jan 21, 2020 at 1:06 PM David Jacot wrote: > Hi Jason, > > Thanks for your feedback. You have brought a good point. I did not consider > this but your are right. It makes sense to add it as well in order to able > to fully > parse the SyncGroup request/response. Let me update

Re: [VOTE] KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies

David, thanks for the KIP. This looks like a nice improvement. Explicit over implicit :) +1, binding -David On Tue, Jan 21, 2020 at 4:17 PM Jason Gustafson wrote: > Thanks, +1 > > On Tue, Jan 21, 2020 at 1:06 PM David Jacot wrote: > > > Hi Jason, > > > > Thanks for your feedback. You have

Re: [VOTE] KIP-514 Add a bounded flush() API to Kafka Producer

Rebased the PR based on latest trunk, can we merge the PR? Kun radai 于2019年12月13日周五 上午9:26写道： > i also have a PR :-) > https://github.com/apache/kafka/pull/7569 > > On Thu, Dec 12, 2019 at 9:50 PM Gwen Shapira wrote: > > > > You got 3 binding votes (Joel, Harsha, Ismael) - the vote passed on

Build failed in Jenkins: kafka-2.3-jdk8 #164

See Changes: [rhauch] KAFKA-9083: Various fixes/improvements for Connect's Values class [rhauch] KAFKA-9024: Better error message when field specified does not exist --

Re: [VOTE] KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies

Thank you for the KIP. Awesomely cloud-native improvement :) +1 (binding) On Tue, Jan 21, 2020, 9:35 AM David Jacot wrote: > Hi all, > > I would like to start a vote on KIP-559: Make the Kafka Protocol Friendlier > with L7 Proxies. > > The KIP is here: > >

Build failed in Jenkins: kafka-trunk-jdk8 #4175

See Changes: [github] KAFKA-9457; Fix flaky test -- [...truncated 5.71 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldNotUpdateStoreForSmallerValue[Eos

Build failed in Jenkins: kafka-2.3-jdk8 #165

See Changes: [rhauch] KAFKA-9143: Log task reconfiguration error only when it happened (#7648) -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node

Build failed in Jenkins: kafka-trunk-jdk11 #1099

See Changes: [github] KAFKA-9457; Fix flaky test -- [...truncated 5.75 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

Thanks for updating the KIP! One last comment/question: you kept `StateStoreNotAvailableException` in favor of `StreamsNotRunningException` (to merge both as suggested). I am wondering, if it might be better to keep `StreamsNotRunningException` instead of `StateStoreNotAvailableException`,

Build failed in Jenkins: kafka-2.2-jdk8-old #201

See Changes: [rhauch] KAFKA-9143: Log task reconfiguration error only when it happened (#7648) -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node