Re: Wiki edit permission request

What is your wiki ID? -Matthias On 4/6/18 10:54 AM, Ray Chiang wrote: > As best as I can tell, I currently don't have edit access. > > -Ray > signature.asc Description: OpenPGP digital signature

Build failed in Jenkins: kafka-trunk-jdk8 #2532

See Changes: [rajinisivaram] Trogdor: Added commonClientConf and adminClientConf to workload specs -- [...truncated 1.46 MB...]

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Hi Jun, please add me to the invitation as well.  If this is happening near Palo Alto, let me know if I can join in person. Thanks. -Ray On 4/4/18 1:34 PM, Jun Rao wrote: Hi, Jan, Dong, John, Guozhang, Perhaps it will be useful to have a KIP meeting to discuss this together as a group. Would

Request for comments on my new feature request

Hello Developers, I'd appreciate your comments on my recent feature request: https://issues.apache.org/jira/browse/KAFKA-6754 Thanks and best, Bill

[jira] [Created] (KAFKA-6759) Include valid Fetch Response high_watermark and log_start_offset when Error Code 1 OFFSET_OUT_OF_RANGE

John R. Fallows created KAFKA-6759: -- Summary: Include valid Fetch Response high_watermark and log_start_offset when Error Code 1 OFFSET_OUT_OF_RANGE Key: KAFKA-6759 URL:

Build failed in Jenkins: kafka-trunk-jdk9 #538

See Changes: [rajinisivaram] Trogdor: Added commonClientConf and adminClientConf to workload specs -- [...truncated 1.48 MB...]

Re: Wiki edit permission request

Got it.  Thanks. -Ray On 4/6/18 12:03 PM, Matthias J. Sax wrote: Please keep it on the mailing list. Wiki permissions granted. -Matthias On 4/6/18 11:58 AM, Ray Chiang wrote: ID is rchiang. -Ray On 4/6/18 11:23 AM, Matthias J. Sax wrote: What is your wiki ID? -Matthias On 4/6/18

Re: Wiki edit permission request

Please keep it on the mailing list. Wiki permissions granted. -Matthias On 4/6/18 11:58 AM, Ray Chiang wrote: > ID is rchiang. > > -Ray > > On 4/6/18 11:23 AM, Matthias J. Sax wrote: >> What is your wiki ID? >> >> -Matthias >> >> On 4/6/18 10:54 AM, Ray Chiang wrote: >>> As best as I can

Re: [DISCUSS] KIP-283: Efficient Memory Usage for Down-Conversion

The two embedded diagrams seem broken. Can you double check ? Thanks On Fri, Apr 6, 2018 at 2:56 PM, Dhruvil Shah wrote: > Hi, > > I created a KIP to help mitigate out of memory issues during > down-conversion. The KIP proposes introducing a configuration that can >

Re: [DISCUSS] KIP-283: Efficient Memory Usage for Down-Conversion

I fixed the diagrams - let me know if you are still having trouble seeing them. Thanks, Dhruvil On Fri, Apr 6, 2018 at 3:05 PM, Ted Yu wrote: > The two embedded diagrams seem broken. > > Can you double check ? > > Thanks > > On Fri, Apr 6, 2018 at 2:56 PM, Dhruvil Shah

Re: [DISCUSS] KIP-283: Efficient Memory Usage for Down-Conversion

bq. we can perform down-conversion when Records.writeTo is called. Wouldn't this delay the network thread (though maybe the duration is short) ? Can you expand on the structure of LazyDownConvertedRecords in more detail ? bq. even if it exceeds fetch.max.bytes I did a brief search but didn't

Build failed in Jenkins: kafka-trunk-jdk8 #2533

See Changes: [github] KAFKA-6576: Configurable Quota Management (KIP-257) (#4699) -- [...truncated 413.81 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

[jira] [Resolved] (KAFKA-6576) Configurable Quota Management (KIP-257)

[ https://issues.apache.org/jira/browse/KAFKA-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6576. --- Resolution: Fixed Reviewer: Jun Rao Fix Version/s: 1.2.0 > Configurable Quota

[DISCUSS] KIP-283: Efficient Memory Usage for Down-Conversion

Hi, I created a KIP to help mitigate out of memory issues during down-conversion. The KIP proposes introducing a configuration that can prevent down-conversions altogether, and also describes a design for efficient memory usage for down-conversion.

Jenkins build is back to normal : kafka-trunk-jdk9 #539

See

[jira] [Created] (KAFKA-6761) Reduce Kafka Streams Footprint

Bill Bejeck created KAFKA-6761: -- Summary: Reduce Kafka Streams Footprint Key: KAFKA-6761 URL: https://issues.apache.org/jira/browse/KAFKA-6761 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-279: Fix log divergence between leader and follower after fast leader fail over

Makes sense. Thanks for the explanation.  Original message From: Anna Povzner Date: 4/6/18 5:38 PM (GMT-08:00) To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-279: Fix log divergence between leader and follower after fast leader fail over Hi Ted, I

Re: [DISCUSS] KIP-283: Efficient Memory Usage for Down-Conversion

Hi Ted, Thanks for the comments. *>> bq. we can perform down-conversion when Records.writeTo is called.>> Wouldn't this delay the network thread (though maybe the duration is short)>> ?* Yes, this is noted in the Cons section. I think we have a precedent for this in the `SSLTransportLayer`

Re: [DISCUSS] KIP-279: Fix log divergence between leader and follower after fast leader fail over

Hi Ted, I updated the Rejected Alternatives section with a more thorough description of alternatives and reasoning for choosing the solution we proposed. While it is more clear why the second alternative guarantees one roundtrip for the clean leader election case, the proposed solution also

Jenkins build is back to normal : kafka-trunk-jdk7 #3321

See

[jira] [Created] (KAFKA-6760) responses not logged properly in controller

Jun Rao created KAFKA-6760: -- Summary: responses not logged properly in controller Key: KAFKA-6760 URL: https://issues.apache.org/jira/browse/KAFKA-6760 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-trunk-jdk7 #3320

See Changes: [github] KAFKA-6576: Configurable Quota Management (KIP-257) (#4699) -- [...truncated 410.19 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2534

See Changes: [github] KAFKA-6054: Fix upgrade path from Kafka Streams v0.10.0 (#4779) -- [...truncated 1.87 MB...]

Dead link in Kafka Streams documentation

https://kafka.apache.org/documentation/streams/developer-guide/ "Testing a Streams application" points to https://kafka.apache.org/documentation/streams/developer-guide/testing.html Which is a dead link. The working link is

Re: [DISCUSS] KIP-280: Enhanced log compaction

Thank you very much for taking the time to read it. bq. In the 'Proposed Changes' section, can you expand 'OCC' ? I've made the 'OCC' into a link pointing to the appropriate Wiki page explaining what it is. This is not a particularly important part of the change, it is just to reference the

Re: [DISCUSS] KIP-269: Substitution Within Configuration Values

Hi, Substitution mechanism can be useful to configure regular password configs liken ssl.keystore.password, ssl.truststore.password, etc. This is can be good alternative to previously proposed KIP-76 and will give more options to the user. https://cwiki.apache.org/confluence/display/KAFKA/KIP-

Re: [VOTE] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

+1 (non-binding) Thanks for the detailed KIP. On Fri, Apr 6, 2018 at 8:54 AM, Guozhang Wang wrote: > Thanks for the KIP! > > +1 (binding) > > On Thu, Apr 5, 2018 at 3:11 PM, Matthias J. Sax > wrote: > > > +1 (binding) > > > > > > -Matthias > > > > On

[jira] [Created] (KAFKA-6757) Log runtime exception in case of server startup errors

Enrico Olivelli created KAFKA-6757: -- Summary: Log runtime exception in case of server startup errors Key: KAFKA-6757 URL: https://issues.apache.org/jira/browse/KAFKA-6757 Project: Kafka

Re: [DISCUSS] KIP-269: Substitution Within Configuration Values

Yes, I was going to suggest that we should do this for all configs earlier, but was reluctant to do that since in its current form, there is a property enableSubstitution (in JAAS config at the moment) that indicates if substitution is to be performed. If enabled, all values in that config are

Re: [DISCUSS] KIP-269: Substitution Within Configuration Values

Hi folks. I think there are a couple of issues that were just raised in this thread. One is whether the ability to use PasswordCallback exists, and if so whether that impacts the applicability of this KIP to the SASL/OAUTHBEARER KIP-255. The second issue is related to how we might leverage this

[jira] [Created] (KAFKA-6758) Default "" consumer group tracks committed offsets, but is otherwise not a real group

David van Geest created KAFKA-6758: -- Summary: Default "" consumer group tracks committed offsets, but is otherwise not a real group Key: KAFKA-6758 URL: https://issues.apache.org/jira/browse/KAFKA-6758

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Hey John, Thanks much for your super-detailed explanation. This is very helpful. Now that I have finished reading through your email, I think the proposed solution in my previous email probably meets the requirement #6 without requiring additional coordination (w.r.t. partition function) among

Wiki edit permission request

As best as I can tell, I currently don't have edit access. -Ray