Re: [DISCUSS] Compatability and KIPs

Jay: https://www.python.org/dev/peps/pep-0257 https://www.python.org/dev/peps/pep-0257/) gives me 404. Can you double check ? Cheers

Re: [DISCUSS] Compatability and KIPs

For projects written in Java, there is http://ispras.linuxbase.org/index.php/Java_API_Compliance_Checker I searched for similar tool for Scala but haven't found one yet. Cheers On Sat, Jan 10, 2015 at 10:40 AM, Ashish Singh asi...@cloudera.com wrote: Jay, I totally agree with paying more

Re: [VOTE] KIP-91 Provide Intuitive User Timeouts in The Producer

com> wrote: > @Ted, We throw a ConfigException when user-configured values of linger.ms, > request.timeout.ms, retry.backoff.ms add up to more than > delivery.timeout.ms > . The kip mentions this in the Validation section. > > On 11 September 2017 at 14:31, Ted Yu <yuzhih...

Re: [DISCUSS] KIP-197: Include Connector type in Connector REST API

..@gmail.com> wrote: > > > Looks good to me! Thanks again! > > > > I say go ahead and ask for a vote in a new thread. > > > > Randall > > > > On Fri, Sep 8, 2017 at 6:22 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > Lowercase const

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

+1 One interface is cleaner. On Thu, Sep 14, 2017 at 7:26 AM, Bill Bejeck wrote: > +1 for me on collapsing the Rich and ValueWithKey interfaces into 1 > interface. > > Thanks, > Bill > > On Wed, Sep 13, 2017 at 11:31 AM, Jeyhun Karimov > wrote:

Re: Build failed in Jenkins: kafka-trunk-jdk8 #2016

I have filed INFRA-15080 for the 'No space left on device' error. On Wed, Sep 13, 2017 at 12:07 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See display/redirect?page=changes> > > Changes: > > [ismael] KAFKA-4501; Fix

QA bot has stalled

Hi, I logged INFRA-15084 . FYI

system test builder

Hi, When I put the following in the address bar of Chrome: https://jenkins.confluent.io/job/system-test-kafka-branch-builder I was told: This site can’t be reached Are the tests accessible by the public ? Thanks

Re: KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule

Makes sense. Please fill out JIRA name, etc. On Mon, Sep 18, 2017 at 9:30 AM, Manikumar wrote: > Hi all, > > I've created a small KIP to extend the sasl.kerberos.principal.to.local > rule syntax to convert short names to lower case. > >

Re: unsubscribe

Please look at instruction on https://kafka.apache.org/contact for unsubscribing On Mon, Sep 18, 2017 at 10:24 AM, Madhav Ancha (BLOOMBERG/ 919 3RD A) < manc...@bloomberg.net> wrote: > unsubscribe > >

Limit Jenkins jobs on H0 to H13

Hi, See Gavin's comment: https://issues.apache.org/jira/browse/INFRA-15084?page= com.atlassian.jira.plugin.system.issuetabpanels:comment- tabpanel=16172575#comment-16172575 Can someone with admin permission modify the Jenkins job(s) ? Thanks

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

> *RecordContext* interface. > However, we want *commit()* method to be used only for *RecordContext* > instances (at least for now), so we add UnsupportedOperationException in > all classes/interfaces that extend/implement *RecordContext.* > In general, 1) we make RecordContext publicly avail

Re: Spurious INFO message in SessionExpireListener (of KafkaHealthcheck)?

See KafkaHealthcheck#register() I think it means registration for the zookeeper path. On Fri, Sep 22, 2017 at 12:38 PM, Jacek Laskowski wrote: > Hi, > > Just noticed that SessionExpireListener#handleNewSession > (of KafkaHealthcheck) prints out the INFO message to the logs [1]

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

n Wed, 13 Sep 2017 at 21:46, Ted Yu <yuzhih...@gmail.com> wrote: > > > Damian: > > Looks like maven artifacts are not populated yet: > > > > https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients > > > > Do you know when artifacts would be

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

Damian: Looks like maven artifacts are not populated yet: https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients Do you know when artifacts would be visible for downstream projects ? Thanks On Wed, Sep 13, 2017 at 4:36 AM, Damian Guy wrote: > The Apache Kafka

Re: Kafka + ACL Topic based security ,Spring Boot

Attachment didn't come thru. Have you read ? https://cwiki.apache.org/confluence/display/KAFKA/Security especially the https://cwiki.apache.org/confluence/display/KAFKA/Security#Security-ImplementingthePermissionManager section ? On Fri, Sep 22, 2017 at 2:45 AM, Pooppillikudiyil, Joby <

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

gt; > > >> > On Thu, Sep 21, 2017 at 4:11 PM Damian Guy <damian@gmail.com> > >> wrote: > >> > > >> > > +1 > >> > > > >> > > On Thu, 21 Sep 2017 at 13:46 Guozhang Wang <wangg...@gmail.com> > >>

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

+1 On Mon, Sep 18, 2017 at 9:19 AM, Paolo Patierno wrote: > Hi devs, > > > I'd like to start a discussion around adding the delete records operation, > already available at protocol level and in the "legacy" Admin Client in > Scala, to the "new" Admin Client API in Java. > >

Re: want to join this mail list

See https://kafka.apache.org/contact for instructions. 2017-10-04 19:31 GMT-07:00 吴晓菊 : > -- > > Chrysan Wu > 联系方式：17717640807 >

Re: [DISCUSS] KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics

Randall: bq. AdminClient currently allows changing the replication factory. By 'replication factory' did you mean 'replication factor' ? Cheers On Wed, Oct 4, 2017 at 9:58 AM, Randall Hauch wrote: > Currently the KIP's scope is only topics that don't yet exist, and we have >

Re: [DISCUSS] KIP-186: Increase offsets retention default to 7 days

+1 on the KIP. bq. introducing offsets.retention.hours config property Probably the introduction would cause confusion among users due to the existing minutes config. On Fri, Oct 6, 2017 at 10:53 AM, Manikumar wrote: > looks like VOTE thread is started for this KIP.

Re: Can't build Kafka project

'm missing the following: > > /kafka/core/build/classes/java/test > > The core project itself doesn't have any java test source code under src/ > > > > > > On Sun, Oct 1, 2017 at 1:04 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > In streams/.classpath , you

Re: [VOTE] KIP-206: Add support for UUID serialization and deserialization

+1 Original message From: Jakub Scholz Date: 10/3/17 2:24 PM (GMT-08:00) To: dev@kafka.apache.org Subject: [VOTE] KIP-206: Add support for UUID serialization and deserialization Hi, Since there were no further discussion points, I would like to start the

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

For rest.ssl.clientAuth , I don't find counterpart in existing code. Can you add explanation on the KIP ? Thanks On Mon, Oct 9, 2017 at 8:25 AM, Jakub Scholz wrote: > Hi, > > I would like to start a discussion about KIP-208: Add SSL support to Kafka > Connect REST interface (

Re: [DISCUSS] KIP-59 : Proposal for a kafka broker command

Please fill 'Discussion thread:' with URL to this thread. For 'Proposed Changes' section, is it possible to indent the lines from 'Broker Id' to 'Trailing partition count' ? This way, it is easier to read. bq. The command kafka-brokers.sh requires zookeeper information Is the above still true

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

+1 to this proposal. On Mon, Oct 16, 2017 at 7:49 AM, Jakub Scholz wrote: > I was having some more thoughts about it. We can simply take over what > Kafka broker implements for the listeners: > - We can take over the "listener" and "listener.security.protocol.map" > options to

Re: [DISCUSS] KIP-209 Connection String Support

bq. I was waiting my email to go through the servers http://search-hadoop.com/ indexes mailing lists actively. The delay is very short. FYI On Mon, Oct 16, 2017 at 2:44 PM, Clebert Suconic <clebert.suco...@gmail.com> wrote: > On Mon, Oct 16, 2017 at 5:41 PM, Ted Yu <yuzhih...@gmai

Re: [DISCUSS] KIP-209 Connection String Support

Please update link for Discussion thread and JIRA There're two TBD's for Invalid conversion and parameters. Can you fill them out ? Thanks On Mon, Oct 16, 2017 at 2:30 PM, Clebert Suconic wrote: > I would like to start a discussion about KIP-209 >

Re: [DISCUSS] KIP-208: Add SSL support to Kafka Connect REST interface

I agree with Randall. Actually I had the same thought during first round of review. On Fri, Oct 13, 2017 at 9:25 AM, Randall Hauch wrote: > Also, do we need these properties to be preceded with `rest`? I'd argue > that we're just configuring the worker's SSL information, and

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

+1 On Fri, Oct 13, 2017 at 3:32 PM, Matthias J. Sax wrote: > +1 > > > > On 9/11/17 3:04 PM, Jorge Esteban Quilcate Otoya wrote: > > Hi All, > > > > It seems that there is no further concern with the KIP-171. > > At this point we would like to start the voting process. > >

Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

+1 On Mon, Oct 2, 2017 at 10:51 PM, Paolo Patierno wrote: > Hi all, > > I didn't see any further discussion around this KIP, so I'd like to start > the vote for it. > > Just for reference : https://cwiki.apache.org/ > confluence/display/KAFKA/KIP-204+%3A+adding+records+ >

Re: [DISCUSS] KIP-209 Connection String Support

Can't you use IllegalArgumentException ? Some example in current code base: clients/src/main/java/org/apache/kafka/clients/Metadata.java: throw new IllegalArgumentException("Max time to wait for metadata updates should not be < 0 milliseconds"); On Mon, Oct 16, 2017 at 3:06 PM, Clebert Suconic

Re: [VOTE] 1.0.0 RC1

After specifying the location of zookeeper jar: export CLASSPATH= The command can be executed successfully: bin/zookeeper-server-start.sh config/zookeeper.properties This doesn't seem to be Java 9 specific issue. On Mon, Oct 16, 2017 at 5:30 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com>

Re: [DISCUSS] KIP-195: AdminClient.increasePartitions

I think increasePartitions is better name, implying there are already partitions. bq. use cases for non-consecutive partition ids. +1 on not supporting non-consecutive partition ids Cheers On Fri, Sep 8, 2017 at 5:34 AM, Ismael Juma wrote: > Hmm, maybe it should be

Re: integration between pull request and JIRA

gt;> PRs, > > One can just "not watch" Kafka's Github repo. I don't watch it either > and thus I get emails for only those PRs I did get tagged or I did > comment on etc. > > Would this not work for you? > > > -Matthias > > On 9/5/17 7:31 PM, T

request for permission to create KIP

Hi, My wiki username is tedyu Can someone grant me permission to create KIP ? Thanks

Re: [DISCUSS] KIP-197: Include Connector type in Connector REST API

he connector > information. > > Best regards, > > Randall > > On Fri, Sep 8, 2017 at 12:00 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Hi, > > Please take a look at: > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 197+Connect+REST+API+should+include+the+connector+type+ > > when+describing+a+connector > > > > Thanks > > >

[DISCUSS] KIP-197: Include Connector type in Connector REST API

Hi, Please take a look at: https://cwiki.apache.org/confluence/display/KAFKA/KIP-197+Connect+REST+API+should+include+the+connector+type+when+describing+a+connector Thanks

Re: [VOTE] KIP-198: Remove ZK dependency from Streams Reset Tool

bq. parameter `--zookeper` that will be deprecated. Can you clarify in which release the parameter will be deprecated and in which release it will be removed ? On Fri, Sep 8, 2017 at 1:15 PM, Matthias J. Sax wrote: > Hi, > > I want to propose KIP-198 for 1.0.0 release.

Re: [DISCUSS] KIP-197: Include Connector type in Connector REST API

rather than "Sink" and > "Source"). Thoughts? > > On Fri, Sep 8, 2017 at 6:02 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Updated the KIP accordingly. > > > > Cheers > > > > On Fri, Sep 8, 2017 at 3:57 PM, Randall Hauch <rha.

[VOTE] KIP-197: Include Connector type in Connector REST API

Hi, Please take a look at the following and cast your vote: https://cwiki.apache.org/confluence/display/KAFKA/KIP- 197+Connect+REST+API+should+include+the+connector+type+ when+describing+a+connector Thanks

Re: [DISCUSS] KIP-197: Include Connector type in Connector REST API

nectorStateInfo` (just like you did to the > `ConnectorInfo` class). WDYT? > > Best regards, > > Randall > > On Fri, Sep 8, 2017 at 1:12 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Thanks for the reminder, Randall. > > > > I have modified the KIP

Re: [DISCUSS] KIP-185: Make exactly once in order delivery per partition the default producer setting

For ProduceRequest v4, would int32 or int16 be enough for idempotenceLevel ? Cheers On Wed, Aug 30, 2017 at 3:47 PM, Apurva Mehta wrote: > Thanks Ismael and Jason, I filed a separate KIP to solve the problems > identified through this discussion. I also incorporated

Re: [VOTE] KIP-91 Provide Intuitive User Timeouts in The Producer

+1 for the KIP. For delivery.timeout.ms , since it should be >= linger.ms + request.timeout.ms + retry.backoff.ms , it seems the default value should be max(120 seconds, linger.ms + request.timeout.ms + retry.backoff.ms). Cheers On Fri, Sep 8, 2017 at 2:04 AM, Ismael Juma

Re: [DISCUSS] KIP-192 - Provide cleaner semantics when idempotence is enabled

For enable.idempotence=safe, it seems giving user impression that idempotence would be safe. However, since it really means best effort, the 'safety' is debatable. Why not just call the new mode besteffort ? Cheers On Tue, Sep 5, 2017 at 11:24 AM, Ismael Juma wrote: > If

Re: [DISCUSS] KIP-192 - Provide cleaner semantics when idempotence is enabled

l has 3 options: requested, required, off ("safe" was in > an earlier proposal). I think these convey the meaning more clearly IMO. > > Ismael > > On 5 Sep 2017 9:22 pm, "Ted Yu" <yuzhih...@gmail.com> wrote: > > > For enable.idempotence=safe, it se

Re: integration between pull request and JIRA

d and one can > go to the PR to read the discussion if interested. > > Or what do you think the value would be? > > > -Matthias > > > On 9/5/17 6:16 PM, Ted Yu wrote: > > Hi, > > Currently the conversations on pull request are not posted back to JIRA. > >

integration between pull request and JIRA

Hi, Currently the conversations on pull request are not posted back to JIRA. Is there technical hurdle preventing this from being done ? Other Apache projects, such as Flink, establish automatic post from pull request to JIRA. Cheers

Re: [DISCUSS] KIP-179: Change ReassignPartitionsCommand to use AdminClient

bq. What about startPartitionAssignment() ? Make sense. startPartitionReassignment() seems to be better since the API deals with reassignment. Cheers On Tue, Sep 5, 2017 at 9:39 AM, Tom Bentley wrote: > I've revised this KIP again: > > * Change the

Re: Fw: [VOTE] KIP-176 : Remove deprecated new-consumer option for tools

Looks good to me. bq. *specifying the --zookeeper for the farmer * *farmer -> former* On Wed, Sep 6, 2017 at 1:42 AM, Paolo Patierno wrote: > Hi devs, > > > I haven't seen any votes for this since last month. > > Is there something that should be addressed in the KIP (it

Re: [DISCUSS] KIP-195: AdminClient.increasePartitions

Tom: Looks good overall. bq. for the topic from the AlterPartitionCountsResult Please align the name of Result with current proposal. Please also fill in JIRA number when you have it. On Thu, Sep 7, 2017 at 9:38 AM, Tom Bentley wrote: > As suggested by Ismael, I've

Re: [DISCUSS] KIP-199: Add Kafka Connect offset reset tool

bq. connector restart and the next message The last part of the sentence seems to be incomplete. bq. command line tool called kafka-connect-source-offset-reset.sh >From the description, the tool does more than resetting (e.g. deleting). How about calling it kafka-connect-source-offset-tool.sh

Re: [DISCUSS] KIP-199: Add Kafka Connect offset reset tool

ts inline below. > > Regards, > > Randall > > On Sun, Sep 10, 2017 at 2:42 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > bq. connector restart and the next message > > > > The last part of the sentence seems to be incomplete. > > > > Fixed

Re: [VOTE] KIP-91 Provide Intuitive User Timeouts in The Producer

max.in.flight.request.per.connection > 1, batches should still > > expire in order. > > > > Jun > > > > On Sat, Sep 9, 2017 at 6:15 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > +1 for the KIP. > > > > > > For delive

Re: [VOTE] KIP-197: Include Connector type in Connector REST API

> > On Tue, Sep 12, 2017 at 11:21 AM Ted Yu <yuzhih...@gmail.com> wrote: > > > Ismael had a vote on the DISCUSS thread: > > > > > > http://search-hadoop.com/m/Kafka/uyzND18F2Bu15PQaW1?subj= > Re+DISCUSS+KIP+197+Include+Connector+type+in+Connector+REST+A

Re: [VOTE] KIP-197: Include Connector type in Connector REST API

at 7:46 PM, Sriram Subramanian <r...@confluent.io> > > wrote: > > > > > +1 > > > > > > On Fri, Sep 8, 2017 at 4:33 PM, Randall Hauch <rha...@gmail.com> > wrote: > > > > > > > +1 (non-binding) > > > > > > > > Rand

Re: [VOTE] KIP-199: Add Kafka Connect Offset Tool

+1 On Mon, Sep 11, 2017 at 7:43 AM, Randall Hauch wrote: > I'd like to start the vote on KIP-199 to add a command line tool that will > allow Connect operators to read, modify, and update source connector > offsets. Details are here: > >

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

bq. deprecations that are added in 1.x (x>0) have to remain in all 2.y Makes sense. It is fine to exclude KIP-113 from your KIP. Thanks On Mon, Sep 25, 2017 at 9:32 AM, Tom Bentley wrote: > Hi Ted, > > Thanks for the feedback! > > bq. topic.action.policy.class.name > >

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

bq. topic.action.policy.class.name Since the policy would cover more than one action, how about using actions for the second word ? For TopicState interface, the abstract modifier for its methods are not needed. bq. KIP-113 Mind adding more to the above bullet ? bq. If this KIP is accepted

Re: [DISCUSS] KIP-206: Add support for UUID serialization and deserialization

Please add link to Discussion thread field. Looks good overall. On Tue, Sep 26, 2017 at 10:18 AM, Jakub Scholz wrote: > Hi, > > I'd like to start a discussion for KIP-206. It is about adding serializers > and deserializers for UUIDs. The details can be found on the wiki: >

Re: KIP-167 Updates

Looks good. Please update the discussion thread link. On Thu, Sep 28, 2017 at 12:01 PM, Bill Bejeck wrote: > All, > > I have updated KIP-167 to include the bootstrapping status of any > GlobalKTables defined in the application. > > The KIP has been updated: >

Re: Can't build Kafka project

In streams/.classpath , you should have the following lines: FYI On Sun, Oct 1, 2017 at 11:02 AM, Waleed Fateem wrote: > Hi everyone, > > I'm quite new to Kafka from a development perspective and I'm having some > issues building the project in Eclipse.

Re: How is CorrelationId used for matching request and response

Which release / version are you looking at ? In trunk branch, I only see one toSend(): protected Send toSend(String destination, ResponseHeader header, short apiVersion) { return new NetworkSend(destination, serialize(apiVersion, header)); On Fri, Sep 29, 2017 at 4:49 PM, Javed,

Re: [DISCUSS] KIP-189: Improve principal builder interface and add support for SASL

bq. change the check in equals() to be this.getClass().equals(other. getClass()) I happened to have Effective Java on hand. Please take a look at related discussion on page 39. Josh later on mentioned Liskov substitution principle and a workaround (favoring composition). FYI On Mon, Aug 28,

Re: Dry-run option for new admin commands

State change on broker side may be subject to various factors (network, disk, etc). How would the dry-run report state change which is close to what actually happens in non-dry-run mode ? Thanks On Fri, Sep 1, 2017 at 7:48 AM, Viktor Somogyi wrote: > Hi all, > > I've

Turing on idempotence by default

Hi, I was reading https://www.confluent.io/blog/exactly-once-semantics-are-possible-heres-how-apache-kafka-does-it/ bq. this feature add negligible performance overhead over the non-idempotent producer. Should idempotence be turned on by default ? Cheers

Re: integration between pull request and JIRA

want, too. (That actually happens, > when you get tagged or comment on one, ie, you get auto subscribed to > the PR.) > > There is a "Subscribe" button on the right hand side. > > -Matthias > > > On 9/5/17 8:57 PM, Ted Yu wrote: > > bq. I did get tagged or

Re: Limit Jenkins jobs on H0 to H13

e: > Hi Ted, > > Thanks for following up with INFRA on the issues we've been seeing. I asked > a clarifying comment in that ticket (for some reason it only allowed me to > add an internal comment). > > Ismael > > On Wed, Sep 20, 2017 at 2:31 AM, Ted Yu <yuzhih...@gmail.com

Re: [VOTE] 1.0.0 RC0

Looks like the following change is needed for some downstream project to compile their code (which was using 0.11.0.1): -import org.apache.kafka.common.protocol.SecurityProtocol; +import org.apache.kafka.common.security.auth.SecurityProtocol; I took a look at docs/upgrade.html but didn't see any

Re: Kafka Consumer - org.apache.kafka.common.errors.TimeoutException: Failed to get offsets by times in 305000 ms

I don't see values for the Consumer Properties. Can you try out 0.11.0.1 ? See http://search-hadoop.com/m/Kafka/uyzND1qxYr5prjxv?subj=Incorrect+consumer+offsets+after+broker+restart+0+11+0+0 On Wed, Oct 11, 2017 at 11:37 AM, SenthilKumar K wrote: > Hi All , Recently we

Re: [VOTE] 1.0.0 RC0

Guozhang: I took a brief look under the staging tree. e.g. https://repository.apache.org/content/groups/staging/org/apache/kafka/kafka-clients/ I don't see 1.0.0 jars. Would the jars be populated later ? Thanks On Tue, Oct 10, 2017 at 6:34 PM, Guozhang Wang wrote: > Hello

Re: [VOTE] 1.0.0 RC0

> > Thanks Ted, > > > > I'm looking into this for possible doc changes now. > > > > Guozhang > > > > On Wed, Oct 11, 2017 at 3:23 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > >> Looks like the following change is needed for some dow

Re: [VOTE] 1.0.0 RC0

gt; users, I think it is OK to not mention it in the upgrade guides. > > For developers rather than users of Kafka, they are assumed to be familiar > with the codebase and not only rely on upgrade guide docs for such > information. > > > Guozhang > > On Thu, Oct 12, 2017

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Please fill out 'Rejected Alternatives' section. Thanks On Wed, Oct 18, 2017 at 4:45 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi all, > > I created a KIP to address the group offset expiration issue reported in > KAFKA-4682: >

Re: [VOTE] KIP-207:The Offsets which ListOffsetsResponse returns should monotonically increase even during a partition leader change

+1 On Tue, Oct 17, 2017 at 11:23 AM, Apurva Mehta wrote: > +1 (non-binding) > > On Tue, Oct 17, 2017 at 11:11 AM, Colin McCabe wrote: > > > Hi all, > > > > I'd like to start the voting process for KIP-207:The Offsets which > > ListOffsetsResponse

Re: working on KAFKA-4928

There was a PR https://github.com/apache/kafka/pull/2889 which was closed. It would be good for committers to chime in on the previous attempt. On Wed, Oct 18, 2017 at 8:39 AM, Pavel Drankov wrote: > Hi, > > My name is Pavel and I'm a very new to Kafka. I actually would

Re: [VOTE] 1.0.0 RC3

bq. Tag to be voted upon (off 1.0 branch) is the 1.0.0-rc2 tag: There seems to be a typo above: 1.0.0-rc3 tag FYI On Mon, Oct 23, 2017 at 6:00 PM, Guozhang Wang wrote: > Hello Kafka users, developers and client-developers, > > This is the third candidate for release of

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Can you create JIRA that corresponds to the KIP ? For the new config, how about naming it production.exception.processor.class ? This way it is clear that class name should be specified. Cheers On Wed, Oct 18, 2017 at 2:40 PM, Matt Farmer wrote: > Hello everyone, > > This is the

Re: [VOTE] KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

+1 On Thu, Nov 30, 2017 at 12:56 AM, Manikumar wrote: > +1 (non-binding) > > On Thu, Nov 30, 2017 at 8:35 AM, Hu Xi wrote: > > > Hi all, > > > > As I didn't see any further discussion around this KIP, I'd like to start > > voting. > > > > KIP

Re: [DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

gt; Thanks, > Dong > > On Sat, Dec 2, 2017 at 3:05 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > bq. It the controller_epoch of the incoming MetadataResponse, or if the > > controller_epoch is the same but the controller_metadata_epoch > > > > Can yo

Re: [DISCUSS] KIP-234: add support for getting topic defaults from AdminClient

In the example, resources is derived from ConfigResource. It would be clearer if you show the derivation. Cheers On Mon, Dec 4, 2017 at 9:51 AM, dan <dan.norw...@gmail.com> wrote: > I added sample usage as well as a WIP commit to the KIP. > > dan > > On Mon, Dec 4, 20

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

lStreamsBuilder# > globalTable > > On Mon, 4 Dec 2560 at 23:10 Ted Yu <yuzhih...@gmail.com> wrote: > > > Can you describe how sourceName is inferred based on the new API ? > > > > Please fill out JIRA number. > > > > BTW here is the URL for the KIP:

Re: [DISCUSS] KIP-231: Improve the Required ACL of ListGroups API

I agree with Dong on maintaining the semantics. The user should know which group(s) he / she is allowed to describe. Cheers On Mon, Dec 4, 2017 at 1:40 PM, Dong Lin wrote: > Hey Vahid, > > Thanks for the KIP. If I understand the you correctly, you want client to > be able

Re: [DISCUSS] KIP-231: Improve the Required ACL of ListGroups API

and your point about "The user should know > which group(s) he / she is allowed to describe." in relationship to the > KIP. Perhaps you can clarify? > > Thanks. > --Vahid > > > > > From: Ted Yu <yuzhih...@gmail.com> > To: dev@kafka.apache.org

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

gt; Thanks a lot for the KIP! > > > > Just one nit: `does not follow provide a good` -> spelling: remove > > `follow` ? > > > > Otherwise, looks good to me. > > > > > > -Matthias > > > > > > > > On

Re: [DISCUSS] KIP-234: add support for getting topic defaults from AdminClient

Can you add some code snippet showing how ConfigResource delivers topic defaults with the proposed change ? Cheers On Mon, Dec 4, 2017 at 9:25 AM, dan wrote: > I would like to start a discussion about KIP-234 > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

dminClient. */brokers/ids/id* contains the ephemeral > metadata registered by broker *.* For broker version, we don't want the > data to outlive the broker. Hence adding it to */brokers/ids/id.* > > On Fri, Dec 1, 2017 at 5:38 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > &

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

>> > > On Wed, Nov 22, 2017, at 12:52, Rajini Sivaram wrote: > >>> > > > Hi Tom, > >>> > > > > >>> > > > No, I am not proposing this as a way to configure replication > >>> quotas. > >>> > &

[DISCUSS] KIP-239 Add queryableStoreName() to GlobalKTable

Hi, Please kindly provide feedback on the following KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-239+Add+queryableStoreName%28%29+to+GlobalKTable Thanks

Re: Reg. beginner issues for a new contributor

Have you seen this ? http://search-hadoop.com/m/Kafka/uyzND14PPsT5THhN1?subj=Re+Contributing+to+Kafka On Thu, Dec 14, 2017 at 8:55 AM, Abhinav Koppula wrote: > Hi Team, > I wanted to get started with contributing to Kafka and learn more about its > internals. Can

Re: Queries on Kafka Capacity

It seems this should help (coming in 1.1 release): https://cwiki.apache.org/confluence/display/KAFKA/KIP-113%3A+Support+replicas+movement+between+log+directories On Wed, Dec 13, 2017 at 11:37 PM, ajay chaudhary < juniora...@yahoo.com.invalid> wrote: > Hi Team, > This is Ajay working with Yodlee

Re: [VOTE] KIP-243: Make ProducerConfig and ConsumerConfig constructors public

+1 nit: via "copy and past" an 'e' is missing at the end. On Mon, Dec 18, 2017 at 2:38 PM, Matthias J. Sax wrote: > Hi, > > I want to propose the following KIP: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

Re: [DISCUSS] KIP-240: AdminClient.listReassignments AdminClient.describeReassignments

Please create corresponding JIRA. For class Reassignment, it seems you forgot to include set of brokers. For class DescribeReassignmentsResult: public KafkaFuture reassignments(); the return value should be a Collection. On Fri, Dec 15, 2017 at 10:16 AM, Tom Bentley

[VOTE] KIP-239 Add queryableStoreName() to GlobalKTable

Hi, Here is the discussion thread: http://search-hadoop.com/m/Kafka/uyzND12QnH514pPO9?subj=Re+DISCUSS+KIP+239+Add+queryableStoreName+to+GlobalKTable Please vote on this KIP. Thanks

Re: [VOTE] KIP-238: Expose Kafka cluster ID in Connect REST API

+1 On Fri, Dec 15, 2017 at 10:49 AM, Ewen Cheslack-Postava wrote: > Discussion seems to have tapered off, so I'd like to start the vote on > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 238%3A+Expose+Kafka+cluster+ID+in+Connect+REST+API > > Obviously +1 (binding)

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

Tom: bq. create a znode /admin/reassignments/$topic-$partition Looks like the tree structure above should be: /admin/reassignments/$topic/$partition bq. The controller removes /admin/reassignment/$topic/$partition Note the lack of 's' for reassignment. It would be good to make zookeeper paths

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 On Fri, Nov 17, 2017 at 9:34 AM, Bill Bejeck wrote: > +1 > > Thanks, > Bill > > On Fri, Nov 17, 2017 at 12:13 PM, Colin McCabe wrote: > > > +1 (non-binding) > > > > Colin > > > > On Tue, Nov 14, 2017, at 10:02, Guozhang Wang wrote: > > > Hello folks, >

Re: Interested in being a contributor

Please read this: https://kafka.apache.org/contributing You can use this Filter to find issues for new contributor: https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20labels%20%3D%20newbie%20AND%20status%20%3D%20Open Cheers On Sat, Nov 18, 2017 at 2:12 AM, Panuwat

Re: [VOTE] 0.11.0.2 RC0

Running test suite I saw: kafka.admin.ReassignPartitionsClusterTest > shouldExecuteThrottledReassignment FAILED java.lang.AssertionError: Expected replication to be < 1 but was 10138 at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.assertTrue(Assert.java:41)

Re: [DISCUSS] KIP-224: Add configuration parameters `retries` and `retry.backoff.ms` to Streams API

>> can > >>> effectively swallow-and-retry-in-next-loop as we did for non-global > >> stores. > >>> Since global stores are per task not per thread, we would not process > the > >>> task after the global store is bootstrapped fu

  1   2   3   4   5   >