Re: [DISCUSS] KIP-263: Allow broker to skip sanity check of inactive segments on broker startup

This is great and definitely needed. I'm not exactly sure of what goes in the process of checking log files at startup, but is there something like signature checks of files (especially closed, immutable ones) that can be saved on disk and checked against at startup ? Wouldn't that help speed up

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

Bootstrap servers vs broker list is the biggest hurdle when teaching to beginners. A standardized set of parameters would incredibly help On 27 Feb. 2018 9:44 am, "Matthias J. Sax" wrote: I agree on consistency, too. However, I am not sure if we should introduce an

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Sounds awesome ! Are you planning to have auto scaling of partitions in a following KIP ? That would be the holy grail On 28 Feb. 2018 5:13 pm, "Dong Lin" wrote: > Hey Jan, > > I am not sure if it is acceptable for producer to be stopped for a while, > particularly for

Re: [VOTE] 1.0.1 RC2

+1. Verified artifacts and ran the basic quickstart. -Jason On Mon, Feb 26, 2018 at 1:08 AM, Manikumar wrote: > +1 (non-binding) > Built src and ran tests > Ran core quick start > > On Sat, Feb 24, 2018 at 8:44 PM, Jakub Scholz wrote: > > > +1

[jira] [Created] (KAFKA-6601) Kafka manager does not provide consumer offset producer rate with kafka v2.10-0.10.2.0

Rajendra Jangir created KAFKA-6601: -- Summary: Kafka manager does not provide consumer offset producer rate with kafka v2.10-0.10.2.0 Key: KAFKA-6601 URL: https://issues.apache.org/jira/browse/KAFKA-6601

Jenkins build is back to normal : kafka-trunk-jdk8 #2443

See

Re: Kafka 0.11.0.1 and filebeat 6.1 compatibility

filebeat is implemented using sarama last I checked, so presumably they are on a version that doesn't know about Kafka 0.11.0.1 and therefore it doesn't know which API versions to use. Not sure if they support leaving it blank or exactly how the sarama config works, but as far as I know sarama

Re: Question about developer documentation

The web page is more about general project info and might be of interest to people beyond just developers. But I agree the wiki landing page could use some updating. Even more than just the developer section as we're missing several releases, the oldest ones are listed at the top, etc. -Ewen On

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Hey Jan, I am not sure if it is acceptable for producer to be stopped for a while, particularly for online application which requires low latency. I am also not sure how consumers can switch to a new topic. Does user application needs to explicitly specify a different topic for producer/consumer

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Hey Allen, Thanks for the comments. On Mon, Feb 26, 2018 at 9:27 PM, Allen Wang wrote: > Hi Dong, > > Please see my comments inline. > > Thanks, > Allen > > On Sun, Feb 25, 2018 at 3:33 PM, Dong Lin wrote: > > > Hey Allen, > > > > Thanks for

Jenkins build is back to normal : kafka-trunk-jdk7 #3218

See

Re: [DISCUSS] KIP-264: Add a consumer metric to record raw fetch size

Thanks Ted for taking a look. I tried to follow the naming pattern used for 'bytes-fetched' metric. For 'bytes-fetched' we have 'bytes-consumed-rate' (as the size of uncompressed fetched record size). As for the raw (compressed) fetch size, we will have 'raw-bytes-consumed-rate'. I'll try to

Re: [DISCUSS] KIP-264: Add a consumer metric to record raw fetch size

There is raw-bytes-consumed in the sample code. Can you add description for that ? Looks good overall. On Tue, Feb 27, 2018 at 12:42 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi all, > > I started a short, and hopefully trivial, KIP to add a KafkaConsumer > metric: >

[DISCUSS] KIP-264: Add a consumer metric to record raw fetch size

Hi all, I started a short, and hopefully trivial, KIP to add a KafkaConsumer metric: https://cwiki.apache.org/confluence/display/KAFKA/KIP-264%3A+Add+a+consumer+metric+to+record+raw+fetch+size Your feedback and suggestions are welcome! Thanks. --Vahid

Hello

Hello,we are a Open source Chinese document organization ,now we are spending time on translating kafka document into Chinese. This is 1.0.0 version link https://github.com/apachecn/kafka-doc-zh/tree/1.0.0。 We want to further cooperation with you, let more Chinese developers more convenient to

Re: Wiki permission

User Panuwat Anawatmongkhon (panuwat.anawatmonghkon) has already permissions to create and edit wiki pages. -Matthias On 2/26/18 11:23 PM, Panuwat Anawatmongkhon wrote: > Hi all, > Can I have permission for create and edit KIP? > My profile name is Panuwat Anawatmongkhon. > Cheers, > Benz >

[jira] [Created] (KAFKA-6600) Kafka Bytes Out lags behind Kafka Bytes In on all brokers when topics replicated with 3 and flume kafka consumer.

kaushik srinivas created KAFKA-6600: --- Summary: Kafka Bytes Out lags behind Kafka Bytes In on all brokers when topics replicated with 3 and flume kafka consumer. Key: KAFKA-6600 URL:

[jira] [Created] (KAFKA-6599) KTable KTable join semantics violated when caching enabled

Jan Filipiak created KAFKA-6599: --- Summary: KTable KTable join semantics violated when caching enabled Key: KAFKA-6599 URL: https://issues.apache.org/jira/browse/KAFKA-6599 Project: Kafka Issue

[jira] [Created] (KAFKA-6598) Kafka to support using ETCD beside Zookeeper

Sebastian Toader created KAFKA-6598: --- Summary: Kafka to support using ETCD beside Zookeeper Key: KAFKA-6598 URL: https://issues.apache.org/jira/browse/KAFKA-6598 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-6597) Issues with Zookeeper and Kafka startup in Windows environment

Alex Dunayevsky created KAFKA-6597: -- Summary: Issues with Zookeeper and Kafka startup in Windows environment Key: KAFKA-6597 URL: https://issues.apache.org/jira/browse/KAFKA-6597 Project: Kafka

[jira] [Created] (KAFKA-6596) Why we can not see any consumer offset produce rate in kafka manager

Rajendra Jangir created KAFKA-6596: -- Summary: Why we can not see any consumer offset produce rate in kafka manager Key: KAFKA-6596 URL: https://issues.apache.org/jira/browse/KAFKA-6596 Project:

Build failed in Jenkins: kafka-trunk-jdk8 #2442

See Changes: [github] KAFKA-6534: Enforce a rebalance in the next poll call when encounter -- [...truncated 416.49 KB...] kafka.zookeeper.ZooKeeperClientTest >

Build failed in Jenkins: kafka-trunk-jdk7 #3217

See Changes: [github] KAFKA-6534: Enforce a rebalance in the next poll call when encounter -- [...truncated 608.37 KB...] kafka.integration.TopicMetadataTest >