[GitHub] kafka pull request #3365: MINOR: Unused logger removed.

2017-06-16 Thread Kamal15
GitHub user Kamal15 opened a pull request: https://github.com/apache/kafka/pull/3365 MINOR: Unused logger removed. You can merge this pull request into a Git repository by running: $ git pull https://github.com/Kamal15/kafka logger Alternatively you can review and apply these

[GitHub] kafka pull request #3364: HOTFIX: Use ResourceType.toJava instead of Resourc...

2017-06-16 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3364 HOTFIX: Use ResourceType.toJava instead of ResourceType.fromString The latter doesn't work for TransactionalId (or any type with two camel-case words). You can merge this pull request into a Git r

[GitHub] kafka pull request #3363: MINOR: Some small cleanups/improvements to KAFKA-5...

2017-06-16 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3363 MINOR: Some small cleanups/improvements to KAFKA-5031 You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-5031-FOLLOWUP Alt

[GitHub] kafka pull request #3156: KAFKA-5031: validate count of records for DefaultR...

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3156 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3362: MINOR: StreamThread standbyTask comment typo

2017-06-16 Thread zqhxuyuan
GitHub user zqhxuyuan opened a pull request: https://github.com/apache/kafka/pull/3362 MINOR: StreamThread standbyTask comment typo log info typos. should be standby task, not active task. You can merge this pull request into a Git repository by running: $ git pull https://gith

Jenkins build is back to normal : kafka-trunk-jdk8 #1719

2017-06-16 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #3171: MINOR: A few cleanups in KafkaApis and Transaction...

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3171 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3361: KAFKA-5435: Improve producer state loading after f...

2017-06-16 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3361 KAFKA-5435: Improve producer state loading after failure You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-5435-ALT Alter

[GitHub] kafka pull request #3306: KAFKA-5435: Ensure producer snapshot retained afte...

2017-06-16 Thread hachikuji
Github user hachikuji closed the pull request at: https://github.com/apache/kafka/pull/3306 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] kafka pull request #3360: KAFKA-5020: Update message format in implementatio...

2017-06-16 Thread apurvam
GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/3360 KAFKA-5020: Update message format in implementation docs You can merge this pull request into a Git repository by running: $ git pull https://github.com/apurvam/kafka KAFKA-5020-message-forma

[jira] [Created] (KAFKA-5464) StreamsKafkaClient should not use StreamsConfig.POLL_MS_CONFIG

2017-06-16 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-5464: -- Summary: StreamsKafkaClient should not use StreamsConfig.POLL_MS_CONFIG Key: KAFKA-5464 URL: https://issues.apache.org/jira/browse/KAFKA-5464 Project: Kafka

Re: [VOTE] KIP-160: Augment KStream.print() to allow users pass in extra parameters in the printed string

2017-06-16 Thread Guozhang Wang
Yes. Please update the wiki page of KIP-160 as well, and then recall the voting process. For those who already voted, please re-review the wiki page and re-cast your vote. Guozhang On Thu, Jun 15, 2017 at 7:08 PM, James Chain wrote: > @Guozhang > > OK, I will add it on writeAsText as well. > S

Build failed in Jenkins: kafka-trunk-jdk8 #1718

2017-06-16 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: clarify partition option behavior for console consumer -- [...truncated 4.10 MB...] at hudson.triggers.SCMTrigger$Runner.runPolling(SC

[GitHub] kafka pull request #3338: KAFKA-5446: Annoying braces showed on log.error us...

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3338 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3359: KAFKA-5062. Kafka brokers can accept malformed req...

2017-06-16 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/3359 KAFKA-5062. Kafka brokers can accept malformed requests which allocat… …e gigabytes of memory You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] kafka pull request #3358: KAFKA-5463: Controller incorrectly logs rack infor...

2017-06-16 Thread jeffchao
GitHub user jeffchao opened a pull request: https://github.com/apache/kafka/pull/3358 KAFKA-5463: Controller incorrectly logs rack information when new brokers are added This change is in response to https://issues.apache.org/jira/browse/KAFKA-5463. When a new broker is ad

[jira] [Created] (KAFKA-5463) Controller incorrectly logs rack information when new brokers are added

2017-06-16 Thread Jeff Chao (JIRA)
Jeff Chao created KAFKA-5463: Summary: Controller incorrectly logs rack information when new brokers are added Key: KAFKA-5463 URL: https://issues.apache.org/jira/browse/KAFKA-5463 Project: Kafka

[GitHub] kafka pull request #3227: MINOR: fix quotes for consistent rendering

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3227 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3228: MINOR: (docs) in section, not at section

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3228 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3356: KAFKA-5456: Ensure producer handles old format lar...

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3356 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3357: KAFKA-5413: Log cleaner fails due to large offset ...

2017-06-16 Thread kelvinrutt
GitHub user kelvinrutt opened a pull request: https://github.com/apache/kafka/pull/3357 KAFKA-5413: Log cleaner fails due to large offset in segment file the contribution is my original work and I license the work to the project under the project's open source license. @jun

to be added the contributor list

2017-06-16 Thread Qingtian Wang
Hello, Not sure if this is right list to send my request I'd like to start contributing by working on simple JIRA issues as suggested by the Kafka website. Per the instruction: - Please contact us to be added the contributor list I'd like to be added to the contribute list, but not sure

Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-16 Thread Matthias J. Sax
Thanks Michał! That is very good feedback. -Matthias On 6/16/17 2:38 AM, Michal Borowiecki wrote: > I wonder if it's a frequent enough use case that Kafka Streams should > consider providing this out of the box - this was asked for multiple > times, right? > > Personally, I agree totally with

Re: Improving tools: --help

2017-06-16 Thread Tom Bentley
> I just checked kafka-topics.sh and the only required argument there is > --zookeeper option. Not sure if you were thinking of some other command. > > I meant that for kafka-topics.sh --create requires --topic (amongst others), but --list does not. (For example, using these methods we can say som

Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-16 Thread Jay Kreps
I think the question is when do you actually *want* processing time semantics? There are definitely times when its safe to assume the two are close enough that a little lossiness doesn't matter much but it is pretty hard to make assumptions about when the processing time is and has been hard for us

Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-16 Thread Jay Kreps
I think the question is when do you actually *want* processing time semantics? There are definitely times when its safe to assume the two are close enough that a little lossiness doesn't matter much but it is pretty hard to make assumptions about when the processing time is and has been hard for us

Re: Improving tools: --help

2017-06-16 Thread Mariam John
Hi Tom, I just checked kafka-topics.sh and the only required argument there is --zookeeper option. Not sure if you were thinking of some other command. But I understand what you mean. One of the places where I had some trouble with something related is the kafka-console-consumer command where t

[jira] [Created] (KAFKA-5462) Add a configuration for users to specify a template for building a custom principal name

2017-06-16 Thread Koelli Mungee (JIRA)
Koelli Mungee created KAFKA-5462: Summary: Add a configuration for users to specify a template for building a custom principal name Key: KAFKA-5462 URL: https://issues.apache.org/jira/browse/KAFKA-5462

[DISCUSS] KIP-168: Add TotalTopicCount metric per cluster

2017-06-16 Thread Abhishek Mendhekar
Hi Kafka Dev, I created KIP-168 to propose adding a metric to emit total topic count in a cluster. The metric will be emited by the controller. The KIP can be found here (https://cwiki.apache.org/confluence/display/KAFKA/KIP-168%3A+Add+TotalTopicCount+metric+per+cluster) and the assciated JIRA im

[GitHub] kafka pull request #3153: MINOR: clarify partition option behavior for conso...

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3153 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-5461) KIP-168: Add TotalTopicCount metric per cluster

2017-06-16 Thread Abhishek Mendhekar (JIRA)
Abhishek Mendhekar created KAFKA-5461: - Summary: KIP-168: Add TotalTopicCount metric per cluster Key: KAFKA-5461 URL: https://issues.apache.org/jira/browse/KAFKA-5461 Project: Kafka Issue

Re: Improving tools: --help

2017-06-16 Thread Tom Bentley
That's a great start Mariam, thanks. Out of interest, how do you handle required arguments for something like kafka-topics.sh where what's required depends on the 'action' option? Cheers, Tom On 16 June 2017 at 15:55, Mariam John wrote: > Hi Tom, > > I just wanted to let you know that I am cu

Jenkins build is back to normal : kafka-trunk-jdk8 #1716

2017-06-16 Thread Apache Jenkins Server
See

Re: Improving tools: --help

2017-06-16 Thread Mariam John
Hi Tom, I just wanted to let you know that I am currently working on KAFKA-2111: https://issues.apache.org/jira/browse/KAFKA-2111 and am almost done with it. The changes that are included in this patch are: - add --help option to all the commands where it is missing - correctly mark all the re

Re?? [DISCUSS] KIP-148: Add a connect timeout for client

2017-06-16 Thread ????????
Hi Colin, I think the exponential backoff should still apply, thanks for the explanation. thanks, David -- -- ??: "Colin McCabe";; : 2017??6??13??(??) 1:43 ??: "dev"; : Re: ??Re?? [DISCUSS] KIP-148: Add a connect tim

[GitHub] kafka pull request #3355: KAFKA-5457: MemoryRecordsBuilder.hasRoomFor should...

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3355 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5457) MemoryRecordsBuilder.hasRoomfor doesn't take into account the headers while computing available space

2017-06-16 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5457. Resolution: Fixed Issue resolved by pull request 3355 [https://github.com/apache/kafka/pull/3355] >

Improving tools: --help

2017-06-16 Thread Tom Bentley
Hi, I noticed that the command line tools could use a little love. For instance, I was surprised that most of them don't support `--help`, and generally there are a few inconsistencies. KIP-14 is dormant and AFAICS no one is working on https://issues.apache.org/jira/browse/KAFKA-2111 either. So i

Build failed in Jenkins: kafka-trunk-jdk8 #1715

2017-06-16 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Consolidate Utils.newThread, Utils.daemonThread and KafkaThread -- [...truncated 4.77 MB...] org.apache.kafka.connect.runtime.distributed.Dis

[jira] [Created] (KAFKA-5460) Documentation on website uses word-breaks resulting in confusion

2017-06-16 Thread Karel Vervaeke (JIRA)
Karel Vervaeke created KAFKA-5460: - Summary: Documentation on website uses word-breaks resulting in confusion Key: KAFKA-5460 URL: https://issues.apache.org/jira/browse/KAFKA-5460 Project: Kafka

[GitHub] kafka pull request #3125: KAFKA-5311: Support ExtendedDeserializer in Kafka ...

2017-06-16 Thread subnova
Github user subnova closed the pull request at: https://github.com/apache/kafka/pull/3125 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] kafka pull request #3351: MINOR: Add --help to DumpLogSegments

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3351 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #3350: MINOR: Redirected the creation of new Thread to Ka...

2017-06-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3350 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-5459) Support kafka-console-producer.sh messages as whole file

2017-06-16 Thread Tom Bentley (JIRA)
Tom Bentley created KAFKA-5459: -- Summary: Support kafka-console-producer.sh messages as whole file Key: KAFKA-5459 URL: https://issues.apache.org/jira/browse/KAFKA-5459 Project: Kafka Issue Type

Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-16 Thread Michal Borowiecki
I wonder if it's a frequent enough use case that Kafka Streams should consider providing this out of the box - this was asked for multiple times, right? Personally, I agree totally with the philosophy of "no final aggregation", as expressed by Eno's post, but IMO that is predicated totally on

[jira] [Resolved] (KAFKA-5426) One second delay in kafka-console-producer

2017-06-16 Thread Paolo Patierno (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paolo Patierno resolved KAFKA-5426. --- Resolution: Not A Bug > One second delay in kafka-console-producer > -