Build failed in Jenkins: kafka-trunk-jdk8 #1288

2017-02-19 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4776; Implement graceful handling for improperly formed compressed -- [...truncated 615.97 KB...] org.apache.kafka.common.metrics.MetricsTest >

[jira] [Commented] (KAFKA-4776) Implement graceful handling for improperly formed compressed message sets

2017-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15874046#comment-15874046 ] ASF GitHub Bot commented on KAFKA-4776: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2572: KAFKA-4776: Implement graceful handling for improp...

2017-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2572 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4776) Implement graceful handling for improperly formed compressed message sets

2017-02-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4776. Resolution: Fixed Fix Version/s: 0.10.3.0 Issue resolved by pull request 2572 [https:

[jira] [Comment Edited] (KAFKA-2319) After controlled shutdown: IllegalStateException: Kafka scheduler has not been started

2017-02-19 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872967#comment-15872967 ] Michał Woś edited comment on KAFKA-2319 at 2/20/17 4:26 AM: I'

[jira] [Comment Edited] (KAFKA-2319) After controlled shutdown: IllegalStateException: Kafka scheduler has not been started

2017-02-19 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872967#comment-15872967 ] Michał Woś edited comment on KAFKA-2319 at 2/20/17 4:26 AM: I'

Re: [VOTE] KIP-98: Exactly Once Delivery and Transactional Messaging

2017-02-19 Thread Guozhang Wang
Thanks Becket. Actually sequence is associated with a message, not a message set. For example if a message set sent by producer contains 100 messages, and the first message's sequence is 5, then the last message's sequence number would be 104, and the next message set's first sequence is expected

[GitHub] kafka-site issue #45: Manual edits needed for 0.10.2 release

2017-02-19 Thread guozhangwang
Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/45 @ewencp Can I merge this patch now since 0.10.2 is released already? I will rebase the patch of course. --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Created] (KAFKA-4781) Kafka should return its advertised host name before any protocol verification is done

2017-02-19 Thread Stephane Maarek (JIRA)
Stephane Maarek created KAFKA-4781: -- Summary: Kafka should return its advertised host name before any protocol verification is done Key: KAFKA-4781 URL: https://issues.apache.org/jira/browse/KAFKA-4781

[jira] [Assigned] (KAFKA-4767) KafkaProducer is not joining its IO thread properly

2017-02-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4767: --- Assignee: huxi > KafkaProducer is not joining its IO thread properly > --

[GitHub] kafka pull request #2576: kafka-4767: KafkaProducer is not joining its IO th...

2017-02-19 Thread amethystic
GitHub user amethystic opened a pull request: https://github.com/apache/kafka/pull/2576 kafka-4767: KafkaProducer is not joining its IO thread properly KafkaProducer#close swallows the InterruptedException which might be acceptable when it's invoked from within the main thread or us

[jira] [Commented] (KAFKA-4780) ReplicaFetcherThread.fetch could not get any reponse

2017-02-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873942#comment-15873942 ] huxi commented on KAFKA-4780: - Seems it is a duplicate of [KAFKA-4477|https://issues.apache.o

[GitHub] kafka pull request #2575: MINOR: update AWS test setup guide

2017-02-19 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/2575 MINOR: update AWS test setup guide You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka minor-update-system-test-readme Alternatively you

Re: [VOTE] KIP-98: Exactly Once Delivery and Transactional Messaging

2017-02-19 Thread Becket Qin
+1. Thanks for the great work on the KIP! I have only one minor question, in the wiki (and the doc) the new message set format has a "FirstSequence" field, should it just be "Sequence" if the sequence is always associated with a message set? On Fri, Feb 17, 2017 at 3:28 AM, Michael Pearce wrote:

[GitHub] kafka pull request #2574: MINOR: Fixed 3 inner classes without instance refe...

2017-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2574 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4774) Inner classes which don't need a reference to the outer class should be static

2017-02-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4774. Resolution: Fixed Fix Version/s: 0.10.3.0 Issue resolved by pull request 2558 [https://github

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-02-19 Thread Jason Gustafson
Re; having a dedicated Headers object. I think it makes sense. Maybe it could implement Iterable? One thing I'm not too sure about is mutability. Both the ProducerRecord and ConsumerRecord are immutable currently. It would be nice to keep it that way. Perhaps Headers could itself be immutable and

Re: [DISCUSS] KIP-124: Request rate quotas

2017-02-19 Thread Becket Qin
Thanks for the KIP, Rajini, If I understand correctly the proposal was essentially trying to quota the CPU usage (that is probably why time slice is used instead of request rate) while the existing quota we have is for network bandwidth. Given we are trying to throttle both CPU and Network, that

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-02-19 Thread radai
"(By the way, doesn't it feel a bit odd that we seem to be designing a feature which is optimized for people not using?)" very. this (i claim :-) ) is the result of very intense opposition to the usefulness of the feature early on, and not a real design goal On Sun, Feb 19, 2017 at 2:11 PM, Micha

[jira] [Commented] (KAFKA-1935) Consumer should use a separate socket for Coordinator connection

2017-02-19 Thread Dipen Patel (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873850#comment-15873850 ] Dipen Patel commented on KAFKA-1935: Hi, I think that this is an interesting

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-02-19 Thread Michael Pearce
On point 1 & 2 Ive updated KIP to show varints (and removed the bit flag). (on the assumption KIP 98 is getting the agreement the protocol is moving from int32 to varInts as standard) On point 3 ive updated to use an array of Header class, instead of a MultiMap in the Headers class object On

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-02-19 Thread Michael Pearce
On points 1 and 2 I agree. This also affects kip-98, I should expect this resolved before that vote also passes. If it is accepted there (I’m assuming this is getting discussed on that KIP? As you’re driving the move to VarInts), I am happy to make this KIP will simply follow suit to whatever i

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-02-19 Thread Jason Gustafson
> > headers dont "leak" into application code. they are useful to application > code as well. This is exactly what I have been trying to get at. The use cases documented here are middleware: https://cwiki.apache.org/confluence/display/KAFKA/A+Case+for+Kafka+Headers. If headers are intended for th

[jira] [Comment Edited] (KAFKA-1524) Implement transactional producer

2017-02-19 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873783#comment-15873783 ] Andrew Olson edited comment on KAFKA-1524 at 2/19/17 6:16 PM: --

[jira] [Commented] (KAFKA-1524) Implement transactional producer

2017-02-19 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873783#comment-15873783 ] Andrew Olson commented on KAFKA-1524: - Can this Jira be closed as obsolete? It appears

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-02-19 Thread radai
headers dont "leak" into application code. they are useful to application code as well. IIUC samze currently has headers "in-V" and would just switch over to kafka headers if they exist. im sure plenty of other users of kafka would have a use for headers. im pretty sure use cases exist around shuff

[jira] [Updated] (KAFKA-4780) ReplicaFetcherThread.fetch could not get any reponse

2017-02-19 Thread mashudong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mashudong updated KAFKA-4780: - Attachment: capture.png log.png > ReplicaFetcherThread.fetch could not get any reponse > -

[jira] [Updated] (KAFKA-4780) ReplicaFetcherThread.fetch could not get any reponse

2017-02-19 Thread mashudong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mashudong updated KAFKA-4780: - Attachment: (was: capture.png) > ReplicaFetcherThread.fetch could not get any reponse > --

[jira] [Updated] (KAFKA-4780) ReplicaFetcherThread.fetch could not get any reponse

2017-02-19 Thread mashudong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mashudong updated KAFKA-4780: - Attachment: (was: log.png) > ReplicaFetcherThread.fetch could not get any reponse > --

[jira] [Created] (KAFKA-4780) ReplicaFetcherThread.fetch could not get any reponse

2017-02-19 Thread mashudong (JIRA)
mashudong created KAFKA-4780: Summary: ReplicaFetcherThread.fetch could not get any reponse Key: KAFKA-4780 URL: https://issues.apache.org/jira/browse/KAFKA-4780 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request #2574: MINOR: Fixed 3 inner classes without instance refe...

2017-02-19 Thread original-brownbear
GitHub user original-brownbear opened a pull request: https://github.com/apache/kafka/pull/2574 MINOR: Fixed 3 inner classes without instance reference to be static * Turned 3 inner classes that weren't static but could be into `static` ones. * Turned one `public` inner class th