[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472806#comment-15472806 ] ASF GitHub Bot commented on KAFKA-3144: --- GitHub user vahidhashemian reopened a pull request:

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472804#comment-15472804 ] ASF GitHub Bot commented on KAFKA-3144: --- Github user vahidhashemian closed the pull request at:

[GitHub] kafka pull request #1336: KAFKA-3144: Report members with no assigned partit...

2016-09-07 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1336 KAFKA-3144: Report members with no assigned partitions in ConsumerGroupCommand This PR makes a couple of enhancements to the `--describe` option of `ConsumerGroupCommand`: 1. Listing

[GitHub] kafka pull request #1336: KAFKA-3144: Report members with no assigned partit...

2016-09-07 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1336 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-07 Thread Gwen Shapira
+1 (binding) On Tue, Sep 6, 2016 at 7:46 PM, Ismael Juma wrote: > Hi all, > > I would like to (re)initiate[1] the voting process for KIP-78 Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id > > As explained in the KIP and discussion

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472599#comment-15472599 ] ASF GitHub Bot commented on KAFKA-4033: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-07 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1726 KAFKA-4033: KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change This PR changes topic subscription semantics so a change in subscription does not

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-07 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1726 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472598#comment-15472598 ] ASF GitHub Bot commented on KAFKA-4033: --- Github user vahidhashemian closed the pull request at:

Build failed in Jenkins: kafka-trunk-jdk7 #1525

2016-09-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4123: Queryable State returning null for key before all stores in [wangguoz] KAFKA-3595: window stores use compact,delete config for changelogs -- [...truncated

Build failed in Jenkins: kafka-trunk-jdk8 #868

2016-09-07 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Document that Connect topics should use compaction [wangguoz] KAFKA-4123: Queryable State returning null for key before all stores in [wangguoz] KAFKA-3595: window stores use compact,delete config for

[jira] [Work started] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-07 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4131 started by Bill Bejeck. -- > Multiple Regex KStream-Consumers cause Null pointer exception in > addRawRecords

Build failed in Jenkins: kafka-trunk-jdk7 #1524

2016-09-07 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Document that Connect topics should use compaction -- [...truncated 6845 lines...] kafka.integration.SslTopicMetadataTest > testAliveBrokerListWithNoTopics STARTED

[jira] [Commented] (KAFKA-1006) Consumer loses messages of a new topic with auto.offset.reset = largest

2016-09-07 Thread Patrick Te Tau (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472427#comment-15472427 ] Patrick Te Tau commented on KAFKA-1006: --- Hi [~guozhang], we are also having trouble with our

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472341#comment-15472341 ] ASF GitHub Bot commented on KAFKA-3144: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request #1336: KAFKA-3144: Report members with no assigned partit...

2016-09-07 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1336 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request #1336: KAFKA-3144: Report members with no assigned partit...

2016-09-07 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1336 KAFKA-3144: Report members with no assigned partitions in ConsumerGroupCommand This PR makes a couple of enhancements to the `--describe` option of `ConsumerGroupCommand`: 1. Listing

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472339#comment-15472339 ] ASF GitHub Bot commented on KAFKA-3144: --- Github user vahidhashemian closed the pull request at:

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-07 Thread Guozhang Wang
+1. On Wed, Sep 7, 2016 at 11:18 AM, Jason Gustafson wrote: > +1 and thanks for the excellent write-up! > > On Wed, Sep 7, 2016 at 10:41 AM, Neha Narkhede wrote: > > > +1 (binding) > > > > On Wed, Sep 7, 2016 at 9:49 AM Grant Henke

[jira] [Commented] (KAFKA-3595) Add capability to specify replication compact option for stream store

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472329#comment-15472329 ] ASF GitHub Bot commented on KAFKA-3595: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-3595) Add capability to specify replication compact option for stream store

2016-09-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3595: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[GitHub] kafka pull request #1792: KAFKA-3595: window stores use compact,delete confi...

2016-09-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1792 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-4123) Queryable State returning null for key before all stores in instance have been initialized

2016-09-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4123. -- Resolution: Fixed Issue resolved by pull request 1824

[GitHub] kafka pull request #1824: KAFKA-4123: Queryable State returning null for key...

2016-09-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1824 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4123) Queryable State returning null for key before all stores in instance have been initialized

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472282#comment-15472282 ] ASF GitHub Bot commented on KAFKA-4123: --- Github user asfgit closed the pull request at:

[jira] [Created] (KAFKA-4143) Transient failure in kafka.server.SaslSslReplicaFetchTest.testReplicaFetcherThread

2016-09-07 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-4143: Summary: Transient failure in kafka.server.SaslSslReplicaFetchTest.testReplicaFetcherThread Key: KAFKA-4143 URL: https://issues.apache.org/jira/browse/KAFKA-4143

[jira] [Resolved] (KAFKA-4043) User-defined handler for topology restart

2016-09-07 Thread Greg Fodor (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Fodor resolved KAFKA-4043. --- Resolution: Not A Problem > User-defined handler for topology restart >

[jira] [Commented] (KAFKA-4043) User-defined handler for topology restart

2016-09-07 Thread Greg Fodor (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472271#comment-15472271 ] Greg Fodor commented on KAFKA-4043: --- Ah, that should work for us. Thanks! > User-defined handler for

Build failed in Jenkins: kafka-trunk-jdk8 #867

2016-09-07 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fixes javadoc of Windows, fixes typo in parameter name of -- [...truncated 6875 lines...] kafka.integration.SaslPlaintextTopicMetadataTest > testAutoCreateTopic

[GitHub] kafka pull request #1832: MINOR: Document that Connect topics should use com...

2016-09-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1832 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4118) StreamsSmokeTest.test_streams started failing since 18 August build

2016-09-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4118: - Assignee: Eno Thereska (was: Guozhang Wang) > StreamsSmokeTest.test_streams started failing

[jira] [Commented] (KAFKA-4118) StreamsSmokeTest.test_streams started failing since 18 August build

2016-09-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472260#comment-15472260 ] Guozhang Wang commented on KAFKA-4118: -- [~enothereska] Could you take a look at this issue? Thanks!

Build failed in Jenkins: kafka-trunk-jdk7 #1523

2016-09-07 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fixes javadoc of Windows, fixes typo in parameter name of -- [...truncated 3416 lines...] kafka.network.SocketServerTest > tooBigRequestIsRejected STARTED

[jira] [Created] (KAFKA-4142) Log files in /data dir date modified keeps being updated?

2016-09-07 Thread Clint Hillerman (JIRA)
Clint Hillerman created KAFKA-4142: -- Summary: Log files in /data dir date modified keeps being updated? Key: KAFKA-4142 URL: https://issues.apache.org/jira/browse/KAFKA-4142 Project: Kafka

[GitHub] kafka pull request #1823: Fixes javadoc of Windows, fixes typo in parameter ...

2016-09-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1823 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (KAFKA-3184) Add Checkpoint for In-memory State Store

2016-09-07 Thread Jeyhun Karimov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeyhun Karimov reassigned KAFKA-3184: - Assignee: Jeyhun Karimov > Add Checkpoint for In-memory State Store >

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-07 Thread Becket Qin
That sounds reasonable to me. I'll update the KIP wiki page. On Wed, Sep 7, 2016 at 1:34 PM, Jason Gustafson wrote: > Hey Becket, > > I don't have a super strong preference, but I think this > > earliestOffset(singleton(partition)); > > captures the intent more clearly than

[jira] [Updated] (KAFKA-4141) 2x increase in cpu usage on new Producer API

2016-09-07 Thread Andrew Jorgensen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Jorgensen updated KAFKA-4141: Description: We are seeing about a 2x increase in CPU usage for the new kafka producer

[jira] [Updated] (KAFKA-4141) 2x increase in cpu usage on new Producer API

2016-09-07 Thread Andrew Jorgensen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Jorgensen updated KAFKA-4141: Description: We are seeing about a 2x increase in CPU usage for the new kafka producer

[jira] [Updated] (KAFKA-4141) 2x increase in cpu usage on new Producer API

2016-09-07 Thread Andrew Jorgensen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Jorgensen updated KAFKA-4141: Description: We are seeing about a 2x increase in CPU usage for the new kafka producer

[jira] [Created] (KAFKA-4141) 2x increase in cp usage on new Producer API

2016-09-07 Thread Andrew Jorgensen (JIRA)
Andrew Jorgensen created KAFKA-4141: --- Summary: 2x increase in cp usage on new Producer API Key: KAFKA-4141 URL: https://issues.apache.org/jira/browse/KAFKA-4141 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-4141) 2x increase in cpu usage on new Producer API

2016-09-07 Thread Andrew Jorgensen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Jorgensen updated KAFKA-4141: Summary: 2x increase in cpu usage on new Producer API (was: 2x increase in cp usage on new

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-07 Thread Jason Gustafson
Hey Becket, I don't have a super strong preference, but I think this earliestOffset(singleton(partition)); captures the intent more clearly than this: offsetsForTimes(singletonMap(partition, -1)); I can understand the desire to keep the API footprint small, but I think the use case is common

[jira] [Commented] (KAFKA-4074) Deleting a topic can make it unavailable even if delete.topic.enable is false

2016-09-07 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471686#comment-15471686 ] Joel Koshy commented on KAFKA-4074: --- Yes - totally missed KAFKA-3175 > Deleting a topic can make it

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-07 Thread Becket Qin
Hi Jason, Thanks for the feedback. That is a good point. For the -1 and -2 semantics, I was just thinking we will preserve the semantics in the wire protocol. For the user facing API, I agree that is not intuitive. We can do one of the following: 1. Add two separate methods: earliestOffsets() and

[jira] [Commented] (KAFKA-4140) Update system tests to allow running tests in parallel

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471552#comment-15471552 ] ASF GitHub Bot commented on KAFKA-4140: --- GitHub user granders opened a pull request:

[GitHub] kafka pull request #1834: [WIP] KAFKA-4140: make system tests parallel frien...

2016-09-07 Thread granders
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/1834 [WIP] KAFKA-4140: make system tests parallel friendly Updates to take advantage of soon-to-be-released ducktape features. You can merge this pull request into a Git repository by running: $

[jira] [Created] (KAFKA-4140) Update system tests to allow running tests in parallel

2016-09-07 Thread Geoff Anderson (JIRA)
Geoff Anderson created KAFKA-4140: - Summary: Update system tests to allow running tests in parallel Key: KAFKA-4140 URL: https://issues.apache.org/jira/browse/KAFKA-4140 Project: Kafka Issue

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-07 Thread Jason Gustafson
+1 and thanks for the excellent write-up! On Wed, Sep 7, 2016 at 10:41 AM, Neha Narkhede wrote: > +1 (binding) > > On Wed, Sep 7, 2016 at 9:49 AM Grant Henke wrote: > > > +1 (non-binding) > > > > On Wed, Sep 7, 2016 at 6:55 AM, Rajini Sivaram < > >

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-07 Thread Jason Gustafson
Hey Becket, Thanks for the KIP. As I understand, the intention is to preserve the current behavior with a timestamp of -1 indicating latest timestamp and -2 indicating earliest timestamp. So users can query these offsets using the offsetsForTimes API if they know the magic values. I'm wondering

Build failed in Jenkins: kafka-trunk-jdk7 #1522

2016-09-07 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3129; Console producer issue when request-required-acks=0 -- [...truncated 12204 lines...] org.apache.kafka.streams.kstream.internals.KTableFilterTest >

Re: [DISCUSS] Time-based releases for Apache Kafka

2016-09-07 Thread Neha Narkhede
Thanks for volunteering, Jason! On Wed, Sep 7, 2016 at 1:59 AM Ismael Juma wrote: > Thanks for volunteering Jason. Sounds good to me, > > Ismael > > On Wed, Sep 7, 2016 at 4:22 AM, Jason Gustafson > wrote: > > > Hey All, > > > > It sounds like the general

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-07 Thread Neha Narkhede
+1 (binding) On Wed, Sep 7, 2016 at 9:49 AM Grant Henke wrote: > +1 (non-binding) > > On Wed, Sep 7, 2016 at 6:55 AM, Rajini Sivaram < > rajinisiva...@googlemail.com > > wrote: > > > +1 (non-binding) > > > > On Wed, Sep 7, 2016 at 4:09 AM, Sriram Subramanian

Build failed in Jenkins: kafka-trunk-jdk8 #866

2016-09-07 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3129; Console producer issue when request-required-acks=0 -- [...truncated 3469 lines...] kafka.coordinator.GroupMetadataManagerTest > testStoreNonEmptyGroup STARTED

[jira] [Assigned] (KAFKA-4135) Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription

2016-09-07 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian reassigned KAFKA-4135: -- Assignee: Vahid Hashemian > Inconsistent javadoc for KafkaConsumer.poll behavior when

[jira] [Reopened] (KAFKA-3129) Console producer issue when request-required-acks=0

2016-09-07 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote reopened KAFKA-3129: Reopening per [~ijuma]'s recommendation as acks=0 in general still has a problem somewhere along the

[jira] [Resolved] (KAFKA-3129) Console producer issue when request-required-acks=0

2016-09-07 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote resolved KAFKA-3129. Resolution: Fixed > Console producer issue when request-required-acks=0 >

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-07 Thread Becket Qin
Thanks everyone for all the feedback. If there is no further concerns or comments I will start a voting thread on this KIP tomorrow. Thanks, Jiangjie (Becket) Qin On Tue, Sep 6, 2016 at 9:48 AM, Becket Qin wrote: > Hi Magnus, > > Thanks for the comments. I agree that

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-07 Thread Grant Henke
+1 (non-binding) On Wed, Sep 7, 2016 at 6:55 AM, Rajini Sivaram wrote: > +1 (non-binding) > > On Wed, Sep 7, 2016 at 4:09 AM, Sriram Subramanian > wrote: > > > +1 binding > > > > > On Sep 6, 2016, at 7:46 PM, Ismael Juma

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-07 Thread Grant Henke
Congratulations and thank you for all of your contributions to Apache Kafka Jason! On Wed, Sep 7, 2016 at 10:12 AM, Mayuresh Gharat wrote: > congrats Jason ! > > Thanks, > > Mayuresh > > On Wed, Sep 7, 2016 at 5:16 AM, Eno Thereska > wrote:

[jira] [Commented] (KAFKA-3129) Console producer issue when request-required-acks=0

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471028#comment-15471028 ] ASF GitHub Bot commented on KAFKA-3129: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1795: KAFKA-3129: Console producer issue when request-re...

2016-09-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1795 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1833: MINOR: fix transient QueryableStateIntegration tes...

2016-09-07 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1833 MINOR: fix transient QueryableStateIntegration test failure The verification in verifyGreaterOrEqual was incorrect. It was failing when a new key was found. Set the TimeWindow to a large value so

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-07 Thread Mayuresh Gharat
congrats Jason ! Thanks, Mayuresh On Wed, Sep 7, 2016 at 5:16 AM, Eno Thereska wrote: > Congrats Jason! > > Eno > > On 7 Sep 2016, at 10:00, Rajini Sivaram > wrote: > > > > Congrats, Jason! > > > > On Wed, Sep 7, 2016 at 8:29 AM, Flavio P

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-09-07 Thread Damian Guy
Gouzhang, Some points about what you have mentioned: 1. You can't just call context.forward() on the flush listener. You have to set some other contextual information (currently ProcessorRecordContext) prior to doing this otherwise the nodes you are forwarding to are undetermined, i.e, this can

[GitHub] kafka pull request #1832: MINOR: Document that Connect topics should use com...

2016-09-07 Thread mfenniak
GitHub user mfenniak opened a pull request: https://github.com/apache/kafka/pull/1832 MINOR: Document that Connect topics should use compaction Update documentation for Kafka Connect distributed’s config.storage.topic, offset.storage.topic, and status.storage.topic configuration

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-07 Thread Eno Thereska
Congrats Jason! Eno > On 7 Sep 2016, at 10:00, Rajini Sivaram wrote: > > Congrats, Jason! > > On Wed, Sep 7, 2016 at 8:29 AM, Flavio P JUNQUEIRA wrote: > >> Congrats, Jason. Well done and great to see this project inviting new >> committers. >>

[jira] [Commented] (KAFKA-4137) Refactor multi-threaded consumer for safer network layer access

2016-09-07 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470445#comment-15470445 ] Ismael Juma commented on KAFKA-4137: KAFKA-1935 may be a duplicate of this one (with less detail, so

[jira] [Commented] (KAFKA-451) follower replica may need to backoff the fetching if leader is not ready yet

2016-09-07 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470408#comment-15470408 ] Ismael Juma commented on KAFKA-451: --- We have the following code in AbstractFetcherThread: {code}

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-07 Thread Rajini Sivaram
+1 (non-binding) On Wed, Sep 7, 2016 at 4:09 AM, Sriram Subramanian wrote: > +1 binding > > > On Sep 6, 2016, at 7:46 PM, Ismael Juma wrote: > > > > Hi all, > > > > I would like to (re)initiate[1] the voting process for KIP-78 Cluster Id: > > > >

[jira] [Updated] (KAFKA-4034) Consumer need not lookup coordinator when using manual assignment

2016-09-07 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4034: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Consumer need not lookup

[jira] [Updated] (KAFKA-4139) Kafka consumer stuck in ensureCoordinatorReady after broker failure

2016-09-07 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-4139: -- Status: Patch Available (was: Open) > Kafka consumer stuck in ensureCoordinatorReady after

[jira] [Commented] (KAFKA-4139) Kafka consumer stuck in ensureCoordinatorReady after broker failure

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470168#comment-15470168 ] ASF GitHub Bot commented on KAFKA-4139: --- GitHub user rajinisivaram opened a pull request:

[GitHub] kafka pull request #1831: KAFKA-4139: Reset findCoordinatorFuture when broke...

2016-09-07 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/1831 KAFKA-4139: Reset findCoordinatorFuture when brokers are unavailable You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafka

Build failed in Jenkins: kafka-trunk-jdk7 #1521

2016-09-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4058: Failure in -- [...truncated 6092 lines...] kafka.log.FileMessageSetTest > testFileSize STARTED kafka.log.FileMessageSetTest > testFileSize PASSED

[DISCUSS] KIP-68 Add a consumed log retention before log retention

2016-09-07 Thread Pengwei (L)
Hi All, I have made a KIP to enhance the log retention, details as follows: https://cwiki.apache.org/confluence/display/KAFKA/KIP-68+Add+a+consumed+log+retention+before+log+retention Now start a discuss thread for this KIP , looking forward to the feedback. Thanks, David

[jira] [Created] (KAFKA-4139) Kafka consumer stuck in ensureCoordinatorReady after broker failure

2016-09-07 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-4139: - Summary: Kafka consumer stuck in ensureCoordinatorReady after broker failure Key: KAFKA-4139 URL: https://issues.apache.org/jira/browse/KAFKA-4139 Project: Kafka

[jira] [Commented] (KAFKA-4119) Get topic offset with Kafka SSL

2016-09-07 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470107#comment-15470107 ] Rajini Sivaram commented on KAFKA-4119: --- Only the new consumer supports security. So if you have

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-07 Thread Rajini Sivaram
Congrats, Jason! On Wed, Sep 7, 2016 at 8:29 AM, Flavio P JUNQUEIRA wrote: > Congrats, Jason. Well done and great to see this project inviting new > committers. > > -Flavio > > On 7 Sep 2016 04:58, "Ashish Singh" wrote: > > > Congrats, Jason! > > > > On

[jira] [Commented] (KAFKA-3703) Selector.close() doesn't complete outgoing writes

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470071#comment-15470071 ] ASF GitHub Bot commented on KAFKA-3703: --- Github user rajinisivaram closed the pull request at:

Re: [DISCUSS] Time-based releases for Apache Kafka

2016-09-07 Thread Ismael Juma
Thanks for volunteering Jason. Sounds good to me, Ismael On Wed, Sep 7, 2016 at 4:22 AM, Jason Gustafson wrote: > Hey All, > > It sounds like the general consensus is in favor of time-based releases. We > can continue the discussion about LTS, but I wanted to go ahead and

[GitHub] kafka pull request #1817: KAFKA-3703: Flush outgoing writes before closing c...

2016-09-07 Thread rajinisivaram
Github user rajinisivaram closed the pull request at: https://github.com/apache/kafka/pull/1817 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Created] (KAFKA-4138) Producer data write network traffic to kafka brokers is increased for 50%

2016-09-07 Thread Zane Zhang (JIRA)
Zane Zhang created KAFKA-4138: - Summary: Producer data write network traffic to kafka brokers is increased for 50% Key: KAFKA-4138 URL: https://issues.apache.org/jira/browse/KAFKA-4138 Project: Kafka

[GitHub] kafka pull request #1830: [WIP] KIP-78 : Cluster Identifier (KAFKA-4093)

2016-09-07 Thread arrawatia
GitHub user arrawatia opened a pull request: https://github.com/apache/kafka/pull/1830 [WIP] KIP-78 : Cluster Identifier (KAFKA-4093) This is a first draft that includes the following changes: 1. Changes to the broker code. - generation of cluster id and storing it in

[jira] [Commented] (KAFKA-4111) broker compress data of certain size instead on a produce request

2016-09-07 Thread julien1987 (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469890#comment-15469890 ] julien1987 commented on KAFKA-4111: --- Thanks.On our scene, message qps of every producer is very small,

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-07 Thread Flavio P JUNQUEIRA
Congrats, Jason. Well done and great to see this project inviting new committers. -Flavio On 7 Sep 2016 04:58, "Ashish Singh" wrote: > Congrats, Jason! > > On Tuesday, September 6, 2016, Jason Gustafson wrote: > > > Thanks all! > > > > On Tue, Sep 6,

Build failed in Jenkins: kafka-trunk-jdk8 #865

2016-09-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4058: Failure in -- [...truncated 12243 lines...] org.apache.kafka.streams.kstream.internals.KTableFilterTest > testSkipNullOnMaterialization PASSED

Build failed in Jenkins: kafka-trunk-jdk7 #1520

2016-09-07 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Reduce the log level when the peer isn't authenticated but is -- [...truncated 5644 lines...] kafka.security.auth.SimpleAclAuthorizerTest > testDenyTakesPrecedence

[jira] [Commented] (KAFKA-3776) Unify store and downstream caching in streams

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469728#comment-15469728 ] ASF GitHub Bot commented on KAFKA-3776: --- GitHub user enothereska reopened a pull request:

[jira] [Commented] (KAFKA-3776) Unify store and downstream caching in streams

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469727#comment-15469727 ] ASF GitHub Bot commented on KAFKA-3776: --- Github user enothereska closed the pull request at:

[GitHub] kafka pull request #1752: KAFKA-3776: Unify store and downstream caching in ...

2016-09-07 Thread enothereska
GitHub user enothereska reopened a pull request: https://github.com/apache/kafka/pull/1752 KAFKA-3776: Unify store and downstream caching in streams You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka

[GitHub] kafka pull request #1752: KAFKA-3776: Unify store and downstream caching in ...

2016-09-07 Thread enothereska
Github user enothereska closed the pull request at: https://github.com/apache/kafka/pull/1752 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (KAFKA-4126) No relevant log when the topic is non-existent

2016-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469699#comment-15469699 ] Balázs Barnabás commented on KAFKA-4126: Yes, in my opinion that would be useful, a small typo

[jira] [Commented] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469675#comment-15469675 ] ASF GitHub Bot commented on KAFKA-4058: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1767: KAFKA-4058: Failure in org.apache.kafka.streams.in...

2016-09-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1767 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-09-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4058: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch