[jira] [Commented] (KAFKA-3926) Transient failures in org.apache.kafka.streams.integration.RegexSourceIntegrationTest

2016-07-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363765#comment-15363765 ] ASF GitHub Bot commented on KAFKA-3926: --- GitHub user bbejeck opened a pull request:

[GitHub] kafka pull request #1590: KAFKA-3926: confirm all expected topics added/remo...

2016-07-05 Thread bbejeck
GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/1590 KAFKA-3926: confirm all expected topics added/removed in createStream… …Tasks call versus simply asserting createStreamTasks method called. You can merge this pull request into a Git repository

[jira] [Work started] (KAFKA-3926) Transient failures in org.apache.kafka.streams.integration.RegexSourceIntegrationTest

2016-07-05 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3926 started by Bill Bejeck. -- > Transient failures in >

[jira] [Commented] (KAFKA-3926) Transient failures in org.apache.kafka.streams.integration.RegexSourceIntegrationTest

2016-07-05 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363724#comment-15363724 ] Bill Bejeck commented on KAFKA-3926: Looking at this a bit more. The test in question is failing on

[jira] [Comment Edited] (KAFKA-3927) kafka broker config docs issue

2016-07-05 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363608#comment-15363608 ] Shawn Guo edited comment on KAFKA-3927 at 7/6/16 2:35 AM: -- these parameters have

[jira] [Comment Edited] (KAFKA-3927) kafka broker config docs issue

2016-07-05 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363608#comment-15363608 ] Shawn Guo edited comment on KAFKA-3927 at 7/6/16 2:25 AM: -- these parameters have

[jira] [Commented] (KAFKA-3927) kafka broker config docs issue

2016-07-05 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363608#comment-15363608 ] Shawn Guo commented on KAFKA-3927: -- these parameters have default value in 0.8 version in config docs, "

Re: [DISCUSS] KIP-53 Add custom policies for reconnect attempts to NetworkdClient

2016-07-05 Thread Ismael Juma
Hi Dana, Thanks for the PR. Technically, a (simple) KIP is required when proposing new configs. Ismael On Sun, Jun 19, 2016 at 7:42 PM, Dana Powers wrote: > I took a stab at implementing a simplified exponential + randomized > backoff policy here:

[jira] [Commented] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

2016-07-05 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363465#comment-15363465 ] Ismael Juma commented on KAFKA-3876: You're probably right [~guozhang]. Here's a PR that increases the

[GitHub] kafka pull request #1589: MINOR: Increase default `waitTime` in `waitUntilTr...

2016-07-05 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1589 MINOR: Increase default `waitTime` in `waitUntilTrue` to 10 seconds 5 seconds is probably enough when running tests locally, but doesn't seem to be so for Jenkins when it is overloaded. You can

[jira] [Commented] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

2016-07-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363389#comment-15363389 ] Guozhang Wang commented on KAFKA-3929: -- I think it'll be better to just define the producer /

NPE using GenericAvroSerde to deserialize

2016-07-05 Thread Philippe Derome
This is possibly more of a Confluent question as GenericAvroSerde is in Confluent example code base. I have a small Stream application, which creates a KTable with String key and GenericRecord value. I then specify a Serde (new GenericAvroSerde) as value deserializer when outputting to topic via

Build failed in Jenkins: kafka-trunk-jdk8 #735

2016-07-05 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: fix generics in Windows.segments and Windows.until -- [...truncated 2374 lines...] kafka.api.ApiUtilsTest > testShortStringNonASCII PASSED kafka.api.ApiUtilsTest

Re: Can I get a code review on my PR for KAFKA-3809? "Auto-generate documentation for topic-level configuration"

2016-07-05 Thread James Cheng
Hi Kafka devs, Checking in again. Can I get a code review on this? Thanks, -James > On Jun 30, 2016, at 1:51 PM, James Cheng wrote: > > Hi Kafka devs, > > Can I get a code review on my pull request for > https://issues.apache.org/jira/browse/KAFKA-3809? > > The code

Build failed in Jenkins: kafka-trunk-jdk8 #734

2016-07-05 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: Auto-repartitioning for merge() and code simplifications [wangguoz] MINOR: Fix generics in KStream.groupBy(...) -- [...truncated 2043 lines...] at

Build failed in Jenkins: kafka-0.10.0-jdk7 #142

2016-07-05 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: fix generics in Windows.segments and Windows.until -- [...truncated 4015 lines...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[5] PASSED

Build failed in Jenkins: kafka-trunk-jdk7 #1404

2016-07-05 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: fix generics in Windows.segments and Windows.until -- [...truncated 3313 lines...] kafka.coordinator.GroupMetadataManagerTest > testStoreNonEmptyGroup PASSED

[jira] [Commented] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

2016-07-05 Thread Ishita Mandhan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363051#comment-15363051 ] Ishita Mandhan commented on KAFKA-3929: --- Are you thinking a similar implementation to KAFAK-3740 for

[jira] [Assigned] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

2016-07-05 Thread Ishita Mandhan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishita Mandhan reassigned KAFKA-3929: - Assignee: Ishita Mandhan > Add prefix for underlying clients configs in StreamConfig >

[jira] [Comment Edited] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

2016-07-05 Thread Ishita Mandhan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362993#comment-15362993 ] Ishita Mandhan edited comment on KAFKA-3876 at 7/5/16 6:48 PM: --- I saw the

[jira] [Commented] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

2016-07-05 Thread Ishita Mandhan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362993#comment-15362993 ] Ishita Mandhan commented on KAFKA-3876: --- I saw a similar one too -

[GitHub] kafka pull request #1587: MINOR: fix generics in Windows.segments and Window...

2016-07-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1587 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3876) Transient test failure: kafka.api.PlaintextConsumerTest.testExpandingTopicSubscriptions

2016-07-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362972#comment-15362972 ] Guozhang Wang commented on KAFKA-3876: -- I have seen a similar failure for a different test case of

[jira] [Created] (KAFKA-3929) Add prefix for underlying clients configs in StreamConfig

2016-07-05 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3929: Summary: Add prefix for underlying clients configs in StreamConfig Key: KAFKA-3929 URL: https://issues.apache.org/jira/browse/KAFKA-3929 Project: Kafka

[jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

2016-07-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362865#comment-15362865 ] Jun Rao commented on KAFKA-3919: [~BigAndy], thanks for the investigation and the additional information.

Build failed in Jenkins: kafka-trunk-jdk7 #1403

2016-07-05 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: Auto-repartitioning for merge() and code simplifications [wangguoz] MINOR: Fix generics in KStream.groupBy(...) -- [...truncated 3313 lines...]

[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created

2016-07-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362787#comment-15362787 ] ASF GitHub Bot commented on KAFKA-2857: --- Github user imandhan closed the pull request at:

[GitHub] kafka pull request #1548: KAFKA-2857 ConsumerGroupCommand throws GroupCoordi...

2016-07-05 Thread imandhan
Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1548 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2857) ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created

2016-07-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362788#comment-15362788 ] ASF GitHub Bot commented on KAFKA-2857: --- GitHub user imandhan reopened a pull request:

[GitHub] kafka pull request #1548: KAFKA-2857 ConsumerGroupCommand throws GroupCoordi...

2016-07-05 Thread imandhan
GitHub user imandhan reopened a pull request: https://github.com/apache/kafka/pull/1548 KAFKA-2857 ConsumerGroupCommand throws GroupCoordinatorNotAvailableException when describing a non-existent group before the offset topic is created Added a check to make sure different cases

[jira] [Commented] (KAFKA-3897) Improve Unit Tests for New Consumer's Regex Subscription

2016-07-05 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362786#comment-15362786 ] Vahid Hashemian commented on KAFKA-3897: An integration test was submitted as part of the patch

[jira] [Resolved] (KAFKA-3897) Improve Unit Tests for New Consumer's Regex Subscription

2016-07-05 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian resolved KAFKA-3897. Resolution: Duplicate > Improve Unit Tests for New Consumer's Regex Subscription >

[jira] [Resolved] (KAFKA-3928) Support a list of partition field names

2016-07-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3928. -- Resolution: Invalid > Support a list of partition field names >

[jira] [Commented] (KAFKA-3927) kafka broker config docs issue

2016-07-05 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362776#comment-15362776 ] Sriharsha Chintalapani commented on KAFKA-3927: --- [~guoxu1231] config/server.properties is an

[jira] [Commented] (KAFKA-3928) Support a list of partition field names

2016-07-05 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362773#comment-15362773 ] Ewen Cheslack-Postava commented on KAFKA-3928: -- [~striderapache] You probably want to file

[GitHub] kafka pull request #1584: MINOR: fix generics in KStream.groupBy(...)

2016-07-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1584 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1580: Hotfix: auto-repartitioning for merge() and code s...

2016-07-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1580 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3410) Unclean leader election and "Halting because log truncation is not allowed"

2016-07-05 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362701#comment-15362701 ] Maysam Yabandeh commented on KAFKA-3410: We ran into this problem again and this time bringing the

[jira] [Updated] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

2016-07-05 Thread Andy Coates (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates updated KAFKA-3919: --- Description: Hi All, I encountered an issue with Kafka following a power outage that saw a

[jira] [Updated] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

2016-07-05 Thread Andy Coates (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates updated KAFKA-3919: --- Description: Hi All, I encountered an issue with Kafka following a power outage that saw a

[jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

2016-07-05 Thread Andy Coates (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362604#comment-15362604 ] Andy Coates commented on KAFKA-3919: Hi [~junrao], thanks for taking the time to look at this. First

Kafka Streams - production use

2016-07-05 Thread Dirk Jeßberger
Hello, According to the FAQ (http://docs.confluent.io/3.0.0/streams/faq.html) it is not recommended to use Kafka Stream for production. When do you expect that it is ready for production use? Within the version 0.10.x.x or with later versions? Best regards Dirk Jeßberger -- Dirk Jeßberger

[jira] [Resolved] (KAFKA-3884) KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging

2016-07-05 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-3884. --- Resolution: Fixed Fixed by KAFKA-3842 > KGroupedStreamIntegrationTest.shouldAggregate seems to be

[jira] [Resolved] (KAFKA-3873) Gradle Test Executor non-zero exit code when running streams tests

2016-07-05 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-3873. --- Resolution: Duplicate Fix Version/s: 0.10.1.0 Fixed by KAFKA-3896 > Gradle Test Executor

[jira] [Assigned] (KAFKA-3873) Gradle Test Executor non-zero exit code when running streams tests

2016-07-05 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-3873: - Assignee: Damian Guy (was: Guozhang Wang) > Gradle Test Executor non-zero exit code when

[jira] [Commented] (KAFKA-3825) Allow users to specify different types of state stores in Streams DSL

2016-07-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362458#comment-15362458 ] ASF GitHub Bot commented on KAFKA-3825: --- GitHub user jeyhunkarimov opened a pull request:

[GitHub] kafka pull request #1588: KAFKA-3825: Allow users to specify different types...

2016-07-05 Thread jeyhunkarimov
GitHub user jeyhunkarimov opened a pull request: https://github.com/apache/kafka/pull/1588 KAFKA-3825: Allow users to specify different types of state stores in Streams DSL You can merge this pull request into a Git repository by running: $ git pull

[jira] [Updated] (KAFKA-3478) Finer Stream Flow Control

2016-07-05 Thread Michael Noll (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated KAFKA-3478: Description: Today we have a event-time based flow control mechanism in order to synchronize

[GitHub] kafka pull request #1587: MINOR: fix generics in Windows.segments and Window...

2016-07-05 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1587 MINOR: fix generics in Windows.segments and Windows.until `Windows.segments(...)` and `Windows.until(...)` currently aren't returning the `Window` with its type param `W`. This causes the generic type

[jira] [Issue Comment Deleted] (KAFKA-3047) Explicit offset assignment in Log.append can corrupt the log

2016-07-05 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3047: --- Comment: was deleted (was: Good to know, thanks for explanation!) > Explicit offset assignment in

[jira] [Issue Comment Deleted] (KAFKA-3047) Explicit offset assignment in Log.append can corrupt the log

2016-07-05 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3047: --- Comment: was deleted (was: Good to know, thanks for explanation!) > Explicit offset assignment in

[jira] [Commented] (KAFKA-3047) Explicit offset assignment in Log.append can corrupt the log

2016-07-05 Thread Joseph Francis (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362262#comment-15362262 ] Joseph Francis commented on KAFKA-3047: --- Hi [~guozhang], We were running kafka 0.9 in production

[GitHub] kafka pull request #1586: Kafka 3836: KStreamReduce and KTableReduce should ...

2016-07-05 Thread jeyhunkarimov
GitHub user jeyhunkarimov opened a pull request: https://github.com/apache/kafka/pull/1586 Kafka 3836: KStreamReduce and KTableReduce should not pass nulls to Deserializers You can merge this pull request into a Git repository by running: $ git pull