[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98252751 [Test build #756 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/756/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98252489 Running this couple of times to test for flakiness. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98262782 [Test build #757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/757/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98271925 Great! Merging this! Thanks @koeninger @helena ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98260031 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98260028 [Test build #31608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31608/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98262541 [Test build #756 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/756/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98260030 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4537 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98252934 [Test build #757 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/757/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98139798 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98139779 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98159843 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98159845 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98159797 [Test build #31555 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31555/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98142732 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98142712 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98142793 [Test build #31558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31558/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98164584 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98164541 [Test build #31558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31558/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98164590 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98227329 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98227259 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98228003 At any rate, I tested it out locally against 0.8.1.1 server install, with the IdempotentExample job from my blogpost. Seemed to work ok. --- If your project is set

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98139964 [Test build #31555 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31555/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98212160 scalastyle passes locally for me... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98227657 [Test build #31602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31602/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29523418 --- Diff: python/pyspark/streaming/tests.py --- @@ -616,6 +615,7 @@ def test_kafka_stream(self): self._kafkaTestUtils.createTopic(topic)

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98210270 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29523269 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -53,14 +53,16 @@ class KafkaRDDSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29523447 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -53,14 +53,16 @@ class KafkaRDDSuite extends FunSuite

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98210246 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98210547 [Test build #31587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31587/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98210874 [Test build #31587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31587/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98210880 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98210879 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29533115 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -220,12 +226,22 @@ class KafkaCluster(val kafkaParams:

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29533137 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaTestUtils.scala --- @@ -227,10 +229,34 @@ private class KafkaTestUtils extends

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29533552 --- Diff: python/pyspark/streaming/tests.py --- @@ -659,7 +659,7 @@ def test_kafka_rdd(self): self._kafkaTestUtils.createTopic(topic)

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29533746 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaTestUtils.scala --- @@ -227,10 +229,34 @@ private class KafkaTestUtils extends

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29532960 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaTestUtils.scala --- @@ -227,10 +229,34 @@ private class KafkaTestUtils extends

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29533586 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -73,27 +74,37 @@ class KafkaRDDSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29533046 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -37,6 +38,11 @@ private[spark] class KafkaCluster(val

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98246269 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98246330 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98246878 [Test build #31608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31608/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98251856 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98251843 [Test build #31602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31602/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98251854 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97899607 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97899630 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97899776 [Test build #31435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31435/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97953966 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97963916 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97963915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97963902 **[Test build #31435 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31435/consoleFull)** for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97953987 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97954389 [Test build #31448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31448/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97984827 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97984826 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-98038141 Hey @koeninger , here is a trick I am trying out to to do targeted debugging in Jenkins. I disabled all the other tests and running only streaming tests. The whole thing

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97984810 [Test build #31448 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31448/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29319824 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -266,24 +283,39 @@ class KafkaCluster(val kafkaParams:

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97362236 Now that the Kafka Direct Python API has been merged, I think its safe to pull this in. Overall it looks good. I had a few minor comments on the code. However I do have a

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29319736 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -220,12 +220,22 @@ class KafkaCluster(val kafkaParams:

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29319753 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -236,9 +246,16 @@ class KafkaCluster(val kafkaParams:

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97313331 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97365189 Also it would be great if we can merge this by this weekend. It seems mostly ready thanks to your continuous rebasing. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29320026 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -53,14 +53,16 @@ class KafkaRDDSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29319699 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -220,12 +220,22 @@ class KafkaCluster(val kafkaParams:

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97313321 **[Test build #31220 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31220/consoleFull)** for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29319994 --- Diff: external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala --- @@ -53,14 +53,16 @@ class KafkaRDDSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29319967 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaTestUtils.scala --- @@ -227,10 +229,33 @@ private class KafkaTestUtils extends

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97313332 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97484571 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97503190 [Test build #31293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31293/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97502625 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97502682 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97484557 [Test build #31288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31288/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97484573 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97547514 At this point, it looks like the java and scala tests are passing, but the python tests are timing out. Console output looks like

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97558005 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97558003 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97557994 **[Test build #31293 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31293/consoleFull)** for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97579285 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97577969 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97577915 Is it timing out locally as well? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97579232 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97581230 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97581186 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97581358 [Test build #31327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31327/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97579891 [Test build #31325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31325/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97589574 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97589653 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97589820 [Test build #31331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31331/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97580085 No, it works fine locally: Running PySpark tests. Output is in python/unit-tests.log. Testing with Python version: Python 2.6.6 Run

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97585868 Actually this branch has merge conflicts with the master. May be that is the reason? Please update your branch and test again. Also I saw python streaming tests

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97609655 That's a whole lot of failures. I am not sure what happened. Running the test once again. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4537#issuecomment-97609722 [Test build #734 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/734/consoleFull) for PR 4537 at commit

[GitHub] spark pull request: [SPARK-2808][Streaming][Kafka] update kafka to...

2015-04-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/4537#discussion_r29389835 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -220,12 +220,22 @@ class KafkaCluster(val kafkaParams:

  1   2   >