[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-09-14 Thread maver1ck
Github user maver1ck commented on the issue: https://github.com/apache/spark/pull/14340 @rxin, Production streaming jobs can be written in Python and me and my company are example. I wrote a little bit more in Jira. I think it's better place for discussion.

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-29 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14340 Thanks a lot @rxin for your comments, let me close it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14340 So I would like to -1 this patch. I think it's been a mistake to support dstream in Python -- yes it satisfies a checkbox and Spark could claim there's support for streaming in Python. However, the

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/14340 @jerryshao agreed that this is probably as good as possible for the Python api and the limitations make sense Generally LGTM, the only remaining comments I had were minor wording things.

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62877/ Test PASSed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62877/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62877/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62871/ Test FAILed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62871 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62871/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62871/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14340 Thanks a lot @koeninger for your review, I think it is not so flexible for Python API to achieve same functionalities as Java/Scala APIs, especially for things like extended class like

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62870/ Test FAILed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62870 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62870/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62870/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/14340 In terms of feature parity, are we OK with telling python users they are out of luck if they need something not covered by Assign / Subscribe / SubscribePattern? For scala / java users they can

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62822/ Test PASSed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62822/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62822/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62807 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62807/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62807/ Test FAILed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62807 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62807/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14340 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62795 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62795/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62795/ Test FAILed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62795 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62795/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62784/ Test FAILed. ---

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62784 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62784/consoleFull)** for PR 14340 at commit

[GitHub] spark issue #14340: [SPARK-16534][Streaming][Kafka] Add Python API support f...

2016-07-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14340 **[Test build #62784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62784/consoleFull)** for PR 14340 at commit