[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196574750 OK apparently the recent mima failures on the master branch is caused by the mqtt dependency not being in maven. We can either fix that with some build hack, or just

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196574785 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196555837 Thanks @rxin. Opened [SPARK-11806](https://issues.apache.org/jira/browse/SPARK-11806) to discuss this --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196553861 Can we have a JIRA ticket to discuss that? I am not sure this github pr is the place to discuss moving kafka out. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196553283 Hi @zsxwing, I think the discussion on supporting Kafka 0.9 should happen **if** we decide to keep Kafka in Spark itself. At this point, I think the piece

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196539603 @JoshRosen could you take a look at this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196537867 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196537861 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196537552 **[Test build #53095 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53095/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196489486 **[Test build #53095 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53095/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196487964 Merge conflict is probably my fault (I modified a file that this PR deleted). --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196485585 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196485589 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196485239 **[Test build #53078 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53078/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196412519 **[Test build #53078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53078/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196175509 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196175510 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196175359 **[Test build #53047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53047/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196141331 **[Test build #53047 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53047/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196115717 I agree with @ksakellis on this one. It would be great if we can pull Kafka out as well. I understand that there are a lot of users who might find it

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196111340 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196111343 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196111225 **[Test build #53043 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53043/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196087049 **[Test build #53043 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53043/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-196086887 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-195913903 **[Test build #53023 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53023/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-195913913 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-195913912 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-195911951 **[Test build #53023 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53023/consoleFull)** for PR 11672 at commit

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-12 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-195890923 @ksakellis Most of Streaming users use Kafka. It may affect a lot of people. I think it's better to discuss how to support Kafka 0.9

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-12 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-195889408 cc @rxin @tdas @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13843][Streaming]Remove streaming-flume...

2016-03-12 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11672#issuecomment-195889378 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this