[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14637 **[Test build #64299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64299/consoleFull)** for PR 14637 at commit

[GitHub] spark issue #13440: [SPARK-15699] [ML] Implement a Chi-Squared test statisti...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13440 **[Test build #64309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64309/consoleFull)** for PR 13440 at commit

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64306/ Test PASSed. ---

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-23 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14763 LGTM - merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #64306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64306/consoleFull)** for PR 14725 at commit

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2016-08-23 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r75944093 --- Diff: docs/streaming-programming-guide.md --- @@ -644,13 +644,39 @@ methods for creating DStreams from files as input sources.

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2016-08-23 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r75944182 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala --- @@ -196,29 +192,33 @@ class FileInputDStream[K, V, F <:

[GitHub] spark issue #14768: [MINOR][BUILD] Fix Java CheckStyle Error

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14768 **[Test build #64308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64308/consoleFull)** for PR 14768 at commit

[GitHub] spark pull request #14772: [Trivial] Typo Fix

2016-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14772 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14772: [Trivial] Typo Fix

2016-08-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14772 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14768: [MINOR][BUILD] Fix Java CheckStyle Error

2016-08-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14768 Jenkins add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14770: [MINOR][DOC] Use standard quotes instead of "curl...

2016-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14770 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14768: [MINOR][BUILD] Fix Java CheckStyle Error

2016-08-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14768 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14775: [SPARK-16581][SPARKR] Make JVM backend calling functions...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14775 **[Test build #64307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64307/consoleFull)** for PR 14775 at commit

[GitHub] spark issue #14775: [SPARK-16581][SPARKR] Make JVM backend calling functions...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64307/ Test PASSed. ---

[GitHub] spark issue #14775: [SPARK-16581][SPARKR] Make JVM backend calling functions...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14775 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14770: [MINOR][DOC] Use standard quotes instead of "curly quote...

2016-08-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14770 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14763 **[Test build #64295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64295/consoleFull)** for PR 14763 at commit

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-23 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14763 Good for you! :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-23 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14763 Thanks @dongjoon-hyun for the pointer; I've regenerated the answer set and all tests are now passing. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14763 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14763 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64295/ Test PASSed. ---

[GitHub] spark pull request #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14637#discussion_r75939624 --- Diff: mesos/pom.xml --- @@ -0,0 +1,109 @@ + + +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;

[GitHub] spark issue #14775: [SPARK-16581][SPARKR] Make JVM backend calling functions...

2016-08-23 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14775 cc @felixcheung @olarayej --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14775: [SPARK-16581][SPARKR] Make JVM backend calling functions...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14775 **[Test build #64307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64307/consoleFull)** for PR 14775 at commit

[GitHub] spark pull request #14775: [SPARK-16581][SPARKR] Make JVM backend calling fu...

2016-08-23 Thread shivaram
GitHub user shivaram opened a pull request: https://github.com/apache/spark/pull/14775 [SPARK-16581][SPARKR] Make JVM backend calling functions public ## What changes were proposed in this pull request? This change exposes a public API in SparkR to create objects, call

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64305/ Test PASSed. ---

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #64305 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64305/consoleFull)** for PR 14725 at commit

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #64306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64306/consoleFull)** for PR 14725 at commit

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-08-23 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14014 @deepakmk9 For now, you need to rename the field. As long as it is not called `element`, it should work. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14731 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #64305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64305/consoleFull)** for PR 14725 at commit

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14731 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64296/ Test PASSed. ---

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14731 **[Test build #64296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64296/consoleFull)** for PR 14731 at commit

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14725 Thanks @holdenk. I have an example usage for primitive arrays in the PR description, let me know if that is not clear enough to show how this change useful. I also added usage for

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64304/ Test FAILed. ---

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #64304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64304/consoleFull)** for PR 14725 at commit

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #64304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64304/consoleFull)** for PR 14725 at commit

[GitHub] spark pull request #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14637#discussion_r75930641 --- Diff: mesos/pom.xml --- @@ -0,0 +1,109 @@ + + +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-23 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/8880 @rxin there's no top-level package being created anymore (after the remaining test code is moved). --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14637#discussion_r75929868 --- Diff: mesos/pom.xml --- @@ -0,0 +1,109 @@ + + +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;

[GitHub] spark issue #14741: [SPARK-6832][SPARKR][WIP]Handle partial reads in SparkR

2016-08-23 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14741 The value of `what` shouldn't change if we are retrying the read. If it was `integer` it should remain `integer`. There is a corner case of what happens if we say read the first byte of the

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14637 **[Test build #64303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64303/consoleFull)** for PR 14637 at commit

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-23 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/8880 Can we avoid creating another top level package? We have a lot of those already. Perhaps just put it into one of the existing one. (network.crypto or storage.crypto). --- If your project is set up

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14637 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14637 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64302/ Test FAILed. ---

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14637 **[Test build #64302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64302/consoleFull)** for PR 14637 at commit

[GitHub] spark pull request #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14637#discussion_r75927255 --- Diff: mesos/pom.xml --- @@ -0,0 +1,109 @@ + + +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14637 **[Test build #64302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64302/consoleFull)** for PR 14637 at commit

[GitHub] spark pull request #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14637#discussion_r75926093 --- Diff: mesos/pom.xml --- @@ -0,0 +1,109 @@ + + +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14637 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64301/ Test FAILed. ---

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14637 **[Test build #64301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64301/consoleFull)** for PR 14637 at commit

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14637 **[Test build #64301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64301/consoleFull)** for PR 14637 at commit

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14637 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14613 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64297/ Test PASSed. ---

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14613 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14613 **[Test build #64297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64297/consoleFull)** for PR 14613 at commit

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64293/ Test PASSed. ---

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #64293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64293/consoleFull)** for PR 14447 at commit

[GitHub] spark issue #14768: [MINOR][BUILD] Fix Java CheckStyle Error

2016-08-23 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14768 @srowen Thanks for the review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14774: [SparkR][BUILD]:ignore cran-check.out under R folder

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14774 **[Test build #64300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64300/consoleFull)** for PR 14774 at commit

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14524 I probably need some oversight here since I'm not familiar with pyspark in this regard, but it looks like PythonMLLibAPI treated seeds a little differently in a few cases which meant they couldn't

[GitHub] spark pull request #14767: [SparkR][Minor] Remove reference link for common ...

2016-08-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14767 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14637 Yes to all three of those. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14774: [SparkR][BUILD]:ignore cran-check.out under R fol...

2016-08-23 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/14774 [SparkR][BUILD]:ignore cran-check.out under R folder ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) R add cran check which will

[GitHub] spark issue #14767: [SparkR][Minor] Remove reference link for common Windows...

2016-08-23 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14767 merged to master and branch-2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-23 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14447 I did test locally this time, thanks Felix --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-23 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14447 btw, this has info on document generation so you could test this out locally: https://github.com/apache/spark/blob/master/R/DOCUMENTATION.md --- If your project is set up for it, you can

[GitHub] spark issue #14637: [SPARK-16967] move mesos to module

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14637 **[Test build #64299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64299/consoleFull)** for PR 14637 at commit

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-23 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75921988 --- Diff: R/pkg/R/sparkR.R --- @@ -550,3 +532,27 @@ processSparkPackages <- function(packages) { } splittedPackages } + +#

[GitHub] spark issue #14637: [WIP] [SPARK-16967] move mesos to module

2016-08-23 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14637 @srowen OK, added the profile to: - .travis.yml - release-build.sh - lint-java - mima - scalastyle What about dev/test-dependencies.sh. Also, I added mesos to

[GitHub] spark pull request #14761: [SparkR][Minor] Add installation message for remo...

2016-08-23 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14761#discussion_r75921626 --- Diff: R/pkg/R/sparkR.R --- @@ -550,3 +532,27 @@ processSparkPackages <- function(packages) { } splittedPackages } + +#

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-08-23 Thread deepakmk9
Github user deepakmk9 commented on the issue: https://github.com/apache/spark/pull/14014 IS there any way to make this work in Spark 1.6.2 , I ma facing the same issue --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-23 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14524 Just to clarify what we are talking about on the Python side, pyspark-mllib given `seed=None` will generate a random seed based on system time, while pyspark-ml given `seed=None` will use a

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-08-23 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/14731 1. updated the code to bypass the glob routine when there is no wildcard; this bypasses something fairly inefficient. 1. reporting FNFE on that base dir differently; skip the stack trace

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64298/ Test FAILed. ---

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12004 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12004 **[Test build #64298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64298/consoleFull)** for PR 12004 at commit

[GitHub] spark issue #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work

2016-08-23 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/14433 @felixcheung, Any comments on the new change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-23 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/14613 @felixcheung I changed the tests according to your comments. For the `specialtypeshandle`, it should return the key in `PRIMITIVE_TYPES` based on the original backend return type. In the

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12004 **[Test build #64298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64298/consoleFull)** for PR 12004 at commit

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14613 **[Test build #64297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64297/consoleFull)** for PR 14613 at commit

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14731 **[Test build #64296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64296/consoleFull)** for PR 14731 at commit

[GitHub] spark issue #14741: [SPARK-6832][SPARKR][WIP]Handle partial reads in SparkR

2016-08-23 Thread krishnakalyan3
Github user krishnakalyan3 commented on the issue: https://github.com/apache/spark/pull/14741 @shivaram @davies - Signature of the readBin function is `readBin(con, what, n, as.integer(size), endian)` What should the value of `what` be when an the process is interrupted

[GitHub] spark issue #14763: [SPARK-17194] Use single quotes when generating SQL for ...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14763 **[Test build #64295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64295/consoleFull)** for PR 14763 at commit

[GitHub] spark issue #14761: [SparkR][Minor] Add installation message for remote mast...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14761 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64294/ Test FAILed. ---

[GitHub] spark issue #14761: [SparkR][Minor] Add installation message for remote mast...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14761 **[Test build #64294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64294/consoleFull)** for PR 14761 at commit

[GitHub] spark issue #14761: [SparkR][Minor] Add installation message for remote mast...

2016-08-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14761 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14761: [SparkR][Minor] Add installation message for remote mast...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14761 **[Test build #64294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64294/consoleFull)** for PR 14761 at commit

[GitHub] spark issue #14768: [MINOR][BUILD] Fix Java CheckStyle Error

2016-08-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14768 The first one seems fine to me. LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #64293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64293/consoleFull)** for PR 14447 at commit

[GitHub] spark issue #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-23 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/8880 Some small things left to take care of, otherwise looking good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14768: [MINOR][BUILD] Fix Java CheckStyle Error

2016-08-23 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14768 For this piece of code: ![image](https://cloud.githubusercontent.com/assets/8546874/17901844/c4dae970-6919-11e6-8361-a73321a19f86.png) I think lines in` if `and `else` blocks should be at

[GitHub] spark pull request #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r75913749 --- Diff: core/src/test/scala/org/apache/spark/crypto/ShuffleEncryptionSuite.scala --- @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #8880: [SPARK-5682][Core] Add encrypted shuffle in spark

2016-08-23 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r75913315 --- Diff: core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala --- @@ -143,7 +179,25 @@ private[spark] class

[GitHub] spark issue #14766: [SPARK-17197] [ML] [PySpark] PySpark LiR/LoR supports tr...

2016-08-23 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/14766 LGTM. Since I mostly work on scala part, wait for other vote. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

<    1   2   3   4   5   6   >