[GitHub] spark pull request: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow se...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13146#issuecomment-219732714 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219739764 **[Test build #58691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58691/consoleFull)** for PR 12627 at commit

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-17 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/13139#discussion_r63520885 --- Diff: docs/ml-classification-regression.md --- @@ -374,6 +374,197 @@ regression model and extracting model summary statistics. +##

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219716908 **[Test build #58692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58692/consoleFull)** for PR 12627 at commit

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-219716919 **[Test build #58694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58694/consoleFull)** for PR 11157 at commit

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-219716906 **[Test build #58693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58693/consoleFull)** for PR 11996 at commit

[GitHub] spark pull request: [SPARK-15192][SQL] null check for SparkSession...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13008#issuecomment-219725454 **[Test build #58695 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58695/consoleFull)** for PR 13008 at commit

[GitHub] spark pull request: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow se...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13146#issuecomment-219732299 **[Test build #58690 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58690/consoleFull)** for PR 13146 at commit

[GitHub] spark pull request: [SPARK-15192][SQL] null check for SparkSession...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13008#issuecomment-219734722 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14434][ML]:User guide doc and examples ...

2016-05-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12788 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-14434][ML]:User guide doc and examples ...

2016-05-17 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/spark/pull/12788#issuecomment-219715492 Merged to master/branch-2.0. Thanks @sethah @zhengruifeng for the review! --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-17 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/13139#discussion_r63521258 --- Diff: docs/ml-classification-regression.md --- @@ -374,6 +374,197 @@ regression model and extracting model summary statistics. +##

[GitHub] spark pull request: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow se...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13146#issuecomment-219732719 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15186][ML][DOCS] Add user guide for gen...

2016-05-17 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/13139#discussion_r63522591 --- Diff: docs/ml-classification-regression.md --- @@ -374,6 +374,197 @@ regression model and extracting model summary statistics. +##

[GitHub] spark pull request: [SPARK-15192][SQL] null check for SparkSession...

2016-05-17 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/13008#issuecomment-219724329 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15308][SQL] RowEncoder should preserve ...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13090#issuecomment-219734892 **[Test build #58696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58696/consoleFull)** for PR 13090 at commit

[GitHub] spark pull request: [SPARK-15192][SQL] null check for SparkSession...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13008#issuecomment-219734720 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15192][SQL] null check for SparkSession...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13008#issuecomment-219734656 **[Test build #58695 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58695/consoleFull)** for PR 13008 at commit

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-17 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/12767#discussion_r63535245 --- Diff: python/pyspark/ml/tests.py --- @@ -594,17 +594,21 @@ def test_fit_minimize_metric(self): iee = InducedErrorEstimator()

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-17 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219740696 LGTM pending one small issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219740118 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219740121 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-219752958 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-219752590 **[Test build #58693 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58693/consoleFull)** for PR 11996 at commit

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219756807 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13148] [YARN] document zero-keytab Oozi...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11033#issuecomment-219756838 **[Test build #58699 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58699/consoleFull)** for PR 11033 at commit

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-219756624 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15333] [DOCS] Reorganize building-spark...

2016-05-17 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/13124#issuecomment-219758945 merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-219760515 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-17 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/13110#issuecomment-219762504 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/13057#discussion_r63550916 --- Diff: launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java --- @@ -334,6 +334,18 @@ static void addPermGenSizeOpt(List cmd) {

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13057#issuecomment-219766358 **[Test build #58703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58703/consoleFull)** for PR 13057 at commit

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219766323 **[Test build #58704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58704/consoleFull)** for PR 8559 at commit

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-219752963 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14346][SQL] Native SHOW CREATE TABLE fo...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13079#issuecomment-219754482 **[Test build #58697 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58697/consoleFull)** for PR 13079 at commit

[GitHub] spark pull request: [SPARK-15362] [ML] Make spark.ml KMeansModel l...

2016-05-17 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/13149#issuecomment-219754552 cc @jkbradley @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13148] [YARN] document zero-keytab Oozi...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11033#issuecomment-219756299 **[Test build #58699 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58699/consoleFull)** for PR 11033 at commit

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219756271 **[Test build #58692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58692/consoleFull)** for PR 12627 at commit

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219756305 **[Test build #58698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58698/consoleFull)** for PR 12767 at commit

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-219756618 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-219758052 **[Test build #58700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58700/consoleFull)** for PR 12957 at commit

[GitHub] spark pull request: [SPARK-13850] Force the sorter to Spill when n...

2016-05-17 Thread sitalkedia
Github user sitalkedia commented on the pull request: https://github.com/apache/spark/pull/13107#issuecomment-219762996 I am not 100% sure of the root cause, but I suspect this is happening when JVM is trying to allocate very large size buffer for pointer array. The issue might be

[GitHub] spark pull request: [SPARK-14346][SQL] Native SHOW CREATE TABLE fo...

2016-05-17 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13079#discussion_r63543604 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -626,40 +626,142 @@ case class ShowCreateTableCommand(table:

[GitHub] spark pull request: [SPARK-13148] [YARN] document zero-keytab Oozi...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11033#issuecomment-219756858 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13148] [YARN] document zero-keytab Oozi...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11033#issuecomment-219756852 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219756801 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219760247 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-219760363 **[Test build #58700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58700/consoleFull)** for PR 12957 at commit

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-17 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-219761399 Thanks for the reivew @MLnick. Instead of using `### Example`, I used `**Examples**` to be consistent with other sections in this page. I prefer to update the

[GitHub] spark pull request: [SPARK-15333] [DOCS] Reorganize building-spark...

2016-05-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13124 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13110 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-15340][SQL]Limit the size of the map us...

2016-05-17 Thread akohli
Github user akohli commented on the pull request: https://github.com/apache/spark/pull/13130#issuecomment-219750370 curious on a couple of things, firstly, you are using CacheBuilder with a cache size of 1000, is that sufficient? Wouldn't it be better to catch an exception or detect

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-17 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/13110#issuecomment-219754259 @wangmiao1981 @srowen Got it. Thanks for kindly remind! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-15263][Core] Make shuffle service dir c...

2016-05-17 Thread tejasapatil
Github user tejasapatil commented on the pull request: https://github.com/apache/spark/pull/13042#issuecomment-219761677 Ok. Changed TestShuffleDataContext to use the method in JavaUtil --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-15308][SQL] RowEncoder should preserve ...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13090#issuecomment-219764507 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15308][SQL] RowEncoder should preserve ...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13090#issuecomment-219764503 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15292] [ML] ML 2.0 QA: Scala APIs audit...

2016-05-17 Thread avulanov
Github user avulanov commented on the pull request: https://github.com/apache/spark/pull/13076#issuecomment-219745995 @yanboliang Sounds good! No one is working on that right now, it would be great if you could. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219760079 **[Test build #58698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58698/consoleFull)** for PR 12767 at commit

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13057#discussion_r63548281 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnable.scala --- @@ -211,15 +211,15 @@ private[yarn] class ExecutorRunnable(

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13057#discussion_r63548468 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala --- @@ -415,14 +417,12 @@ object YarnSparkHadoopUtil { * the

[GitHub] spark pull request: [SPARK-15263][Core] Make shuffle service dir c...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13042#issuecomment-219761359 **[Test build #58701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58701/consoleFull)** for PR 13042 at commit

[GitHub] spark pull request: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12394#issuecomment-219761427 **[Test build #58702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58702/consoleFull)** for PR 12394 at commit

[GitHub] spark pull request: [SPARK-15308][SQL] RowEncoder should preserve ...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13090#issuecomment-219764030 **[Test build #58696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58696/consoleFull)** for PR 13090 at commit

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/12627#issuecomment-219742751 I'm making a pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-4131] [SQL] Support INSERT OVERWRITE [L...

2016-05-17 Thread prongs
Github user prongs commented on the pull request: https://github.com/apache/spark/pull/13067#issuecomment-219742726 Any update on this? Seems like a useful feature. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-14346][SQL] Native SHOW CREATE TABLE fo...

2016-05-17 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13079#discussion_r63543727 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/ShowCreateTableSuite.scala --- @@ -116,24 +116,143 @@ class ShowCreateTableSuite extends

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-219756200 **[Test build #58694 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58694/consoleFull)** for PR 11157 at commit

[GitHub] spark pull request: [SPARK-15182] [ML] Copy MLlib doc to ML: ml.fe...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12957#issuecomment-219760507 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219760251 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13057#discussion_r63548041 --- Diff: launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java --- @@ -334,6 +334,18 @@ static void addPermGenSizeOpt(List cmd) {

[GitHub] spark pull request: [SPARK-15315][SQL] Adding error check to the C...

2016-05-17 Thread sureshthalamati
Github user sureshthalamati commented on a diff in the pull request: https://github.com/apache/spark/pull/13105#discussion_r63470142 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -172,4 +173,15 @@ class DefaultSource

[GitHub] spark pull request: [SPARK-15315][SQL] Adding error check to the C...

2016-05-17 Thread sureshthalamati
Github user sureshthalamati commented on the pull request: https://github.com/apache/spark/pull/13105#issuecomment-219630738 CC @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-15292] [ML] ML 2.0 QA: Scala APIs audit...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13076#issuecomment-219631618 **[Test build #58668 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58668/consoleFull)** for PR 13076 at commit

[GitHub] spark pull request: [SPARK-15292] [ML] ML 2.0 QA: Scala APIs audit...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13076#issuecomment-219631693 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15292] [ML] ML 2.0 QA: Scala APIs audit...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13076#issuecomment-219631695 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14906][ML] Copy linalg in PySpark to ne...

2016-05-17 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/13099#issuecomment-219632187 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14906][ML] Copy linalg in PySpark to ne...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13099#issuecomment-219632642 **[Test build #58671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58671/consoleFull)** for PR 13099 at commit

[GitHub] spark pull request: [SPARK-15358] [TEST] Rename HiveDDLCommandSuit...

2016-05-17 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/13142 [SPARK-15358] [TEST] Rename HiveDDLCommandSuite and DDLCommandSuite to HivePlanParserSuite and PlanParserSuite What changes were proposed in this pull request? After we moving

[GitHub] spark pull request: [SPARK-15358] [TEST] Rename HiveDDLCommandSuit...

2016-05-17 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/13142#issuecomment-219633544 CC @hvanhovell @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15358] [TEST] Rename HiveDDLCommandSuit...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13142#issuecomment-219634169 **[Test build #58672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58672/consoleFull)** for PR 13142 at commit

[GitHub] spark pull request: [SPARK-10216][SQL] Avoid creating empty files ...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12855#issuecomment-219635725 **[Test build #58666 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58666/consoleFull)** for PR 12855 at commit

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13057#discussion_r63559163 --- Diff: launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java --- @@ -334,6 +334,18 @@ static void addPermGenSizeOpt(List cmd) {

[GitHub] spark pull request: [SPARK-15214][SQL] Code-generation for Generat...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13065#issuecomment-219772495 **[Test build #58705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58705/consoleFull)** for PR 13065 at commit

[GitHub] spark pull request: [SPARK-15112][SQL] Allows query plan schema an...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12952#issuecomment-219778500 **[Test build #58706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58706/consoleFull)** for PR 12952 at commit

[GitHub] spark pull request: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12394#issuecomment-219775158 **[Test build #58702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58702/consoleFull)** for PR 12394 at commit

[GitHub] spark pull request: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12394#issuecomment-219775337 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14634][ML] Add BisectingKMeansSummary

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12394#issuecomment-219775333 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [DOC][MINOR] ml.feature Scala and Python API s...

2016-05-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13159#discussion_r63637481 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/VectorIndexer.scala --- @@ -240,7 +240,8 @@ object VectorIndexer extends

[GitHub] spark pull request: [DOC][MINOR] ml.feature Scala and Python API s...

2016-05-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13159#discussion_r63637490 --- Diff: python/pyspark/ml/feature.py --- @@ -2401,7 +2413,7 @@ class PCAModel(JavaModel, JavaMLReadable, JavaMLWritable): """ ..

[GitHub] spark pull request: [DOC][MINOR] ml.feature Scala and Python API s...

2016-05-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13159#discussion_r63637479 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/PCA.scala --- @@ -106,7 +107,7 @@ object PCA extends DefaultParamsReadable[PCA] {

[GitHub] spark pull request: [SPARK-15345][SQL][PYSPARK]. SparkSession's co...

2016-05-17 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13160#issuecomment-219909680 hm I don't think it is safe to create two contexts and stop the existing one. Maybe we can go ahead and change the sql conf setting, but not the spark context setting?

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/13057#discussion_r63560321 --- Diff: launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java --- @@ -334,6 +334,18 @@ static void addPermGenSizeOpt(List cmd) {

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12627#discussion_r63560959 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/DataFrameExample.scala --- @@ -24,7 +24,8 @@ import com.google.common.io.Files import

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-17 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-219782448 Ya. I was really flustrated, too. When you read the body of `checkEvaluationWithOptimization` function above, it has the following lines. It adds `Alias`.

[GitHub] spark pull request: [SPARK-15273] YarnSparkHadoopUtil#getOutOfMemo...

2016-05-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/13057#discussion_r63561739 --- Diff: launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java --- @@ -334,6 +334,18 @@ static void addPermGenSizeOpt(List cmd) {

[GitHub] spark pull request: [SPARK-15018][PYSPARK][ML] Fixed bug causing e...

2016-05-17 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/12790#discussion_r63561746 --- Diff: python/pyspark/ml/pipeline.py --- @@ -89,9 +87,9 @@ def setParams(self, stages=None): setParams(self, stages=None)

[GitHub] spark pull request: [SPARK-14615][ML] Use the new ML Vector and Ma...

2016-05-17 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/12627#discussion_r63561856 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LabeledPoint.scala --- @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-14346][SQL] Native SHOW CREATE TABLE fo...

2016-05-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13079#issuecomment-219784277 **[Test build #58697 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58697/consoleFull)** for PR 13079 at commit

[GitHub] spark pull request: [SPARK-14346][SQL] Native SHOW CREATE TABLE fo...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13079#issuecomment-219784648 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14346][SQL] Native SHOW CREATE TABLE fo...

2016-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13079#issuecomment-219784650 Test PASSed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   >