[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

2016-09-18 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15131 @HyukjinKwon @shivaram Thanks for your comments. I will fix the URI issue in this PR as you suggested. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65564/consoleFull)** for PR 15131 at commit

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65553 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65553/consoleFull)** for PR 14971 at commit

[GitHub] spark issue #15136: [SPARK-17581] [SQL] Invalidate Statistics After Some ALT...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15136 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65554/ Test PASSed. ---

[GitHub] spark issue #15135: [pyspark][group]pyspark GroupedData can't apply agg func...

2016-09-18 Thread citoubest
Github user citoubest commented on the issue: https://github.com/apache/spark/pull/15135 @petermaxlee In my opinion, list comprehension can reduce code length to some extent. It's better if the agg method can support the easy way in api level. --- If your project is set up

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79302302 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1426,41 +1426,53 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15137 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65557/ Test PASSed. ---

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15137 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15137 **[Test build #65557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65557/consoleFull)** for PR 15137 at commit

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79302542 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1426,41 +1426,53 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65562/ Test PASSed. ---

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14597 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65563/ Test PASSed. ---

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65564/consoleFull)** for PR 15131 at commit

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65564/ Test PASSed. ---

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15131 Could you explain the goal of this a bit more? It looks like: 1. these are not exported functions from the R package 2. these are not documented (`@noRd`) in generated API doc 3.

[GitHub] spark pull request #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of...

2016-09-18 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15139#discussion_r79303509 --- Diff: R/pkg/inst/tests/testthat/test_mllib.R --- @@ -761,27 +761,13 @@ test_that("spark.kstest", { expect_equal(stats$p.value, rStats$p.value,

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15134 **[Test build #65567 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65567/consoleFull)** for PR 15134 at commit

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15134 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65567/ Test PASSed. ---

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15134 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15134 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65550/ Test FAILed. ---

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15134 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15127 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15137: [SPARK-17512][Core] Avoid formatting to python pa...

2016-09-18 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/15137 [SPARK-17512][Core] Avoid formatting to python path for yarn and mesos cluster mode ## What changes were proposed in this pull request? Yarn and mesos cluster mode support remote python

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #65562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65562/consoleFull)** for PR 15024 at commit

[GitHub] spark pull request #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated S...

2016-09-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14971#discussion_r79300109 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -259,6 +260,230 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark issue #15082: [SPARK-17528][SQL] MutableProjection should not cache co...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15082 **[Test build #65561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65561/consoleFull)** for PR 15082 at commit

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/15134 Well, I understand your meaning, I'm guessing most of the users they're using SparkSubmit or SparkLaunch to start application and in that case app name should be well figured out even if not set

[GitHub] spark issue #15136: [SPARK-17581] [SQL] Invalidate Statistics After Some ALT...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15136 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15136: [SPARK-17581] [SQL] Invalidate Statistics After Some ALT...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15136 **[Test build #65554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65554/consoleFull)** for PR 15136 at commit

[GitHub] spark pull request #15138: [SPARK-17583][SQL] Remove unused rowSeparator var...

2016-09-18 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/15138 [SPARK-17583][SQL] Remove unused rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV ## What changes were proposed in this pull request?

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15099 **[Test build #65556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65556/consoleFull)** for PR 15099 at commit

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65556/ Test PASSed. ---

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15099 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65570/consoleFull)** for PR 15131 at commit

[GitHub] spark issue #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmog...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15139 **[Test build #65572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65572/consoleFull)** for PR 15139 at commit

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15051 **[Test build #65573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65573/consoleFull)** for PR 15051 at commit

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15131 I just took a look. The problematic code is here, [SparkContext.scala#L1429](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L1429).

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widened encoder for DataFram...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15072 Hi @hvanhovell, What do you think about this? Would this one be like the one we might merge if we can't find any better way until the next release? or it seems too hacky? I am being

[GitHub] spark issue #15097: [SPARK-17540][SparkR][Spark Core] fix SparkR array serde...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15097 +1 for adding tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15099: [SPARK-17541][SQL] fix some DDL bugs about table ...

2016-09-18 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15099#discussion_r79299637 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala --- @@ -284,8 +284,12 @@ class CatalogImpl(sparkSession: SparkSession)

[GitHub] spark pull request #15073: [SPARK-17518] [SQL] Block Users to Specify the In...

2016-09-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15073 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

2016-09-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15073 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-09-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15024 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15082: [SPARK-17528][SQL] MutableProjection should not cache co...

2016-09-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15082 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15099 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15099 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65560/ Test FAILed. ---

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15099 **[Test build #65560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65560/consoleFull)** for PR 15099 at commit

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14597 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65559/ Test FAILed. ---

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14597 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14597 **[Test build #65559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65559/consoleFull)** for PR 14597 at commit

[GitHub] spark issue #15082: [SPARK-17528][SQL] MutableProjection should not cache co...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15082 **[Test build #65561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65561/consoleFull)** for PR 15082 at commit

[GitHub] spark issue #15082: [SPARK-17528][SQL] MutableProjection should not cache co...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15082 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15082: [SPARK-17528][SQL] MutableProjection should not cache co...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15082 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65561/ Test PASSed. ---

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #65562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65562/consoleFull)** for PR 15024 at commit

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14597 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14597 **[Test build #65563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65563/consoleFull)** for PR 14597 at commit

[GitHub] spark issue #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmog...

2016-09-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15139 @junyangq --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15131 @yanboliang Most methods in context.R are not exported (except `spark.lapply` and `setLogLevel`) and therefore they are not publically accessible from the R package. Does this work

[GitHub] spark pull request #15051: [SPARK-17499][SparkR][ML][MLLib] make the default...

2016-09-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r79303689 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,14 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65570/ Test PASSed. ---

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

2016-09-18 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15051 @felixcheung Now I update the scala-side wapper args type as following: layers: Array[Int], seed: String and the seed default value currently I use "", not NULL, because

[GitHub] spark issue #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmog...

2016-09-18 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15139 @felixcheung I agree with you and added test to check the R print method is doing sth. Any more comments, feel free to let me know. Thanks! --- If your project is set up for it, you can reply

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15127 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65549/ Test PASSed. ---

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15134 **[Test build #65550 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65550/consoleFull)** for PR 15134 at commit

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15134 **[Test build #6 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/6/consoleFull)** for PR 15134 at commit

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15099 **[Test build #65556 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65556/consoleFull)** for PR 15099 at commit

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15051 **[Test build #65558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65558/consoleFull)** for PR 15051 at commit

[GitHub] spark pull request #15051: [SPARK-17499][SparkR][ML][MLLib] make the default...

2016-09-18 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r79299954 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,14 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14597 **[Test build #65559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65559/consoleFull)** for PR 14597 at commit

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65553/ Test FAILed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15099 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15051 **[Test build #65558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65558/consoleFull)** for PR 15051 at commit

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15051 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15131 Hm.. It seems it does not trigger the build because the last change does not include R changes. I manually ran this after checking out your PR in my forked repo -

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15099 **[Test build #65565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65565/consoleFull)** for PR 15099 at commit

[GitHub] spark pull request #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of...

2016-09-18 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/15139 [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmogorov-Smirnov test summary ## What changes were proposed in this pull request? #14881 added Kolmogorov-Smirnov Test wrapper to SparkR.

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15099 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15099 **[Test build #65565 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65565/consoleFull)** for PR 15099 at commit

[GitHub] spark issue #15138: [SPARK-17583][SQL] Remove unused rowSeparator variable a...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15138 **[Test build #65569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65569/consoleFull)** for PR 15138 at commit

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15131 (FYI, I ran another build - https://ci.appveyor.com/project/HyukjinKwon/spark/build/103-15131-pr) --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmog...

2016-09-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15139 I agree we don't need to check the full output but we should check the R print method is doing something - without a test, we have it broken before. Generally we should have a test at

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65571/consoleFull)** for PR 15131 at commit

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15127 **[Test build #65549 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65549/consoleFull)** for PR 15127 at commit

[GitHub] spark issue #15136: [SPARK-17581] [SQL] Invalidate Statistics After Some ALT...

2016-09-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15136 is `SET LOCATION` the only command that can invalidate the statistics? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14597 **[Test build #65563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65563/consoleFull)** for PR 14597 at commit

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15051 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65558/ Test PASSed. ---

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15134 **[Test build #65567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65567/consoleFull)** for PR 15134 at commit

[GitHub] spark issue #15138: [SPARK-17583][SQL] Remove unused rowSeparator variable a...

2016-09-18 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15138 Do you mind if I ask to review this @holdenk and @srowen ? I remember bumping up the version was reviewed by you both. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmog...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15139 **[Test build #65568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65568/consoleFull)** for PR 15139 at commit

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/15099 @cloud-fan, since this bug fix is important that other patches depends on this, I am +1 on current approach. Maybe in future, we should consider making TableIdentifier a unique identifier for all

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79303139 --- Diff: R/pkg/R/context.R --- @@ -225,6 +225,42 @@ setCheckpointDir <- function(sc, dirName) { invisible(callJMethod(sc, "setCheckpointDir",

[GitHub] spark issue #15099: [SPARK-17541][SQL] fix some DDL bugs about table managem...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65565/ Test PASSed. ---

[GitHub] spark pull request #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of...

2016-09-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15139#discussion_r79303313 --- Diff: R/pkg/inst/tests/testthat/test_mllib.R --- @@ -761,27 +761,13 @@ test_that("spark.kstest", { expect_equal(stats$p.value, rStats$p.value,

[GitHub] spark issue #15138: [SPARK-17583][SQL] Remove unused rowSeparator variable a...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15138 **[Test build #65566 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65566/consoleFull)** for PR 15138 at commit

[GitHub] spark issue #15138: [SPARK-17583][SQL] Remove unused rowSeparator variable a...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15138 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15138: [SPARK-17583][SQL] Remove unused rowSeparator variable a...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15138 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65566/ Test FAILed. ---

  1   2   3   4   >