[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20339 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86431/ Test PASSed. ---

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20339 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20339 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20339 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86432/ Test PASSed. ---

[GitHub] spark issue #20342: [SPARK-23170] Dump the statistics of effective runs of a...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20342 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/72/ Test

[GitHub] spark pull request #20337: [SPARK-11630] [core] ClosureCleaner moved from wa...

2018-01-21 Thread rekhajoshm
GitHub user rekhajoshm opened a pull request: https://github.com/apache/spark/pull/20337 [SPARK-11630] [core] ClosureCleaner moved from warning to debug ## What changes were proposed in this pull request? ClosureCleaner moved from warning to debug ## How was this patch

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20339 **[Test build #86432 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86432/testReport)** for PR 20339 at commit

[GitHub] spark issue #20342: [SPARK-23170] Dump the statistics of effective runs of a...

2018-01-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20342 cc @maropu Since we do not have a UsageLog yet, this PR just dumps the statistics of effective runs. Based on this statistics, maybe you can improve the analyzer and optimizer rules to reduce

[GitHub] spark issue #20342: [SPARK-23170] Dump the statistics of effective runs of a...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20342 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20339 **[Test build #86431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86431/testReport)** for PR 20339 at commit

[GitHub] spark pull request #20342: [SPARK-23170] Dump the statistics of effective ru...

2018-01-21 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/20342 [SPARK-23170] Dump the statistics of effective runs of analyzer and optimizer rules ## What changes were proposed in this pull request? Dump the statistics of effective runs of

[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...

2018-01-21 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 re-ping folks ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20333: [SPARK-23087][SQL] CheckCartesianProduct too rest...

2018-01-21 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/20333#discussion_r162807813 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameJoinSuite.scala --- @@ -274,4 +274,18 @@ class DataFrameJoinSuite extends QueryTest with

[GitHub] spark issue #20341: [MINOR] [SQL] Test case cleanups for recent PRs

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20341 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86440/ Test PASSed. ---

[GitHub] spark issue #20341: [MINOR] [SQL] Test case cleanups for recent PRs

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20341 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20341: [MINOR] [SQL] Test case cleanups for recent PRs

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20341 **[Test build #86440 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86440/testReport)** for PR 20341 at commit

[GitHub] spark pull request #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCD...

2018-01-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20343#discussion_r162816645 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala --- @@ -339,6 +340,30 @@ class TPCDSQuerySuite extends BenchmarkQueryTest {

[GitHub] spark pull request #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCD...

2018-01-21 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20343#discussion_r162818134 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala --- @@ -339,6 +340,30 @@ class TPCDSQuerySuite extends BenchmarkQueryTest {

[GitHub] spark issue #17123: [SPARK-19781][ML] Handle NULLs as well as NaNs in Bucket...

2018-01-21 Thread crackcell
Github user crackcell commented on the issue: https://github.com/apache/spark/pull/17123 @WeichenXu123 sorry to miss the message for two days, I'm working on it. --- - To unsubscribe, e-mail:

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20343 **[Test build #86444 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86444/testReport)** for PR 20343 at commit

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86444/ Test FAILed. ---

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20339 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86430/ Test PASSed. ---

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20339 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20339 **[Test build #86430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86430/testReport)** for PR 20339 at commit

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20343 **[Test build #86444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86444/testReport)** for PR 20343 at commit

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/75/ Test

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20342 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20342 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86443/ Test PASSed. ---

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

2018-01-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20342 Sounds good to me. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCD...

2018-01-21 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/20343 [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQuerySuite ## What changes were proposed in this pull request? This pr added TPCDS v2.7 (latest) queries in `TPCDSQuerySuite` because the

[GitHub] spark pull request #20344: [MINOR] Typo fixes

2018-01-21 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/20344#discussion_r162821736 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/unresolved.scala --- @@ -199,7 +199,7 @@ case class UnresolvedGenerator(name:

[GitHub] spark pull request #20344: [MINOR] Typo fixes

2018-01-21 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/20344#discussion_r162821723 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1222,7 +1222,7 @@ class Analyzer(

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20342 **[Test build #86443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86443/testReport)** for PR 20342 at commit

[GitHub] spark pull request #20342: [SPARK-23170][SQL] Dump the statistics of effecti...

2018-01-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20342#discussion_r162814715 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/rules/QueryExecutionMetering.scala --- @@ -0,0 +1,90 @@ +/* + * Licensed to

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20345 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20345 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86449/ Test FAILed. ---

[GitHub] spark issue #20337: [SPARK-11630] [core] ClosureCleaner moved from warning t...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20337 **[Test build #86422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86422/testReport)** for PR 20337 at commit

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20345 **[Test build #86449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86449/testReport)** for PR 20345 at commit

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20345 **[Test build #86449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86449/testReport)** for PR 20345 at commit

[GitHub] spark issue #18906: [SPARK-21692][PYSPARK][SQL] Add nullability support to P...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18906 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20337: [SPARK-11630] [core] ClosureCleaner moved from warning t...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20337 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/61/ Test

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20345 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20345 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/79/ Test

[GitHub] spark issue #20337: [SPARK-11630] [core] ClosureCleaner moved from warning t...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20337 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18906: [SPARK-21692][PYSPARK][SQL] Add nullability support to P...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18906 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86445/ Test PASSed. ---

[GitHub] spark issue #20337: [SPARK-11630] [core] ClosureCleaner moved from warning t...

2018-01-21 Thread rekhajoshm
Github user rekhajoshm commented on the issue: https://github.com/apache/spark/pull/20337 thanks @srowen done. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

2018-01-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20339 This was tested: 1. https://github.com/apache/spark/pull/20339/commits/fe59c8aa2b6e66930ef1fade198d35eeb27210ef intentionally added some changes in `.lintr` and `lint-r` to see if

[GitHub] spark issue #20342: [SPARK-23170] Dump the statistics of effective runs of a...

2018-01-21 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/20342 nit: How about using a format below? ( a pair of effective/total one): ``` Rule Effective Time/Total Time Effective Runs/Total Runs

[GitHub] spark issue #20344: [MINOR] Typo fixes

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20344 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86447/ Test FAILed. ---

[GitHub] spark pull request #19340: [SPARK-22119][ML] Add cosine distance to KMeans

2018-01-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19340 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #18906: [SPARK-21692][PYSPARK][SQL] Add nullability support to P...

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18906 **[Test build #86445 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86445/testReport)** for PR 18906 at commit

[GitHub] spark issue #20344: [MINOR] Typo fixes

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20344 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20344: [MINOR] Typo fixes

2018-01-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20344 **[Test build #86447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86447/testReport)** for PR 20344 at commit

[GitHub] spark issue #19340: [SPARK-22119][ML] Add cosine distance to KMeans

2018-01-21 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19340 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add schema evolution test suite...

2018-01-21 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20208 Hi, @gatorsmile , @cloud-fan , @sameeragarwal , @HyukjinKwon . The PR is ready for review again. Spark commit log seems to be a little quiet since yesterday. Could you squeeze some

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86448/ Test FAILed. ---

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

2018-01-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20345: [SPARK-23172][SQL] Respect Project nodes in Reord...

2018-01-21 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/20345 [SPARK-23172][SQL] Respect Project nodes in ReorderJoin ## What changes were proposed in this pull request? The current `ReorderJoin` optimizer rule cannot flatten a pattern `Join -> Project ->

<    1   2   3   4