[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165578299 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see #

[GitHub] spark pull request #20479: [SPARK-23305][SQL][TEST] Add `spark.sql.files.ign...

2018-02-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20479#discussion_r165578302 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala --- @@ -92,4 +96,39 @@ class FileBasedDataSourceSuite extends Qu

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165578412 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see #

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/518/ Test

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20446 **[Test build #86980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86980/testReport)** for PR 20446 at commit [`f02172f`](https://github.com/apache/spark/commit/f0

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20485 **[Test build #86979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86979/testReport)** for PR 20485 at commit [`75950a1`](https://github.com/apache/spark/commit/75

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/519/ Test

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/520/ Test

[GitHub] spark pull request #20485: [SPARK-23315][SQL] failed to get output from cano...

2018-02-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20485#discussion_r165578555 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/PushDownOperatorsToDataSource.scala --- @@ -99,15 +100,22 @@ object PushD

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Add `spark.sql.files.ignoreMiss...

2018-02-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20479 For test-only PRs, we still can merge it to 2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additio

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20484 **[Test build #86978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86978/testReport)** for PR 20484 at commit [`7b3b0a4`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20484 **[Test build #86977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86977/testReport)** for PR 20484 at commit [`fc5b395`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20483 **[Test build #86966 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86966/testReport)** for PR 20483 at commit [`376c855`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20483 **[Test build #86967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86967/testReport)** for PR 20483 at commit [`53d3259`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Add `spark.sql.files.ignoreMiss...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20479 **[Test build #86976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86976/testReport)** for PR 20479 at commit [`4512d72`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #20477: [SPARK-23303][SQL] improve the explain result for data s...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20477 **[Test build #86974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86974/testReport)** for PR 20477 at commit [`4ca2c40`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86967/ Test FAILed. ---

[GitHub] spark issue #20477: [SPARK-23303][SQL] improve the explain result for data s...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20477 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86974/ Test FAILed. ---

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Add `spark.sql.files.ignoreMiss...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20479 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86977/ Test FAILed. ---

[GitHub] spark issue #20482: [SPARK-23311][SQL][TEST]add FilterFunction test case for...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20482 **[Test build #86964 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86964/testReport)** for PR 20482 at commit [`f45ef79`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86978/ Test FAILed. ---

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86966/ Test FAILed. ---

[GitHub] spark issue #20477: [SPARK-23303][SQL] improve the explain result for data s...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20477 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Add `spark.sql.files.ignoreMiss...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20479 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86976/ Test FAILed. ---

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20482: [SPARK-23311][SQL][TEST]add FilterFunction test case for...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20482 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20482: [SPARK-23311][SQL][TEST]add FilterFunction test case for...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20482 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86964/ Test FAILed. ---

[GitHub] spark pull request #20479: [SPARK-23305][SQL][TEST] Add `spark.sql.files.ign...

2018-02-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20479#discussion_r165579611 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala --- @@ -92,4 +96,37 @@ class FileBasedDataSourceSuite extends Qu

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Test `spark.sql.files.ignoreMis...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20479 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165579945 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see ## Up

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Test `spark.sql.files.ignoreMis...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20479 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/521/ Test

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Test `spark.sql.files.ignoreMis...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20479 **[Test build #86982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86982/testReport)** for PR 20479 at commit [`9a2f640`](https://github.com/apache/spark/commit/9a

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20485 **[Test build #86981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86981/testReport)** for PR 20485 at commit [`3aa0438`](https://github.com/apache/spark/commit/3a

[GitHub] spark pull request #20485: [SPARK-23315][SQL] failed to get output from cano...

2018-02-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20485#discussion_r165579903 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/PushDownOperatorsToDataSource.scala --- @@ -81,33 +81,44 @@ object PushDo

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20485 cc @tdas @jose-torres @rdblue @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional co

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165580176 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see ## Up

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Test `spark.sql.files.ignoreMis...

2018-02-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20479 I updated the JIRA issue and PR descriptions to mention all file-based data sources. --- - To unsubscribe, e-mail: reviews

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165580446 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see ## Up

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165580466 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165580509 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20446 **[Test build #86980 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86980/testReport)** for PR 20446 at commit [`f02172f`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/522/ Test

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86980/ Test PASSed. ---

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20483 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h.

[GitHub] spark pull request #20483: [SPARK-23312][SQL] add a config to turn off vecto...

2018-02-02 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20483#discussion_r165581115 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -141,6 +141,12 @@ object SQLConf { .booleanConf

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/523/ Test

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20485 **[Test build #86979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86979/testReport)** for PR 20485 at commit [`75950a1`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86979/ Test FAILed. ---

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20483 **[Test build #86983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86983/testReport)** for PR 20483 at commit [`53d3259`](https://github.com/apache/spark/commit/53

[GitHub] spark pull request #20464: [SPARK-23291][SQL][R] R's substr should not reduc...

2018-02-02 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20464#discussion_r165582806 --- Diff: R/pkg/R/column.R --- @@ -169,7 +169,7 @@ setMethod("alias", #' @note substr since 1.4.0 setMethod("substr", signature(x = "Column"),

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165583911 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/524/ Test

[GitHub] spark pull request #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20484#discussion_r165584080 --- Diff: docs/sql-programming-guide.md --- @@ -1776,6 +1776,66 @@ working with timestamps in `pandas_udf`s to get the best performance, see

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20484 **[Test build #86984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86984/testReport)** for PR 20484 at commit [`cb149f2`](https://github.com/apache/spark/commit/cb

[GitHub] spark pull request #20464: [SPARK-23291][SQL][R] R's substr should not reduc...

2018-02-02 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20464#discussion_r165584627 --- Diff: R/pkg/R/column.R --- @@ -169,7 +169,7 @@ setMethod("alias", #' @note substr since 1.4.0 setMethod("substr", signature(x = "Column"),

[GitHub] spark pull request #20464: [SPARK-23291][SQL][R] R's substr should not reduc...

2018-02-02 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20464#discussion_r165584849 --- Diff: docs/sparkr.md --- @@ -663,3 +663,7 @@ You can inspect the search path in R with [`search()`](https://stat.ethz.ch/R-ma - The `stringsAsFacto

[GitHub] spark issue #20464: [SPARK-23291][SQL][R] R's substr should not reduce start...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20464 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20464: [SPARK-23291][SQL][R] R's substr should not reduce start...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20464 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/525/ Test

[GitHub] spark issue #20464: [SPARK-23291][SQL][R] R's substr should not reduce start...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20464 **[Test build #86985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86985/testReport)** for PR 20464 at commit [`d994d76`](https://github.com/apache/spark/commit/d9

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86984/ Test PASSed. ---

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20484 **[Test build #86984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86984/testReport)** for PR 20484 at commit [`cb149f2`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20484 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20424: [Spark-23240][python] Better error message when extraneo...

2018-02-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20424 Yup, makes sense. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews

[GitHub] spark issue #20464: [SPARK-23291][SQL][R] R's substr should not reduce start...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20464 **[Test build #86985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86985/testReport)** for PR 20464 at commit [`d994d76`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #20464: [SPARK-23291][SQL][R] R's substr should not reduce start...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20464 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86985/ Test PASSed. ---

[GitHub] spark issue #20464: [SPARK-23291][SQL][R] R's substr should not reduce start...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20464 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #20472: [SPARK-22751][ML]Improve ML RandomForest shuffle ...

2018-02-02 Thread lucio-yz
Github user lucio-yz commented on a diff in the pull request: https://github.com/apache/spark/pull/20472#discussion_r165595281 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -1002,10 +1008,14 @@ private[spark] object RandomForest extends Logg

[GitHub] spark issue #20472: [SPARK-22751][ML]Improve ML RandomForest shuffle perform...

2018-02-02 Thread lucio-yz
Github user lucio-yz commented on the issue: https://github.com/apache/spark/pull/20472 previous problems have been solved --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e

[GitHub] spark pull request #20474: [SPARK-23235][Core] Add executor Threaddump to ap...

2018-02-02 Thread attilapiros
Github user attilapiros commented on a diff in the pull request: https://github.com/apache/spark/pull/20474#discussion_r165604504 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/OneApplicationResource.scala --- @@ -51,6 +52,46 @@ private[v1] class AbstractApplicationR

[GitHub] spark pull request #20483: [SPARK-23312][SQL] add a config to turn off vecto...

2018-02-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20483#discussion_r165609895 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -141,6 +141,12 @@ object SQLConf { .booleanConf

[GitHub] spark issue #20477: [SPARK-23303][SQL] improve the explain result for data s...

2018-02-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20477 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-

[GitHub] spark issue #20477: [SPARK-23303][SQL] improve the explain result for data s...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20477 **[Test build #86986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86986/testReport)** for PR 20477 at commit [`4ca2c40`](https://github.com/apache/spark/commit/4c

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20485 **[Test build #86981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86981/testReport)** for PR 20485 at commit [`3aa0438`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20485 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86981/ Test FAILed. ---

[GitHub] spark issue #20477: [SPARK-23303][SQL] improve the explain result for data s...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20477 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20477: [SPARK-23303][SQL] improve the explain result for data s...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20477 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/526/ Test

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20483 **[Test build #86983 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86983/testReport)** for PR 20483 at commit [`53d3259`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20483: [SPARK-23312][SQL] add a config to turn off vectorized c...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20483 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86983/ Test PASSed. ---

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Test `spark.sql.files.ignoreMis...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20479 **[Test build #86982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86982/testReport)** for PR 20479 at commit [`9a2f640`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Test `spark.sql.files.ignoreMis...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20479 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20479: [SPARK-23305][SQL][TEST] Test `spark.sql.files.ignoreMis...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20479 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86982/ Test PASSed. ---

[GitHub] spark pull request #20486: [SPARK-23317][SQL] rename ContinuousReader.setOff...

2018-02-02 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/20486 [SPARK-23317][SQL] rename ContinuousReader.setOffset to setStartOffset ## What changes were proposed in this pull request? In the document of `ContinuousReader.setOffset`, we say this met

[GitHub] spark issue #20486: [SPARK-23317][SQL] rename ContinuousReader.setOffset to ...

2018-02-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20486 **[Test build #86987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86987/testReport)** for PR 20486 at commit [`b7f71b1`](https://github.com/apache/spark/commit/b7

[GitHub] spark issue #20486: [SPARK-23317][SQL] rename ContinuousReader.setOffset to ...

2018-02-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20486 cc @jose-torres @zsxwing --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: r

[GitHub] spark issue #20486: [SPARK-23317][SQL] rename ContinuousReader.setOffset to ...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20486 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20486: [SPARK-23317][SQL] rename ContinuousReader.setOffset to ...

2018-02-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20486 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/527/ Test

  1   2   3   4   5   >