[GitHub] spark pull request #20098: [SPARK-22914][DEPLOY] Register history.ui.port

2018-01-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/20098#discussion_r159339086 --- Diff: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ApplicationMasterUtilSuite.scala --- @@ -0,0 +1,44 @@ +/* + * Licensed

[GitHub] spark pull request #20098: [SPARK-22914][DEPLOY] Register history.ui.port

2018-01-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/20098#discussion_r159339383 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -836,6 +833,20 @@ object ApplicationMaster

[GitHub] spark issue #20013: [SPARK-20657][core] Speed up rendering of the stages pag...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20013 **[Test build #85614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85614/testReport)** for PR 20013 at commit

[GitHub] spark issue #20138: [SPARK-20664][core] Delete stale application data from S...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20138 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85611/ Test PASSed. ---

[GitHub] spark issue #20138: [SPARK-20664][core] Delete stale application data from S...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20138 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20138: [SPARK-20664][core] Delete stale application data from S...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20138 **[Test build #85611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85611/testReport)** for PR 20138 at commit

[GitHub] spark issue #20127: [SPARK-22932] [SQL] Refactor AnalysisContext

2018-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20127 Hi, @gatorsmile . This PR seems to be landed into only `master`, but is marked as 2.3.0 in JIRA. Could you merge this into `branch-2.3` or fix the version into 2.4 or 3.0? ---

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85613/testReport)** for PR 19872 at commit

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20046 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85610/ Test FAILed. ---

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20046 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20046 **[Test build #85610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85610/testReport)** for PR 20046 at commit

[GitHub] spark pull request #20131: [MINOR] Fix a bunch of typos

2018-01-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/20131#discussion_r159313149 --- Diff: common/network-common/src/main/java/org/apache/spark/network/protocol/MessageWithHeader.java --- @@ -100,7 +100,7 @@ public long transferred() {

[GitHub] spark issue #20045: [Spark-22360][SQL][TEST] Add unit tests for Window Speci...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20045 **[Test build #85612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85612/testReport)** for PR 20045 at commit

[GitHub] spark issue #20138: [SPARK-20664][core] Delete stale application data from S...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20138 **[Test build #85611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85611/testReport)** for PR 20138 at commit

[GitHub] spark issue #20138: [SPARK-20664][core] Delete stale application data from S...

2018-01-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/20138 There are some previous comments on this code at: https://github.com/vanzin/spark/pull/40 --- - To unsubscribe, e-mail:

[GitHub] spark issue #20138: [SPARK-20664][core] Delete stale application data from S...

2018-01-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/20138 @ericvandenbergfb --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20138: [SPARK-20664][core] Delete stale application data...

2018-01-02 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/20138 [SPARK-20664][core] Delete stale application data from SHS. Detect the deletion of event log files from storage, and remove data about the related application attempt in the SHS. Also

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85605/ Test PASSed. ---

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85605/testReport)** for PR 19872 at commit

[GitHub] spark issue #20114: [SPARK-22530][PYTHON][SQL] Adding Arrow support for Arra...

2018-01-02 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/20114 Thanks @HyukjinKwon and @ueshin ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85609/ Test PASSed. ---

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85609 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85609/testReport)** for PR 20136 at commit

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85606/ Test PASSed. ---

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85606 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85606/testReport)** for PR 20136 at commit

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20046 **[Test build #85610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85610/testReport)** for PR 20046 at commit

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19872 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85604/ Test FAILed. ---

[GitHub] spark issue #19872: [SPARK-22274][PYTHON][SQL] User-defined aggregation func...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85604 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85604/testReport)** for PR 19872 at commit

[GitHub] spark pull request #19717: [SPARK-22646] [Submission] Spark on Kubernetes - ...

2018-01-02 Thread echarles
Github user echarles commented on a diff in the pull request: https://github.com/apache/spark/pull/19717#discussion_r159282180 --- Diff: resource-managers/kubernetes/docker/src/main/dockerfiles/spark-base/Dockerfile --- @@ -0,0 +1,47 @@ +# +# Licensed to the Apache

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85602/ Test PASSed. ---

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85602/testReport)** for PR 20136 at commit

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20135 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20135 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85603/ Test PASSed. ---

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20135 **[Test build #85603 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85603/testReport)** for PR 20135 at commit

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20046 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20046 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85601/ Test PASSed. ---

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20046 **[Test build #85601 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85601/testReport)** for PR 20046 at commit

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20046 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85599/ Test PASSed. ---

[GitHub] spark pull request #19621: [SPARK-11215][ML] Add multiple columns support to...

2018-01-02 Thread WeichenXu123
Github user WeichenXu123 closed the pull request at: https://github.com/apache/spark/pull/19621 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20046 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19621: [SPARK-11215][ML] Add multiple columns support to String...

2018-01-02 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/19621 I am too busy recently to fix those failed R tests. Anyone who has spare time can take over this PR and I will help review. Thanks! ---

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20046 **[Test build #85599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85599/testReport)** for PR 20046 at commit

[GitHub] spark issue #19943: [SPARK-16060][SQL] Support Vectorized ORC Reader

2018-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19943 Thank you, @cloud-fan . I'll try to update this after #20116 lands on master branch. --- - To unsubscribe, e-mail:

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159269896 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1971,8 +1971,8 @@ abstract class DDLSuite extends

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85600/ Test FAILed. ---

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20136 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85600 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85600/testReport)** for PR 20136 at commit

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20135 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85597/ Test PASSed. ---

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20135 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20135 **[Test build #85597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85597/testReport)** for PR 20135 at commit

[GitHub] spark pull request #20057: [SPARK-22880][SQL] Add cascadeTruncate option to ...

2018-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20057#discussion_r159262664 --- Diff: docs/sql-programming-guide.md --- @@ -1339,6 +1339,13 @@ the following case-insensitive options: This is a JDBC writer related

[GitHub] spark pull request #20116: [SPARK-20960][SQL] make ColumnVector public

2018-01-02 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20116#discussion_r159260224 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/WritableColumnVector.java --- @@ -586,7 +587,7 @@ public final int

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20137 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20137 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85608/ Test FAILed. ---

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20137 **[Test build #85608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85608/testReport)** for PR 20137 at commit

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20137 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20137 **[Test build #85607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85607/testReport)** for PR 20137 at commit

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20137 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85607/ Test FAILed. ---

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85609/testReport)** for PR 20136 at commit

[GitHub] spark pull request #20136: [SPARK-22938] Assert that SQLConf.get is accessed...

2018-01-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20136#discussion_r159252410 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -1087,6 +1089,11 @@ object SQLConf { class SQLConf extends

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20137 **[Test build #85608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85608/testReport)** for PR 20137 at commit

[GitHub] spark issue #20076: [SPARK-21786][SQL] When acquiring 'compressionCodecClass...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20076 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20076: [SPARK-21786][SQL] When acquiring 'compressionCodecClass...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20076 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85595/ Test PASSed. ---

[GitHub] spark issue #20076: [SPARK-21786][SQL] When acquiring 'compressionCodecClass...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20076 **[Test build #85595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85595/testReport)** for PR 20076 at commit

[GitHub] spark issue #20137: [SPARK-22939] [PySpark] Support Spark UDF in registerFun...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20137 **[Test build #85607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85607/testReport)** for PR 20137 at commit

[GitHub] spark pull request #20137: [SPARK-22939] [PySpark] Support Spark UDF in regi...

2018-01-02 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/20137 [SPARK-22939] [PySpark] Support Spark UDF in registerFunction [WIP] ## What changes were proposed in this pull request? ```Python import random from pyspark.sql.functions import udf

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85606 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85606/testReport)** for PR 20136 at commit

[GitHub] spark pull request #20116: [SPARK-20960][SQL] make ColumnVector public

2018-01-02 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20116#discussion_r159248950 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnVector.java --- @@ -14,32 +14,38 @@ * See the License for the specific language

[GitHub] spark pull request #20082: [SPARK-22897][CORE]: Expose stageAttemptId in Tas...

2018-01-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20082 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19872: [SPARK-22274][PySpark] User-defined aggregation function...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85605/testReport)** for PR 19872 at commit

[GitHub] spark pull request #20116: [SPARK-20960][SQL] make ColumnVector public

2018-01-02 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20116#discussion_r159248670 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnVector.java --- @@ -14,32 +14,38 @@ * See the License for the specific language

[GitHub] spark issue #20082: [SPARK-22897][CORE]: Expose stageAttemptId in TaskContex...

2018-01-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20082 thanks, merging to master/2.3! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #19872: [SPARK-22274][PySpark] User-defined aggregation f...

2018-01-02 Thread icexelloss
Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/19872#discussion_r159248298 --- Diff: python/pyspark/sql/group.py --- @@ -82,6 +91,13 @@ def agg(self, *exprs): >>> from pyspark.sql import functions as F

[GitHub] spark issue #20076: [SPARK-21786][SQL] When acquiring 'compressionCodecClass...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20076 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85594/ Test PASSed. ---

[GitHub] spark issue #20076: [SPARK-21786][SQL] When acquiring 'compressionCodecClass...

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20076 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20076: [SPARK-21786][SQL] When acquiring 'compressionCodecClass...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20076 **[Test build #85594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85594/testReport)** for PR 20076 at commit

[GitHub] spark pull request #20082: [SPARK-22897][CORE]: Expose stageAttemptId in Tas...

2018-01-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20082#discussion_r159247576 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -79,6 +79,7 @@ private[spark] abstract class Task[T](

[GitHub] spark pull request #20136: [SPARK-22938] Assert that SQLConf.get is accessed...

2018-01-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20136#discussion_r159247039 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -70,7 +72,12 @@ object SQLConf { * Default config. Only

[GitHub] spark issue #19872: [SPARK-22274][PySpark] User-defined aggregation function...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19872 **[Test build #85604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85604/testReport)** for PR 19872 at commit

[GitHub] spark pull request #20010: [SPARK-22826][SQL] findWiderTypeForTwo Fails over...

2018-01-02 Thread bdrillard
Github user bdrillard commented on a diff in the pull request: https://github.com/apache/spark/pull/20010#discussion_r159244795 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -148,6 +160,61 @@ object TypeCoercion {

[GitHub] spark issue #19764: [SPARK-22539][SQL] Add second order for rangepartitioner...

2018-01-02 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19764 I'm probably not qualified to review this. I don't think you addressed Herman's question. It wasn't about ordering or whether the same exact row maps to the same partition, but whether all values

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20135 **[Test build #85603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85603/testReport)** for PR 20135 at commit

[GitHub] spark pull request #20135: [SPARK-22937][SQL] SQL elt output binary for bina...

2018-01-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20135#discussion_r159243492 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -684,6 +685,34 @@ object TypeCoercion { }

[GitHub] spark pull request #20135: [SPARK-22937][SQL] SQL elt output binary for bina...

2018-01-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20135#discussion_r159243470 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -271,33 +271,45 @@ case class

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85602/testReport)** for PR 20136 at commit

[GitHub] spark issue #20135: [SPARK-22937][SQL] SQL elt output binary for binary inpu...

2018-01-02 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/20135 I'll update the migration guide, too. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20116: [SPARK-20960][SQL] make ColumnVector public

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20116 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20116: [SPARK-20960][SQL] make ColumnVector public

2018-01-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85593/ Test PASSed. ---

[GitHub] spark issue #20116: [SPARK-20960][SQL] make ColumnVector public

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20116 **[Test build #85593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85593/testReport)** for PR 20116 at commit

[GitHub] spark pull request #20136: [SPARK-22938] Assert that SQLConf.get is accessed...

2018-01-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20136#discussion_r159240318 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -70,7 +71,10 @@ object SQLConf { * Default config. Only

[GitHub] spark pull request #20136: [SPARK-22938] Assert that SQLConf.get is accessed...

2018-01-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20136#discussion_r159239867 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -70,7 +71,10 @@ object SQLConf { * Default config. Only

[GitHub] spark issue #20046: [SPARK-22362][SQL] Add unit test for Window Aggregate Fu...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20046 **[Test build #85601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85601/testReport)** for PR 20046 at commit

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20136 **[Test build #85600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85600/testReport)** for PR 20136 at commit

[GitHub] spark issue #20136: [SPARK-22938] Assert that SQLConf.get is accessed only o...

2018-01-02 Thread juliuszsompolski
Github user juliuszsompolski commented on the issue: https://github.com/apache/spark/pull/20136 cc @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20136: [SPARK-22938] Assert that SQLConf.get is accessed...

2018-01-02 Thread juliuszsompolski
GitHub user juliuszsompolski opened a pull request: https://github.com/apache/spark/pull/20136 [SPARK-22938] Assert that SQLConf.get is accessed only on the driver. ## What changes were proposed in this pull request? Assert if code tries to access SQLConf.get on executor.

[GitHub] spark pull request #20135: [SPARK-22937][SQL] SQL elt output binary for bina...

2018-01-02 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/20135#discussion_r159235432 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -684,6 +685,34 @@ object TypeCoercion { }

<    1   2   3   >