[GitHub] rezasafi opened a new pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-12 Thread GitBox
rezasafi opened a new pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306 This change exposes the executors' proscfs metrics that were introduced in SPARK-24958 to Metrics system. To do this a new

[GitHub] AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446867240 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446867237 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446867109 **[Test build #100074 has

[GitHub] AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446867240 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446867237 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins removed a comment on issue #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them URL: https://github.com/apache/spark/pull/23307#issuecomment-446873630 Can one of the admins verify this patch?

[GitHub] felixcheung commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
felixcheung commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446873879 all pass This is an automated message from the

[GitHub] AmplabJenkins removed a comment on issue #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them URL: https://github.com/apache/spark/pull/23307#issuecomment-446872846 Can one of the admins verify this patch?

[GitHub] SparkQA commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule

2018-12-12 Thread GitBox
SparkQA commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule URL: https://github.com/apache/spark/pull/23273#issuecomment-446874129 **[Test build #100075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100075/testReport)**

[GitHub] AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-446846457 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] seancxmao commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule

2018-12-12 Thread GitBox
seancxmao commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule URL: https://github.com/apache/spark/pull/23273#issuecomment-446854424 @srowen The build failed twice because of the same reason. It seems we ran into [SparkR CRAN feasibility check server

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446860614 Merged build finished. Test FAILed. This is

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446860622 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] gengliangwang commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
gengliangwang commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446865570 retest this please. This is an automated message from

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446865854 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446865851 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446869022 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446869022 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446869016 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446869016 Merged build finished. Test PASSed. This

[GitHub] HyukjinKwon commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
HyukjinKwon commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#issuecomment-446874266 retest this please

[GitHub] AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-446846453 Merged build finished. Test FAILed. This is an automated

[GitHub] SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446847757 **[Test build #100070 has

[GitHub] 10110346 commented on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max&

2018-12-12 Thread GitBox
10110346 commented on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max& URL: https://github.com/apache/spark/pull/23304#issuecomment-446853077 retest this please This is an automated message from the Apache

[GitHub] AmplabJenkins commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108#issuecomment-446856436 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446860411 **[Test build #100065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100065/testReport)**

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446860614 Merged build finished. Test FAILed. This is an

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446860622 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446827820 **[Test build #100065 has

[GitHub] SparkQA removed a comment on issue #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298#issuecomment-446825963 **[Test build #100063 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100063/testReport)** for PR

[GitHub] HyukjinKwon commented on a change in pull request #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
HyukjinKwon commented on a change in pull request #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#discussion_r241289429 ## File path:

[GitHub] SparkQA commented on issue #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
SparkQA commented on issue #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298#issuecomment-446863225 **[Test build #100063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100063/testReport)** for PR 23298 at

[GitHub] AmplabJenkins commented on issue #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298#issuecomment-446863584 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298#issuecomment-446863582 Merged build finished. Test FAILed. This is an automated message from

[GitHub] gengliangwang commented on a change in pull request #22878: [SPARK-25789][SQL] Support for Dataset of Avro

2018-12-12 Thread GitBox
gengliangwang commented on a change in pull request #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#discussion_r241293536 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroEncoder.scala ## @@

[GitHub] AmplabJenkins commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#issuecomment-446875393 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#issuecomment-446875395 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446875537 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#issuecomment-446875393 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446875536 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446875537 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446875362 **[Test build #100077 has

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446875536 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
SparkQA commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#issuecomment-446875353 **[Test build #100076 has

[GitHub] AmplabJenkins commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#issuecomment-446875395 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] SparkQA removed a comment on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffle

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffle URL: https://github.com/apache/spark/pull/23281#issuecomment-446803437 **[Test build #4465 has

[GitHub] AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-446855274 Can one of the admins verify this patch?

[GitHub] SparkQA commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2018-12-12 Thread GitBox
SparkQA commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108#issuecomment-446855600 **[Test build #100072 has

[GitHub] SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446870213 **[Test build #100070 has

[GitHub] kjmrknsn opened a new pull request #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them

2018-12-12 Thread GitBox
kjmrknsn opened a new pull request #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them URL: https://github.com/apache/spark/pull/23307 ## What changes were proposed in this pull request? ### Issue

[GitHub] AmplabJenkins commented on issue #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23307: [SPARK-26335][SQL] Add a property for Dataset#show not to care about wide characters when padding them URL: https://github.com/apache/spark/pull/23307#issuecomment-446872846 Can one of the admins verify this patch?

[GitHub] felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#discussion_r241297727 ## File path: R/pkg/inst/profile/shell.R ## @@

[GitHub] AmplabJenkins removed a comment on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max&

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max& URL: https://github.com/apache/spark/pull/23304#issuecomment-446853853 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] seancxmao edited a comment on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule

2018-12-12 Thread GitBox
seancxmao edited a comment on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule URL: https://github.com/apache/spark/pull/23273#issuecomment-446854424 @srowen The build failed twice because of the same reason. It seems we ran into [SparkR CRAN feasibility check server

[GitHub] AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-446855211 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-446855274 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-446855521 Can one of the admins verify this patch?

[GitHub] AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-446855211 Can one of the admins verify this patch?

[GitHub] dilipbiswal commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2018-12-12 Thread GitBox
dilipbiswal commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108#issuecomment-446855386 retest this please This is an

[GitHub] JkSelf commented on issue #23269: [SPARK-26316] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-12 Thread GitBox
JkSelf commented on issue #23269: [SPARK-26316] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23269#issuecomment-446863791 @cloud-fan sorry for the delay. And I will create new PRs to backport 2.4 and 2.3. Thanks!

[GitHub] HyukjinKwon commented on a change in pull request #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
HyukjinKwon commented on a change in pull request #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#discussion_r241289429 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298#issuecomment-446863584 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298#issuecomment-446863582 Merged build finished. Test FAILed. This is an automated

[GitHub] SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446868590 **[Test build #100061 has

[GitHub] SparkQA removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446822063 **[Test build #100061 has

[GitHub] SparkQA removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446847757 **[Test build #100070 has

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446870352 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446870345 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446870345 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-446870352 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] cloud-fan commented on a change in pull request #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
cloud-fan commented on a change in pull request #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#discussion_r241298370 ## File path:

[GitHub] seancxmao commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule

2018-12-12 Thread GitBox
seancxmao commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule URL: https://github.com/apache/spark/pull/23273#issuecomment-446873024 retest this please. This is an automated message from the

[GitHub] felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#discussion_r241298433 ## File path: R/pkg/inst/profile/shell.R ## @@

[GitHub] felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#discussion_r241297727 ## File path: R/pkg/inst/profile/shell.R ## @@

[GitHub] felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell

2018-12-12 Thread GitBox
felixcheung commented on a change in pull request #23293: [MINOR][R] Fix indents of sparkR welcome message to be consistent with pyspark and spark-shell URL: https://github.com/apache/spark/pull/23293#discussion_r241298433 ## File path: R/pkg/inst/profile/shell.R ## @@

[GitHub] HeartSaVioR commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2018-12-12 Thread GitBox
HeartSaVioR commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#discussion_r240960705 ## File path:

[GitHub] zhengruifeng commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2018-12-12 Thread GitBox
zhengruifeng commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#issuecomment-446552681 retest this please This is an automated

[GitHub] gaborgsomogyi commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2018-12-12 Thread GitBox
gaborgsomogyi commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#discussion_r240950079 ## File path:

[GitHub] gaborgsomogyi commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2018-12-12 Thread GitBox
gaborgsomogyi commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#discussion_r240950079 ## File path:

[GitHub] HeartSaVioR commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2018-12-12 Thread GitBox
HeartSaVioR commented on a change in pull request #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#discussion_r240960705 ## File path:

[GitHub] SparkQA commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
SparkQA commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446545889 **[Test build #100019 has

[GitHub] mgaido91 commented on issue #23285: [SPARK-26224][SQL] Avoid creating many project on subsequent calls to withColumn

2018-12-12 Thread GitBox
mgaido91 commented on issue #23285: [SPARK-26224][SQL] Avoid creating many project on subsequent calls to withColumn URL: https://github.com/apache/spark/pull/23285#issuecomment-446546121 the test failure shows a potential regression due to this patch I hadn't thought of. Collapsing the

[GitHub] AmplabJenkins commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#issuecomment-446553239 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#issuecomment-446553241 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446545590 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446545601 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446545590 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446545601 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2018-12-12 Thread GitBox
SparkQA commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#issuecomment-446553449 **[Test build #100020 has

[GitHub] AmplabJenkins removed a comment on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#issuecomment-446553241 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#issuecomment-446553239 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23295: [MINOR][SQL]Change `ThreadLocal.withInitial` to Scala lambda syntax

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23295: [MINOR][SQL]Change `ThreadLocal.withInitial` to Scala lambda syntax URL: https://github.com/apache/spark/pull/23295#issuecomment-446497662 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446497676 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446498835 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446499187 **[Test build #100011 has

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446498829 Merged build finished. Test PASSed. This is

[GitHub] kiszk commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
kiszk commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446499063 retest this please This is an automated message from the

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446500593 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446500587 **[Test build #100012 has

<    3   4   5   6   7   8   9   10   >