[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656819488 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #27988: [SPARK-31226][CORE][TEST] SizeBasedCoalesce logic will lose partition

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656682406 **[Test build #125615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125615/testReport)** for PR 27988 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656819397 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] tgravescs commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
tgravescs commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656819037 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #27988: [SPARK-31226][CORE][TEST] SizeBasedCoalesce logic will lose partition

2020-07-10 Thread GitBox
SparkQA commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656818779 **[Test build #125615 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125615/testReport)** for PR 27988 at commit

[GitHub] [spark] SparkQA commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
SparkQA commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656818843 **[Test build #125633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125633/testReport)** for PR 29067 at commit

[GitHub] [spark] tgravescs commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
tgravescs commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656818311 @warrenzhu25 can you look t the test failures - one might be related: org.apache.spark.deploy.yarn.YarnSparkHadoopUtilSuite.executorMemoryOverhead when

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656816296 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656816220 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
SparkQA commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656816280 **[Test build #125632 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125632/testReport)** for PR 29066 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656815748 **[Test build #125632 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125632/testReport)** for PR 29066 at commit

[GitHub] [spark] revans2 opened a new pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
revans2 opened a new pull request #29067: URL: https://github.com/apache/spark/pull/29067 I would love to see this go into the 3.1 release. It also applies cleanly to the 3.0 branch if someone wants to pull it in there too. This may look big, but it is mostly refactoring to get all

[GitHub] [spark] AmplabJenkins commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656816220 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
SparkQA commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656815748 **[Test build #125632 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125632/testReport)** for PR 29066 at commit

[GitHub] [spark] viirya commented on a change in pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-10 Thread GitBox
viirya commented on a change in pull request #28996: URL: https://github.com/apache/spark/pull/28996#discussion_r453000366 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -2030,7 +2030,25 @@ class Dataset[T] private[sql]( * @group typedrel

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656813811 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656813806 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656813806 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656812985 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] aokolnychyi opened a new pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
aokolnychyi opened a new pull request #29066: URL: https://github.com/apache/spark/pull/29066 ### What changes were proposed in this pull request? This WIP PR shows how we can implement first steps of the [design

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656811992 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656812985 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656679447 **[Test build #125611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125611/testReport)** for PR 28972 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656811985 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
SparkQA commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656812490 **[Test build #125631 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125631/testReport)** for PR 29050 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656811985 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656812121 **[Test build #125611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125611/testReport)** for PR 28972 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656780136 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656811295 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656693014 **[Test build #125616 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125616/testReport)** for PR 28412 at commit

[GitHub] [spark] dongjoon-hyun closed pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-10 Thread GitBox
dongjoon-hyun closed pull request #28926: URL: https://github.com/apache/spark/pull/28926 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656809763 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
SparkQA commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656810092 **[Test build #125616 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125616/testReport)** for PR 28412 at commit

[GitHub] [spark] SparkQA commented on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
SparkQA commented on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656809867 **[Test build #125630 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125630/testReport)** for PR 29053 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656809763 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656808736 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656808728 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656808728 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] peter-toth commented on a change in pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
peter-toth commented on a change in pull request #29053: URL: https://github.com/apache/spark/pull/29053#discussion_r452992807 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -161,7 +161,8 @@ abstract class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656806580 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656663259 **[Test build #125608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125608/testReport)** for PR 28977 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark'

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656806574 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-10 Thread GitBox
SparkQA commented on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-656806883 **[Test build #125608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125608/testReport)** for PR 28977 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656806574 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29063: URL: https://github.com/apache/spark/pull/29063#issuecomment-656806021 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29063: URL: https://github.com/apache/spark/pull/29063#issuecomment-656806021 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spar

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656679442 **[Test build #125613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125613/testReport)** for PR 28287 at commit

[GitHub] [spark] srowen commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
srowen commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656804952 Yeah DATETIME is definitely not the same thing as TIMESTAMP. You need to start with a Spark date-time type, logically.

[GitHub] [spark] SparkQA commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's blac

2020-07-10 Thread GitBox
SparkQA commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656804835 **[Test build #125613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125613/testReport)** for PR 28287 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656803707 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656803694 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656803694 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656802466 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-656802466 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656625881 **[Test build #125603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125603/testReport)** for PR 28904 at commit

[GitHub] [spark] SparkQA commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-10 Thread GitBox
SparkQA commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-656801641 **[Test build #125603 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125603/testReport)** for PR 28904 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656797158 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656797158 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656796734 **[Test build #125629 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125629/testReport)** for PR 28969 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656796266 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656795743 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656795734 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656795734 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656644537 **[Test build #125606 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125606/testReport)** for PR 28967 at commit

[GitHub] [spark] SparkQA commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-10 Thread GitBox
SparkQA commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-656793977 **[Test build #125606 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125606/testReport)** for PR 28967 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656792367 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656792361 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656792361 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656650491 **[Test build #125607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125607/testReport)** for PR 28969 at commit

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656790188 **[Test build #125607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125607/testReport)** for PR 28969 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-656781350 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-656781350 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656780129 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656780129 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656772419 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656772419 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656770276 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656770886 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] warrenzhu25 commented on pull request #29044: [WIP][SPARK-32227] Fix regression bug in load-spark-env.cmd with Spark 3.0.0

2020-07-10 Thread GitBox
warrenzhu25 commented on pull request #29044: URL: https://github.com/apache/spark/pull/29044#issuecomment-656771107 > It's directly relevant to this PR because your patch is changing `environment` variable. > > * Please see this for the detail (https://github.com/cdarlint/winutils)

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656770886 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656770267 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656770513 **[Test build #125628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125628/testReport)** for PR 29057 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656724344 **[Test build #125620 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125620/testReport)** for PR 29054 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656770373 BTW, since this touches 20 files, this should pass Jenkins to make it sure that everything is okay. This

[GitHub] [spark] MaxGekk commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-10 Thread GitBox
MaxGekk commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656770212 The [ML tests](https://github.com/apache/spark/pull/28998#issuecomment-656724706) are not related to the changes: ```

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656770267 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656769700 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-10 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-656769831 **[Test build #125620 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125620/testReport)** for PR 29054 at commit

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656769009 **[Test build #125605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125605/testReport)** for PR 29057 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656633261 **[Test build #125605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125605/testReport)** for PR 29057 at commit

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #29057: URL: https://github.com/apache/spark/pull/29057#discussion_r452943244 ## File path: .github/workflows/master.yml ## @@ -1,156 +1,238 @@ name: master on: - push: Review comment: @gengliangwang . That's the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656758782 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656758782 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29044: [WIP][SPARK-32227] Fix regression bug in load-spark-env.cmd with Spark 3.0.0

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29044: URL: https://github.com/apache/spark/pull/29044#issuecomment-656758336 Please remove `[WIP]` from the title when AppVeyor passes on Windows. Thanks. This is an automated

[GitHub] [spark] dongjoon-hyun commented on pull request #29044: [SPARK-32227] Fix regression bug in load-spark-env.cmd with Spark 3.0.0

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29044: URL: https://github.com/apache/spark/pull/29044#issuecomment-656758003 It's directly relevant to this PR because your patch is changing `environment` variable. - Please see this for the detail (https://github.com/cdarlint/winutils) -

[GitHub] [spark] viirya commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-10 Thread GitBox
viirya commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-656757538 I'll add Python and R in a follow-up. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656757326 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656757326 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
SparkQA commented on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656756847 **[Test build #125627 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125627/testReport)** for PR 29065 at commit

[GitHub] [spark] wangyum opened a new pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
wangyum opened a new pull request #29065: URL: https://github.com/apache/spark/pull/29065 ### What changes were proposed in this pull request? We can improve the performance of some joins by pre-filtering one side of a join using the values from the other side of the join. In order

<    1   2   3   4   5   6   7   8   9   10   >