[GitHub] [spark] HyukjinKwon commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

HyukjinKwon commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654599703 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654614124 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-654159125 **[Test build #125055 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125055/testReport)** for PR 27983 at commit

[GitHub] [spark] cloud-fan commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

cloud-fan commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-654162289 > Probably, you also need to add a new rule in HiveSessionStateBuilder. Yea, this is not good and should be refactored, but this is the case for now. The extra analyzer

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654164921 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

SparkQA removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654157015 **[Test build #125065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125065/testReport)** for PR 27366 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654164921 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654164877 **[Test build #125065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125065/testReport)** for PR 27366 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #29009: [SPARK-32193][SQL] Update migrate guide docs on regexp function

HyukjinKwon commented on pull request #29009: URL: https://github.com/apache/spark/pull/29009#issuecomment-654168528 No, @GuoPhilipse, I meant if it's supported in `SELECT REGEXP('abc', '([a-z]+)');` way. This is an

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654168779 **[Test build #125069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125069/testReport)** for PR 28969 at commit

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-654168923 **[Test build #125070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125070/testReport)** for PR 27983 at commit

[GitHub] [spark] GuoPhilipse commented on pull request #29009: [SPARK-32193][SQL] Update migrate guide docs on regexp function

GuoPhilipse commented on pull request #29009: URL: https://github.com/apache/spark/pull/29009#issuecomment-654168933 > No, @GuoPhilipse, I meant if it's supported in `SELECT REGEXP('abc', '([a-z]+)');` way. No,it's a different way.

[GitHub] [spark] SparkQA commented on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

SparkQA commented on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654168938 **[Test build #125068 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125068/testReport)** for PR 28987 at commit

[GitHub] [spark] SparkQA commented on pull request #29011: [WIP][SPARK-XXXXX][SQL] Parallelize HashAggregationQueryWithControlledFallbackSuite

SparkQA commented on pull request #29011: URL: https://github.com/apache/spark/pull/29011#issuecomment-654168935 **[Test build #125067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125067/testReport)** for PR 29011 at commit

[GitHub] [spark] cloud-fan commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

cloud-fan commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-654174375 Good catch! LGTM, let's update the failed tests. This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

cloud-fan commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654174553 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #28992: [SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins commented on pull request #28992: URL: https://github.com/apache/spark/pull/28992#issuecomment-654177748 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28992: [SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

SparkQA commented on pull request #28992: URL: https://github.com/apache/spark/pull/28992#issuecomment-654177629 **[Test build #125066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125066/testReport)** for PR 28992 at commit

[GitHub] [spark] xuanyuanking commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

xuanyuanking commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r450162731 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala ## @@ -259,6 +269,9 @@

[GitHub] [spark] cloud-fan commented on a change in pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

cloud-fan commented on a change in pull request #28996: URL: https://github.com/apache/spark/pull/28996#discussion_r450162816 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2656,6 +2656,14 @@ object SQLConf { .checkValue(_

[GitHub] [spark] SparkQA removed a comment on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

SparkQA removed a comment on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-654144672 **[Test build #125060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125060/testReport)** for PR 28991 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

AmplabJenkins commented on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-654187760 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

AmplabJenkins removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654186419 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] maropu commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

maropu commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-654187102 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

AmplabJenkins removed a comment on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-654187760 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-654192286 **[Test build #125052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125052/testReport)** for PR 28957 at commit

[GitHub] [spark] SparkQA commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

SparkQA commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-654192090 **[Test build #125054 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125054/testReport)** for PR 28859 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

AmplabJenkins commented on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-654191992 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

AmplabJenkins removed a comment on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-654191992 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

SparkQA removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-654093219 **[Test build #125054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125054/testReport)** for PR 28859 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-654093215 **[Test build #125052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125052/testReport)** for PR 28957 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654198417 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

SparkQA commented on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-654198384 **[Test build #125077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125077/testReport)** for PR 28991 at commit

[GitHub] [spark] LantaoJin commented on pull request #28901: [SPARK-32064][SQL] Supporting create temporary table

LantaoJin commented on pull request #28901: URL: https://github.com/apache/spark/pull/28901#issuecomment-654198375 > If I write the output to a temp location and then create a temp view, is it similar to the temp table? Except that temp table can be removed when the session terminates.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654196866 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

AmplabJenkins removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654204222 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

AmplabJenkins removed a comment on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-654209546 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

AmplabJenkins removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654209613 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

AmplabJenkins removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-654209578 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

AmplabJenkins commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654209613 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

cloud-fan commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r450086968 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala ## @@ -259,6 +269,9 @@ class

[GitHub] [spark] AmplabJenkins commented on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

AmplabJenkins commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654221607 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

AmplabJenkins removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654221607 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

SparkQA removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654208965 **[Test build #125082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125082/testReport)** for PR 28808 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

HyukjinKwon commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654241248 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to fill the map index when the event logs from the old Spark version

SparkQA commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-654251762 **[Test build #125058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125058/testReport)** for PR 28965 at commit

[GitHub] [spark] SparkQA commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

SparkQA commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-654251660 **[Test build #125087 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125087/testReport)** for PR 28833 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to fill the map index when the event logs from the old Spark versio

SparkQA removed a comment on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-654123803 **[Test build #125058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125058/testReport)** for PR 28965 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

AmplabJenkins commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-654252285 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-654252285 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

SparkQA commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-654258449 **[Test build #125053 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125053/testReport)** for PR 28904 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654258309 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

SparkQA commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-654264713 **[Test build #125090 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125090/testReport)** for PR 28904 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to fill the map index when the event logs from the old Spark version

AmplabJenkins commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-654265147 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29007: [SPARK-XXXXX][SQL][DOCS] consistency in argument naming for time functions

SparkQA commented on pull request #29007: URL: https://github.com/apache/spark/pull/29007#issuecomment-654264534 **[Test build #125088 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125088/testReport)** for PR 29007 at commit

[GitHub] [spark] SparkQA commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to fill the map index when the event logs from the old Spark version

SparkQA commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-654264439 **[Test build #125089 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125089/testReport)** for PR 28965 at commit

[GitHub] [spark] maropu commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

maropu commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654283393 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-654282769 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654281650 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

AmplabJenkins removed a comment on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-654281664 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-654281653 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-654282769 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654281675 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

AmplabJenkins removed a comment on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-654169570 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HeartSaVioR commented on pull request #29011: [WIP][SPARK-XXXXX][SQL] Parallelize HashAggregationQueryWithControlledFallbackSuite

HeartSaVioR commented on pull request #29011: URL: https://github.com/apache/spark/pull/29011#issuecomment-654170747 Rationalization: it turns out that HashAggregationQueryWithFallbackSuite is more than 11x slower compared to HashAggregationQuerySuite. If the test ran fast enough then the

[GitHub] [spark] AmplabJenkins commented on pull request #28912: [SPARK-32057][SQL][test-hive1.2][test-hadoop2.7] ExecuteStatement: cancel and close should not transiently ERROR

AmplabJenkins commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-654175665 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

SparkQA commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654175563 **[Test build #125072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125072/testReport)** for PR 27066 at commit

[GitHub] [spark] SparkQA commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

SparkQA commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654188289 **[Test build #125075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125075/testReport)** for PR 28683 at commit

[GitHub] [spark] MaxGekk opened a new pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

MaxGekk opened a new pull request #29012: URL: https://github.com/apache/spark/pull/29012 ### What changes were proposed in this pull request? 1. Set the SQL config `spark.sql.legacy.allowCastNumericToTimestamp` to `true` by default 2. Remove explicit sets of

[GitHub] [spark] SparkQA commented on pull request #28992: [SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

SparkQA commented on pull request #28992: URL: https://github.com/apache/spark/pull/28992#issuecomment-654188295 **[Test build #125073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125073/testReport)** for PR 28992 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

AmplabJenkins removed a comment on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-654187762 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

SparkQA commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-654188351 **[Test build #125074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125074/testReport)** for PR 28833 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

cloud-fan commented on a change in pull request #27366: URL: https://github.com/apache/spark/pull/27366#discussion_r450177143 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/StructFilters.scala ## @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

cloud-fan commented on a change in pull request #27366: URL: https://github.com/apache/spark/pull/27366#discussion_r450176725 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/StructFilters.scala ## @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

AmplabJenkins removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-654194495 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29011: [WIP][SPARK-XXXXX][SQL] Parallelize HashAggregationQueryWithControlledFallbackSuite

AmplabJenkins removed a comment on pull request #29011: URL: https://github.com/apache/spark/pull/29011#issuecomment-654194034 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

AmplabJenkins removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-654194505 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28997: [SPARK-32172][CORE]Use createDirectory instead of mkdir

SparkQA removed a comment on pull request #28997: URL: https://github.com/apache/spark/pull/28997#issuecomment-654083343 **[Test build #125048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125048/testReport)** for PR 28997 at commit

[GitHub] [spark] SparkQA commented on pull request #29011: [WIP][SPARK-XXXXX][SQL] Parallelize HashAggregationQueryWithControlledFallbackSuite

SparkQA commented on pull request #29011: URL: https://github.com/apache/spark/pull/29011#issuecomment-654201884 **[Test build #125078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125078/testReport)** for PR 29011 at commit

[GitHub] [spark] SparkQA commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

SparkQA commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-654201970 **[Test build #125079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125079/testReport)** for PR 28859 at commit

[GitHub] [spark] SparkQA commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

SparkQA commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654212893 **[Test build #5051 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/5051/testReport)** for PR 27066 at commit

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654212573 **[Test build #125083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125083/testReport)** for PR 28986 at commit

[GitHub] [spark] SparkQA commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-654212676 **[Test build #125084 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125084/testReport)** for PR 28957 at commit

[GitHub] [spark] LantaoJin edited a comment on pull request #28901: [SPARK-32064][SQL] Supporting create temporary table

LantaoJin edited a comment on pull request #28901: URL: https://github.com/apache/spark/pull/28901#issuecomment-654224633 > If I write the output to a temp location and then create a temp view to read from this temp location, ... Ah, I knew your meaning now, using `CREATE TEMP VIEW

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654226087 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654225984 **[Test build #125083 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125083/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28970: [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite

AmplabJenkins removed a comment on pull request #28970: URL: https://github.com/apache/spark/pull/28970#issuecomment-654230111 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] srowen commented on pull request #29007: [SPARK-XXXXX][SQL][DOCS] consistency in argument naming for time functions

srowen commented on pull request #29007: URL: https://github.com/apache/spark/pull/29007#issuecomment-654261324 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] HeartSaVioR commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

HeartSaVioR commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-654262269 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #28961: [SPARK-32143][SQL] Prevent a skewed join from producing too many partition splits

SparkQA removed a comment on pull request #28961: URL: https://github.com/apache/spark/pull/28961#issuecomment-654072848 **[Test build #125045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125045/testReport)** for PR 28961 at commit

[GitHub] [spark] Ngone51 commented on a change in pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

Ngone51 commented on a change in pull request #28979: URL: https://github.com/apache/spark/pull/28979#discussion_r450273782 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala ## @@ -102,6 +105,28 @@ case class ScalaUDF( }

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-654282779 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28992: [SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

SparkQA removed a comment on pull request #28992: URL: https://github.com/apache/spark/pull/28992#issuecomment-654168934 **[Test build #125066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125066/testReport)** for PR 28992 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28992: [SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins removed a comment on pull request #28992: URL: https://github.com/apache/spark/pull/28992#issuecomment-654177755 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28992: [SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

AmplabJenkins removed a comment on pull request #28992: URL: https://github.com/apache/spark/pull/28992#issuecomment-654177748 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654185225 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

maropu commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654185609 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] cloud-fan commented on pull request #28629: [SPARK-31769][CORE] Add MDC support for driver threads

cloud-fan commented on pull request #28629: URL: https://github.com/apache/spark/pull/28629#issuecomment-654186160 > can we continue with Adding the Driver inherited MDC passing to Executor using setLocalProperties? SGTM

[GitHub] [spark] AmplabJenkins commented on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

AmplabJenkins commented on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654190804 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

AmplabJenkins removed a comment on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654190804 This is an automated message from the Apache Git Service. To respond to the message, please log on

<    1   2   3   4   5   6   7   8   9   10   >