[GitHub] [spark] AmplabJenkins removed a comment on pull request #28999: [MINOR][SQL] Re-use GetTimestamp in ParseToDate

AmplabJenkins removed a comment on pull request #28999: URL: https://github.com/apache/spark/pull/28999#issuecomment-654056075 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-654055697 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

AmplabJenkins removed a comment on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654056087 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654007651 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29006: [SPARK-32058][BUILD][SQL][test-hive1.2][FOLLOWUP] Set hadoop 2.7.4 for hive 1.2 profile

AmplabJenkins commented on pull request #29006: URL: https://github.com/apache/spark/pull/29006#issuecomment-654056389 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

AmplabJenkins commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-654056588 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

HeartSaVioR commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-654065873 Thanks for the links. That's the all what I'd like to see. > This is a redundant code of the package-private JDK counterpart. As the code not a perfect match even it

[GitHub] [spark] SparkQA commented on pull request #28961: [SPARK-32143][SQL] Prevent a skewed join from producing too many partition splits

SparkQA commented on pull request #28961: URL: https://github.com/apache/spark/pull/28961#issuecomment-654072848 **[Test build #125045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125045/testReport)** for PR 28961 at commit

[GitHub] [spark] SparkQA commented on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

SparkQA commented on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-654077152 **[Test build #125039 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125039/testReport)** for PR 28991 at commit

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

HeartSaVioR edited a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-654065873 Thanks for the links. That's all what I'd like to see. > This is a redundant code of the package-private JDK counterpart. As the code not a perfect match even

[GitHub] [spark] attilapiros commented on a change in pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

attilapiros commented on a change in pull request #28967: URL: https://github.com/apache/spark/pull/28967#discussion_r450045017 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExecutorDiskUtils.java ## @@ -45,34 +31,16 @@ public static File

[GitHub] [spark] SparkQA commented on pull request #28997: [SPARK-32172][CORE]Use createDirectory instead of mkdir

SparkQA commented on pull request #28997: URL: https://github.com/apache/spark/pull/28997#issuecomment-654083343 **[Test build #125048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125048/testReport)** for PR 28997 at commit

[GitHub] [spark] sidedoorleftroad commented on pull request #28997: [SPARK-32172][CORE]Use createDirectory instead of mkdir

sidedoorleftroad commented on pull request #28997: URL: https://github.com/apache/spark/pull/28997#issuecomment-654083284 The code has been modified. Submitting code for the first time is too nervous. Thanks a lot! @dongjoon-hyun @HeartSaVioR

[GitHub] [spark] HeartSaVioR commented on a change in pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

HeartSaVioR commented on a change in pull request #28967: URL: https://github.com/apache/spark/pull/28967#discussion_r450052572 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExecutorDiskUtils.java ## @@ -45,34 +31,16 @@ public static File

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28997: [SPARK-32172][CORE]Use createDirectory instead of mkdir

AmplabJenkins removed a comment on pull request #28997: URL: https://github.com/apache/spark/pull/28997#issuecomment-654083726 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28997: [SPARK-32172][CORE]Use createDirectory instead of mkdir

AmplabJenkins commented on pull request #28997: URL: https://github.com/apache/spark/pull/28997#issuecomment-654083726 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-654097454 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-654097454 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28912: [SPARK-32057][SQL][test-hive1.2][test-hadoop2.7] ExecuteStatement: cancel and close should not transiently ERROR

AmplabJenkins removed a comment on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-654097261 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

SparkQA commented on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654107835 **[Test build #125050 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125050/testReport)** for PR 28987 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

cloud-fan commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r450086968 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala ## @@ -259,6 +269,9 @@ class

[GitHub] [spark] cloud-fan commented on pull request #29006: [SPARK-32058][BUILD][SQL][test-hive1.2][FOLLOWUP] Set hadoop 2.7.4 for hive 1.2 profile

cloud-fan commented on pull request #29006: URL: https://github.com/apache/spark/pull/29006#issuecomment-654041468 If a PR wants to test hive 1.2, it must add both [test-hive1.2] and [test-hadoop2.7]? This is an automated

[GitHub] [spark] TJX2014 commented on a change in pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

TJX2014 commented on a change in pull request #28926: URL: https://github.com/apache/spark/pull/28926#discussion_r450010508 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala ## @@ -2612,6 +2612,11 @@ object Sequence

[GitHub] [spark] cloud-fan commented on a change in pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

cloud-fan commented on a change in pull request #28926: URL: https://github.com/apache/spark/pull/28926#discussion_r450009801 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala ## @@ -2612,6 +2612,11 @@ object

[GitHub] [spark] AmplabJenkins commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654043310 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #28912: [SPARK-32057][SQL][test-hive1.2][test-hadoop2.7] ExecuteStatement: cancel and close should not transiently ERROR

maropu commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-654050670 Ah, I see. we need the tag `[test-hadoop2.7]`, too... This is an automated message from the Apache Git Service.

[GitHub] [spark] SparkQA removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

SparkQA removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654024002 **[Test build #125029 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125029/testReport)** for PR 28683 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28912: [SPARK-32057][SQL][test-hive1.2][test-hadoop2.7] ExecuteStatement: cancel and close should not transiently ERROR

SparkQA removed a comment on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-654000969 **[Test build #125019 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125019/testReport)** for PR 28912 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

SparkQA removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-654033039 **[Test build #125032 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125032/testReport)** for PR 27428 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-653991792 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

SparkQA removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654009976 **[Test build #125024 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125024/testReport)** for PR 28808 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29006: [SPARK-32058][BUILD][SQL][test-hive1.2][FOLLOWUP] Set hadoop 2.7.4 for hive 1.2 profile

SparkQA removed a comment on pull request #29006: URL: https://github.com/apache/spark/pull/29006#issuecomment-653994905 **[Test build #125016 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125016/testReport)** for PR 29006 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654008236 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28999: [MINOR][SQL] Re-use GetTimestamp in ParseToDate

SparkQA removed a comment on pull request #28999: URL: https://github.com/apache/spark/pull/28999#issuecomment-654009975 **[Test build #125021 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125021/testReport)** for PR 28999 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28997: [SPARK-32172][CORE]Use createDirectory instead of mkdir

SparkQA removed a comment on pull request #28997: URL: https://github.com/apache/spark/pull/28997#issuecomment-653953206 **[Test build #124981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124981/testReport)** for PR 28997 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-654054494 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29007: [SPARK-XXXXX][SQL][DOCS] consistency in argument naming for time functions

SparkQA removed a comment on pull request #29007: URL: https://github.com/apache/spark/pull/29007#issuecomment-654028341 **[Test build #125030 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125030/testReport)** for PR 29007 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654055192 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29004: [SPARK-32178][TESTS] Disable test-dependencies.sh from Jenkins jobs

SparkQA removed a comment on pull request #29004: URL: https://github.com/apache/spark/pull/29004#issuecomment-653988306 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

SparkQA removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-653959224 **[Test build #124985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124985/testReport)** for PR 28904 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

SparkQA removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-653992215 **[Test build #125013 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125013/testReport)** for PR 27983 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-653951023 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

SparkQA removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654047169 **[Test build #125035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125035/testReport)** for PR 28988 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

SparkQA removed a comment on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654009977 **[Test build #125022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125022/testReport)** for PR 28996 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654054483 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654055192 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-654054501 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

SparkQA commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654054349 **[Test build #125029 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125029/testReport)** for PR 28683 at commit

[GitHub] [spark] dilipbiswal commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

dilipbiswal commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-654054782 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

SparkQA removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-654012820 **[Test build #125026 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125026/testReport)** for PR 28998 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

SparkQA removed a comment on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-653980498 **[Test build #124999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124999/testReport)** for PR 29002 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654054472 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

SparkQA removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-654047198 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

SparkQA removed a comment on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-654010078 **[Test build #125025 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125025/testReport)** for PR 28676 at commit

[GitHub] [spark] SparkQA commented on pull request #28963: [SPARK-32145][SQL][test-hive1.2][test-hadoop2.7] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error mess

SparkQA commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-654062701 **[Test build #125043 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125043/testReport)** for PR 28963 at commit

[GitHub] [spark] HeartSaVioR commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

HeartSaVioR commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r450042481 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala ## @@ -259,6 +269,9 @@

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-654081005 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28999: [MINOR][SQL] Re-use GetTimestamp in ParseToDate

AmplabJenkins removed a comment on pull request #28999: URL: https://github.com/apache/spark/pull/28999#issuecomment-654080398 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] yaooqinn commented on pull request #28963: [SPARK-32145][SQL][test-hive1.2][test-hadoop2.7] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error mes

yaooqinn commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-654105199 kindly ping @juliuszsompolski @cloud-fan thanks This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

SparkQA removed a comment on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654093081 **[Test build #125050 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125050/testReport)** for PR 28987 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

AmplabJenkins commented on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654108351 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to fill the map index when the event logs from the old Spark version

SparkQA commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-654123803 **[Test build #125058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125058/testReport)** for PR 28965 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to fill the map index when the event logs from the old Spark version

AmplabJenkins commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-654124343 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-654141703 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29009: [SPARK-32193][SQL]update migrate guide docs on regexp function

AmplabJenkins removed a comment on pull request #29009: URL: https://github.com/apache/spark/pull/29009#issuecomment-654140900 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

AmplabJenkins removed a comment on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654148412 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654148531 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28987: [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

AmplabJenkins commented on pull request #28987: URL: https://github.com/apache/spark/pull/28987#issuecomment-654148412 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

AmplabJenkins commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654157398 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654157384 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

AmplabJenkins removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654157398 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654157015 **[Test build #125065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125065/testReport)** for PR 27366 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

cloud-fan commented on a change in pull request #27428: URL: https://github.com/apache/spark/pull/27428#discussion_r450007512 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala ## @@ -148,24 +204,105 @@ object

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654044546 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654044546 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29008: [SPARK-31579][SQL] replaced floorDiv to Div

AmplabJenkins removed a comment on pull request #29008: URL: https://github.com/apache/spark/pull/29008#issuecomment-654042478 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #29008: [SPARK-31579][SQL] replaced floorDiv to Div

AmplabJenkins commented on pull request #29008: URL: https://github.com/apache/spark/pull/29008#issuecomment-654044389 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

viirya commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654044476 retest this please... This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

AmplabJenkins removed a comment on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-654049253 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

SparkQA commented on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-654048965 **[Test build #125034 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125034/testReport)** for PR 28964 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

AmplabJenkins removed a comment on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-654049241 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

AmplabJenkins commented on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-654049241 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

SparkQA removed a comment on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-654037792 **[Test build #125034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125034/testReport)** for PR 28964 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29003: [SPARK-32177][WEBUI] Remove the weird line from near the Spark logo on mouseover in the WebUI

AmplabJenkins removed a comment on pull request #29003: URL: https://github.com/apache/spark/pull/29003#issuecomment-654048895 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

SparkQA commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-654054385 **[Test build #125024 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125024/testReport)** for PR 28808 at commit

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654054369 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-654054494 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-654054354 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

SparkQA commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-654054386 **[Test build #125032 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125032/testReport)** for PR 27428 at commit

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-654054348 **[Test build #125026 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125026/testReport)** for PR 28998 at commit

[GitHub] [spark] SparkQA commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

SparkQA commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-654054383 **[Test build #124999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124999/testReport)** for PR 29002 at commit

[GitHub] [spark] SparkQA commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

SparkQA commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654054352 **[Test build #125035 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125035/testReport)** for PR 28988 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654054472 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-654054389 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

SparkQA commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-654054368 **[Test build #125025 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125025/testReport)** for PR 28676 at commit

[GitHub] [spark] SparkQA commented on pull request #29006: [SPARK-32058][BUILD][SQL][test-hive1.2][FOLLOWUP] Set hadoop 2.7.4 for hive 1.2 profile

SparkQA commented on pull request #29006: URL: https://github.com/apache/spark/pull/29006#issuecomment-654054355 **[Test build #125016 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125016/testReport)** for PR 29006 at commit

[GitHub] [spark] SparkQA commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

SparkQA commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-654054397 **[Test build #124985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124985/testReport)** for PR 28904 at commit

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-654054370 **[Test build #125013 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125013/testReport)** for PR 27983 at commit

[GitHub] [spark] SparkQA commented on pull request #28912: [SPARK-32057][SQL][test-hive1.2][test-hadoop2.7] ExecuteStatement: cancel and close should not transiently ERROR

SparkQA commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-654054351 **[Test build #125019 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125019/testReport)** for PR 28912 at commit

[GitHub] [spark] SparkQA commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

SparkQA commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654054390 **[Test build #125022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125022/testReport)** for PR 28996 at commit

<    1   2   3   4   5   6   7   8   9   10   >