[GitHub] [spark] SparkQA removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660315845 **[Test build #126073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126073/testReport)** for PR 28708 at commit [`9d210f5`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29151: [SPARK-29909][BUILD] Use python3 in build scripts

AmplabJenkins commented on pull request #29151: URL: https://github.com/apache/spark/pull/29151#issuecomment-660380369 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660380086 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660380089 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126

[GitHub] [spark] SparkQA commented on pull request #29151: [SPARK-29909][BUILD] Use python3 in build scripts

SparkQA commented on pull request #29151: URL: https://github.com/apache/spark/pull/29151#issuecomment-660379985 **[Test build #126071 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126071/testReport)** for PR 29151 at commit [`ce84970`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-660378942 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-660378942 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] holdenk commented on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

holdenk commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-660378889 This chunk of code is pretty standalone and theres no conflicts so I didn't feel it necessary, it's a judgement call and Jenkins is in the middle of an upgrade. --

[GitHub] [spark] holdenk commented on pull request #29151: [SPARK-29909][BUILD] Use python3 in build scripts

holdenk commented on pull request #29151: URL: https://github.com/apache/spark/pull/29151#issuecomment-660379312 LGTM, just ran into needing this ~30 minutes ago on one of my laptops :) This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

AmplabJenkins removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-660378948 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126

[GitHub] [spark] SparkQA removed a comment on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA removed a comment on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-660262080 **[Test build #126069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126069/testReport)** for PR 29101 at commit [`d37c21c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29101: [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions

SparkQA commented on pull request #29101: URL: https://github.com/apache/spark/pull/29101#issuecomment-660378627 **[Test build #126069 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126069/testReport)** for PR 29101 at commit [`d37c21c`](https://github.co

[GitHub] [spark] maropu commented on pull request #29143: [SPARK-32344][SQL] Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

maropu commented on pull request #29143: URL: https://github.com/apache/spark/pull/29143#issuecomment-660376359 Ah, I see. Seems like I need to update the golden files.. This is an automated message from the Apache Git Servic

[GitHub] [spark] jiangxb1987 commented on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

jiangxb1987 commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-660376404 shouldn't we trigger another round of jenkins test before merging this? This is an automated message fro

[GitHub] [spark] holdenk commented on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

holdenk commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-660375991 Merged to the development branch! This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [spark] huaxingao commented on pull request #29056: [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs

huaxingao commented on pull request #29056: URL: https://github.com/apache/spark/pull/29056#issuecomment-660375808 also edit the menu-sql.yaml to update the sidebar menu? This is an automated message from the Apache Git Servi

[GitHub] [spark] asfgit closed pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

asfgit closed pull request #28619: URL: https://github.com/apache/spark/pull/28619 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] huaxingao commented on a change in pull request #29056: [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs

huaxingao commented on a change in pull request #29056: URL: https://github.com/apache/spark/pull/29056#discussion_r456706603 ## File path: docs/sql-ref-syntax-ddl-create-table-hiveformat.md ## @@ -36,6 +36,14 @@ CREATE [ EXTERNAL ] TABLE [ IF NOT EXISTS ] table_identifier

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29008: [SPARK-31579][SQL] replaced floorDiv to Div

AmplabJenkins removed a comment on pull request #29008: URL: https://github.com/apache/spark/pull/29008#issuecomment-660370684 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29008: [SPARK-31579][SQL] replaced floorDiv to Div

AmplabJenkins commented on pull request #29008: URL: https://github.com/apache/spark/pull/29008#issuecomment-660370684 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29008: [SPARK-31579][SQL] replaced floorDiv to Div

SparkQA commented on pull request #29008: URL: https://github.com/apache/spark/pull/29008#issuecomment-660370261 **[Test build #126066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126066/testReport)** for PR 29008 at commit [`02cfa89`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29008: [SPARK-31579][SQL] replaced floorDiv to Div

SparkQA removed a comment on pull request #29008: URL: https://github.com/apache/spark/pull/29008#issuecomment-660228945 **[Test build #126066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126066/testReport)** for PR 29008 at commit [`02cfa89`](https://gi

[GitHub] [spark] holdenk commented on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

holdenk commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-660368416 This looks good to me, I'm excited for us to have this improvement. Thanks for working on this and thanks to all the folks who took the time to review it. Sorry I have not been

[GitHub] [spark] holdenk commented on pull request #25870: [SPARK-27936][K8S] Support python deps

holdenk commented on pull request #25870: URL: https://github.com/apache/spark/pull/25870#issuecomment-660366866 I'm also back after my motorcycle crash last year, let me know when it's up to date and I'd be happy to take another look. Thanks for sticking with this. --

[GitHub] [spark] holdenk commented on a change in pull request #29014: [SPARK-32199][SPARK-32198] Reduce job failures during decommissioning

holdenk commented on a change in pull request #29014: URL: https://github.com/apache/spark/pull/29014#discussion_r456701507 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorLossReason.scala ## @@ -54,9 +54,14 @@ private [spark] object LossReasonPending exte

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660363827 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] holdenk commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

holdenk commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660364460 sounds good, I'll work on resolving the test issues. @jiangxb1987 if you want to make the follow up issues under the decommissioning umbrella issue it'll make tracking it easier

[GitHub] [spark] AmplabJenkins commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660363823 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660363823 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660363807 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/30689/ ---

[GitHub] [spark] Fokko commented on a change in pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

Fokko commented on a change in pull request #29122: URL: https://github.com/apache/spark/pull/29122#discussion_r456688795 ## File path: python/pyspark/sql/functions.py ## @@ -2440,7 +2442,7 @@ def from_json(col, schema, options={}): @since(2.1) -def to_json(col, options={}

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660353441 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660353428 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660353405 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/30686/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660353428 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660353199 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/30689/ -

[GitHub] [spark] srowen commented on a change in pull request #29121: [SPARK-32319][PYSPARK] Remove unused imports

srowen commented on a change in pull request #29121: URL: https://github.com/apache/spark/pull/29121#discussion_r456687430 ## File path: python/pyspark/ml/tests/test_stat.py ## @@ -40,7 +40,7 @@ def test_chisquaretest(self): if __name__ == "__main__": -from pyspark.ml.

[GitHub] [spark] AmplabJenkins commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

AmplabJenkins commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-660348522 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-660348522 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

SparkQA removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-660200667 **[Test build #126062 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126062/testReport)** for PR 29067 at commit [`cb29e47`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

SparkQA commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-660347743 **[Test build #126062 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126062/testReport)** for PR 29067 at commit [`cb29e47`](https://github.co

[GitHub] [spark] Fokko commented on a change in pull request #29121: [SPARK-32319][PYSPARK] Remove unused imports

Fokko commented on a change in pull request #29121: URL: https://github.com/apache/spark/pull/29121#discussion_r456679942 ## File path: python/pyspark/mllib/classification.py ## @@ -102,6 +102,7 @@ class LogisticRegressionModel(LinearClassificationModel): in Multinomial

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29104: [SPARK-32290][SQL] NotInSubquery SingleColumn Optimize

AmplabJenkins removed a comment on pull request #29104: URL: https://github.com/apache/spark/pull/29104#issuecomment-660345615 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29104: [SPARK-32290][SQL] NotInSubquery SingleColumn Optimize

AmplabJenkins commented on pull request #29104: URL: https://github.com/apache/spark/pull/29104#issuecomment-660345615 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29104: [SPARK-32290][SQL] NotInSubquery SingleColumn Optimize

SparkQA commented on pull request #29104: URL: https://github.com/apache/spark/pull/29104#issuecomment-660345247 **[Test build #126064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126064/testReport)** for PR 29104 at commit [`9e03d7e`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

AmplabJenkins removed a comment on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-660344698 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126

[GitHub] [spark] SparkQA removed a comment on pull request #29104: [SPARK-32290][SQL] NotInSubquery SingleColumn Optimize

SparkQA removed a comment on pull request #29104: URL: https://github.com/apache/spark/pull/29104#issuecomment-660210258 **[Test build #126064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126064/testReport)** for PR 29104 at commit [`9e03d7e`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660345179 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/30686/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

AmplabJenkins removed a comment on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-660344690 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

AmplabJenkins commented on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-660344690 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

SparkQA commented on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-660343826 **[Test build #126060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126060/testReport)** for PR 29089 at commit [`2157a71`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

SparkQA removed a comment on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-660195822 **[Test build #126060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126060/testReport)** for PR 29089 at commit [`2157a71`](https://gi

[GitHub] [spark] jiangxb1987 commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

jiangxb1987 commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660341681 We can merge it, I may create some followup tickets but I don't want to block the PR for longer. This is an

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660340659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126

[GitHub] [spark] SparkQA removed a comment on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

SparkQA removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660331222 **[Test build #126074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126074/testReport)** for PR 29145 at commit [`5c4c177`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660340653 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

SparkQA commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660340630 **[Test build #126074 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126074/testReport)** for PR 29145 at commit [`5c4c177`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660340653 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] holdenk commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

holdenk commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660340513 Hey folks it's the end of the workweek. I just want to check in and see if people believe this PR is still under active discussion, or if once it resolves in Jenkins it's ok to

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660340271 **[Test build #126076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126076/testReport)** for PR 28708 at commit [`2467732`](https://github.com

[GitHub] [spark] imback82 commented on pull request #29127: [SPARK-32327][SQL] Introduce UnresolvedTableOrPermanentView for commands that support a table and permanent view, but not a temporary view

imback82 commented on pull request #29127: URL: https://github.com/apache/spark/pull/29127#issuecomment-660338281 > I think we should fail the temp view creating instead of silently ignoring the table properties when specified. @imback82 can you fix this first? Will do. ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

AmplabJenkins removed a comment on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-660337643 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

AmplabJenkins commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-660337643 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

SparkQA commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-660337252 **[Test build #126075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126075/testReport)** for PR 28676 at commit [`9caeecd`](https://github.com

[GitHub] [spark] imback82 commented on a change in pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

imback82 commented on a change in pull request #28676: URL: https://github.com/apache/spark/pull/28676#discussion_r456671815 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2665,6 +2665,17 @@ object SQLConf { .checkValue(_ >

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29130: [SPARK-32330][SQL] Preserve shuffled hash join build side partitioning

AmplabJenkins removed a comment on pull request #29130: URL: https://github.com/apache/spark/pull/29130#issuecomment-660332843 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29130: [SPARK-32330][SQL] Preserve shuffled hash join build side partitioning

AmplabJenkins removed a comment on pull request #29130: URL: https://github.com/apache/spark/pull/29130#issuecomment-660332838 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29130: [SPARK-32330][SQL] Preserve shuffled hash join build side partitioning

AmplabJenkins commented on pull request #29130: URL: https://github.com/apache/spark/pull/29130#issuecomment-660332838 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29130: [SPARK-32330][SQL] Preserve shuffled hash join build side partitioning

SparkQA commented on pull request #29130: URL: https://github.com/apache/spark/pull/29130#issuecomment-660332105 **[Test build #126058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126058/testReport)** for PR 29130 at commit [`f9479b6`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29130: [SPARK-32330][SQL] Preserve shuffled hash join build side partitioning

SparkQA removed a comment on pull request #29130: URL: https://github.com/apache/spark/pull/29130#issuecomment-660186821 **[Test build #126058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126058/testReport)** for PR 29130 at commit [`f9479b6`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins removed a comment on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-660331182 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660331651 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins removed a comment on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-660331178 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660331651 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

AmplabJenkins commented on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-660331178 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

SparkQA commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660331222 **[Test build #126074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126074/testReport)** for PR 29145 at commit [`5c4c177`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

SparkQA removed a comment on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-660191253 **[Test build #126059 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126059/testReport)** for PR 29135 at commit [`7127744`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29135: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

SparkQA commented on pull request #29135: URL: https://github.com/apache/spark/pull/29135#issuecomment-660330664 **[Test build #126059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126059/testReport)** for PR 29135 at commit [`7127744`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

SparkQA removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660315847 **[Test build #126072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126072/testReport)** for PR 29145 at commit [`0ea0ef7`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660326840 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

SparkQA commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660326646 **[Test build #126072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126072/testReport)** for PR 29145 at commit [`0ea0ef7`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660326840 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660315845 **[Test build #126073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126073/testReport)** for PR 28708 at commit [`9d210f5`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

SparkQA commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660315847 **[Test build #126072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126072/testReport)** for PR 29145 at commit [`0ea0ef7`](https://github.com

[GitHub] [spark] shaneknapp commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

shaneknapp commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660315331 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29151: [SPARK-29909][BUILD] Use python3 in build scripts

AmplabJenkins removed a comment on pull request #29151: URL: https://github.com/apache/spark/pull/29151#issuecomment-660314382 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins removed a comment on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660314550 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-660314436 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29145: [WIP][SPARK-32346][SQL] Support filters pushdown in Avro datasource

AmplabJenkins commented on pull request #29145: URL: https://github.com/apache/spark/pull/29145#issuecomment-660314550 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-660314436 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-660314434 **[Test build #126070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126070/testReport)** for PR 29020 at commit [`895f5fd`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29151: [SPARK-29909][BUILD] Use python3 in build scripts

SparkQA commented on pull request #29151: URL: https://github.com/apache/spark/pull/29151#issuecomment-660314401 **[Test build #126071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126071/testReport)** for PR 29151 at commit [`ce84970`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29151: [SPARK-29909][BUILD] Use python3 in build scripts

AmplabJenkins commented on pull request #29151: URL: https://github.com/apache/spark/pull/29151#issuecomment-660314382 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] srowen opened a new pull request #29151: [SPARK-29909][BUILD] Use python3 in build scripts

srowen opened a new pull request #29151: URL: https://github.com/apache/spark/pull/29151 ### What changes were proposed in this pull request? Use `/usr/bin/env python3` consistently instead of `/usr/bin/env python` in build scripts, to reliably select Python 3. ### Why are the

[GitHub] [spark] holdenk commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

holdenk commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-660308966 Looks like my CR follow up caused an issue in the shuffle part, I think it's where I was unifying the types. Ran the storage tests locally but forgot to also check all of the sh

[GitHub] [spark] imback82 commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

imback82 commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-660304613 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] viirya commented on a change in pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

viirya commented on a change in pull request #28676: URL: https://github.com/apache/spark/pull/28676#discussion_r456632968 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2665,6 +2665,17 @@ object SQLConf { .checkValue(_ > 0,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29143: [SPARK-32344][SQL] Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

AmplabJenkins removed a comment on pull request #29143: URL: https://github.com/apache/spark/pull/29143#issuecomment-660295123 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29143: [SPARK-32344][SQL] Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

AmplabJenkins removed a comment on pull request #29143: URL: https://github.com/apache/spark/pull/29143#issuecomment-660295105 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #29143: [SPARK-32344][SQL] Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

SparkQA removed a comment on pull request #29143: URL: https://github.com/apache/spark/pull/29143#issuecomment-660152659 **[Test build #126056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126056/testReport)** for PR 29143 at commit [`a83de82`](https://gi

<    1   2   3   4   5   6   7   8   >