[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-640028005 **[Test build #123588 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123588/testReport)** for PR 28593 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27331: [SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

AmplabJenkins removed a comment on pull request #27331: URL: https://github.com/apache/spark/pull/27331#issuecomment-640010817 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27331: [SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

AmplabJenkins commented on pull request #27331: URL: https://github.com/apache/spark/pull/27331#issuecomment-640010817 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-640009891 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

AmplabJenkins commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-640009891 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements

maropu commented on a change in pull request #27246: URL: https://github.com/apache/spark/pull/27246#discussion_r436249425 ## File path: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java ## @@ -703,6 +702,7 @@ public boolean hasNext() {

[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-640009693 **[Test build #123588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123588/testReport)** for PR 28593 at commit

[GitHub] [spark] gengliangwang closed pull request #28733: [SPARK-31705][SQL] Push more possible predicates through Join via CNF conversion

gengliangwang closed pull request #28733: URL: https://github.com/apache/spark/pull/28733 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] gengliangwang commented on a change in pull request #28741: [WIP][SPARK-31919][SQL] Push down more predicates through Join

gengliangwang commented on a change in pull request #28741: URL: https://github.com/apache/spark/pull/28741#discussion_r436249183 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PushPredicateThroughJoin.scala ## @@ -0,0 +1,248 @@ +/* + *

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28741: [WIP][SPARK-31919][SQL] Push down more predicates through Join

AmplabJenkins removed a comment on pull request #28741: URL: https://github.com/apache/spark/pull/28741#issuecomment-640008576 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28741: [WIP][SPARK-31919][SQL] Push down more predicates through Join

AmplabJenkins commented on pull request #28741: URL: https://github.com/apache/spark/pull/28741#issuecomment-640008576 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28741: [WIP][SPARK-31919][SQL] Push down more predicates through Join

SparkQA commented on pull request #28741: URL: https://github.com/apache/spark/pull/28741#issuecomment-640008330 **[Test build #123587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123587/testReport)** for PR 28741 at commit

[GitHub] [spark] gengliangwang commented on pull request #28733: [SPARK-31705][SQL] Push more possible predicates through Join via CNF conversion

gengliangwang commented on pull request #28733: URL: https://github.com/apache/spark/pull/28733#issuecomment-640007623 I find a simpler solution and create https://github.com/apache/spark/pull/28741. Close this one now.

[GitHub] [spark] gengliangwang commented on pull request #28741: [SPARK-31919][SQL] Push down more predicates through Join

gengliangwang commented on pull request #28741: URL: https://github.com/apache/spark/pull/28741#issuecomment-640007372 I will add more test cases. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] gengliangwang opened a new pull request #28741: [SPARK-31919][SQL] Push down more predicates through Join

gengliangwang opened a new pull request #28741: URL: https://github.com/apache/spark/pull/28741 ### What changes were proposed in this pull request? Currently, in the rule`PushPredicateThroughJoin`, if the condition predicate of `Or` operator can't be entirely pushed down,

[GitHub] [spark] HyukjinKwon commented on pull request #28740: [SPARK-31903][SQL][PYSPARK][2.4] Fix toPandas with Arrow enabled to show metrics in Query UI.

HyukjinKwon commented on pull request #28740: URL: https://github.com/apache/spark/pull/28740#issuecomment-640007031 cc @holdenk FYI This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] HyukjinKwon closed pull request #28740: [SPARK-31903][SQL][PYSPARK][2.4] Fix toPandas with Arrow enabled to show metrics in Query UI.

HyukjinKwon closed pull request #28740: URL: https://github.com/apache/spark/pull/28740 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #28740: [SPARK-31903][SQL][PYSPARK][2.4] Fix toPandas with Arrow enabled to show metrics in Query UI.

HyukjinKwon commented on pull request #28740: URL: https://github.com/apache/spark/pull/28740#issuecomment-640006886 Merged to branch-2.4. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon closed pull request #28739: [MINOR][SS][DOCS] fileNameOnly parameter description re-unite

HyukjinKwon closed pull request #28739: URL: https://github.com/apache/spark/pull/28739 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #28739: [MINOR][SS][DOCS] fileNameOnly parameter description re-unite

HyukjinKwon commented on pull request #28739: URL: https://github.com/apache/spark/pull/28739#issuecomment-640006744 Merged to master and branch-3.0. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28733: [SPARK-31705][SQL] Push more possible predicates through Join via CNF conversion

AmplabJenkins removed a comment on pull request #28733: URL: https://github.com/apache/spark/pull/28733#issuecomment-63182 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28733: [SPARK-31705][SQL] Push more possible predicates through Join via CNF conversion

AmplabJenkins commented on pull request #28733: URL: https://github.com/apache/spark/pull/28733#issuecomment-63182 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28733: [SPARK-31705][SQL] Push more possible predicates through Join via CNF conversion

SparkQA removed a comment on pull request #28733: URL: https://github.com/apache/spark/pull/28733#issuecomment-639960706 **[Test build #123585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123585/testReport)** for PR 28733 at commit

[GitHub] [spark] SparkQA commented on pull request #28733: [SPARK-31705][SQL] Push more possible predicates through Join via CNF conversion

SparkQA commented on pull request #28733: URL: https://github.com/apache/spark/pull/28733#issuecomment-639998806 **[Test build #123585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123585/testReport)** for PR 28733 at commit

[GitHub] [spark] attilapiros commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

attilapiros commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-639990452 It is in the `unit-tests.log` on the jenkins too (this is the appender target see

<    1   2