[GitHub] [spark] AmplabJenkins commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852547488 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43703/ --

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852547459 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43703/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

SparkQA commented on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852546716 **[Test build #139186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139186/testReport)** for PR 32592 at commit

[GitHub] [spark] SparkQA commented on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

SparkQA commented on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852544933 **[Test build #139185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139185/testReport)** for PR 32592 at commit

[GitHub] [spark] xinrong-databricks commented on a change in pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

xinrong-databricks commented on a change in pull request #32592: URL: https://github.com/apache/spark/pull/32592#discussion_r643542406 ## File path: python/pyspark/pandas/tests/indexes/test_base.py ## @@ -1254,31 +1254,32 @@ def test_monotonic(self):

[GitHub] [spark] xinrong-databricks commented on a change in pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

xinrong-databricks commented on a change in pull request #32592: URL: https://github.com/apache/spark/pull/32592#discussion_r643542210 ## File path: python/pyspark/pandas/data_type_ops/base.py ## @@ -87,7 +92,6 @@ def __init__(self, dtype: Dtype, spark_type: DataType):

[GitHub] [spark] SparkQA removed a comment on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

SparkQA removed a comment on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852541064 **[Test build #139184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139184/testReport)** for PR 32592 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

AmplabJenkins removed a comment on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852541535 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139184/

[GitHub] [spark] SparkQA commented on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

SparkQA commented on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852541518 **[Test build #139184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139184/testReport)** for PR 32592 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

AmplabJenkins commented on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852541535 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139184/ -- This

[GitHub] [spark] SparkQA commented on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

SparkQA commented on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852541064 **[Test build #139184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139184/testReport)** for PR 32592 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins removed a comment on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852539704 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139183/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

AmplabJenkins removed a comment on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852539702 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139182/

[GitHub] [spark] AmplabJenkins commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852539704 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139183/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

AmplabJenkins commented on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852539702 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139182/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

SparkQA removed a comment on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852440323 **[Test build #139182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139182/testReport)** for PR 32735 at commit

[GitHub] [spark] SparkQA commented on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

SparkQA commented on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852536431 **[Test build #139182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139182/testReport)** for PR 32735 at commit

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852531060 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43703/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA removed a comment on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852476764 **[Test build #139183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139183/testReport)** for PR 32698 at commit

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852522355 **[Test build #139183 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139183/testReport)** for PR 32698 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

AmplabJenkins removed a comment on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852492052 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43702/

[GitHub] [spark] AmplabJenkins commented on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

AmplabJenkins commented on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852492052 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43702/ --

[GitHub] [spark] SparkQA commented on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

SparkQA commented on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852491939 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43702/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852476764 **[Test build #139183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139183/testReport)** for PR 32698 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32727: [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

AmplabJenkins removed a comment on pull request #32727: URL: https://github.com/apache/spark/pull/32727#issuecomment-852474616 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139157/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

AmplabJenkins removed a comment on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852474620 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139180/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32721: [SPARK-35077][SQL] Migrate to transformWithPruning for leftover optimizer rules

AmplabJenkins removed a comment on pull request #32721: URL: https://github.com/apache/spark/pull/32721#issuecomment-852474633 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139175/

[GitHub] [spark] AmplabJenkins commented on pull request #32721: [SPARK-35077][SQL] Migrate to transformWithPruning for leftover optimizer rules

AmplabJenkins commented on pull request #32721: URL: https://github.com/apache/spark/pull/32721#issuecomment-852474633 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139175/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32727: [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

AmplabJenkins commented on pull request #32727: URL: https://github.com/apache/spark/pull/32727#issuecomment-852474616 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139157/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

AmplabJenkins commented on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852474620 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139180/ -- This

[GitHub] [spark] otterc commented on a change in pull request #30691: [SPARK-32920][SHUFFLE] Finalization of Shuffle push/merge with Push based shuffle and preparation step for the reduce stage

otterc commented on a change in pull request #30691: URL: https://github.com/apache/spark/pull/30691#discussion_r643501449 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1743,6 +1762,10 @@ private[spark] class DAGScheduler( }

[GitHub] [spark] otterc commented on a change in pull request #30691: [SPARK-32920][SHUFFLE] Finalization of Shuffle push/merge with Push based shuffle and preparation step for the reduce stage

otterc commented on a change in pull request #30691: URL: https://github.com/apache/spark/pull/30691#discussion_r643429058 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1743,6 +1762,10 @@ private[spark] class DAGScheduler( }

[GitHub] [spark] viirya commented on a change in pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

viirya commented on a change in pull request #32735: URL: https://github.com/apache/spark/pull/32735#discussion_r643496109 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/HigherOrderFunctionsSuite.scala ## @@ -735,4 +736,100 @@ class

[GitHub] [spark] SparkQA commented on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

SparkQA commented on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852461362 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43702/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

SparkQA removed a comment on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852368921 **[Test build #139180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139180/testReport)** for PR 32388 at commit

[GitHub] [spark] SparkQA commented on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

SparkQA commented on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852458372 **[Test build #139180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139180/testReport)** for PR 32388 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #32727: [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

dongjoon-hyun commented on pull request #32727: URL: https://github.com/apache/spark/pull/32727#issuecomment-852456128 For branch-3.1, I will make a new PR for backporting. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] dongjoon-hyun closed pull request #32727: [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

dongjoon-hyun closed pull request #32727: URL: https://github.com/apache/spark/pull/32727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] dongjoon-hyun commented on pull request #32727: [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

dongjoon-hyun commented on pull request #32727: URL: https://github.com/apache/spark/pull/32727#issuecomment-852454568 Thank you so much, @holdenk ! Merged to master for Apache Spark 3.2.0. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #32727: [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

SparkQA removed a comment on pull request #32727: URL: https://github.com/apache/spark/pull/32727#issuecomment-852102632 **[Test build #139157 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139157/testReport)** for PR 32727 at commit

[GitHub] [spark] SparkQA commented on pull request #32727: [SPARK-35589][CORE] BlockManagerMasterEndpoint should not ignore index-only shuffle file during updating

SparkQA commented on pull request #32727: URL: https://github.com/apache/spark/pull/32727#issuecomment-852451930 **[Test build #139157 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139157/testReport)** for PR 32727 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32721: [SPARK-35077][SQL] Migrate to transformWithPruning for leftover optimizer rules

SparkQA removed a comment on pull request #32721: URL: https://github.com/apache/spark/pull/32721#issuecomment-852286966 **[Test build #139175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139175/testReport)** for PR 32721 at commit

[GitHub] [spark] SparkQA commented on pull request #32721: [SPARK-35077][SQL] Migrate to transformWithPruning for leftover optimizer rules

SparkQA commented on pull request #32721: URL: https://github.com/apache/spark/pull/32721#issuecomment-852451536 **[Test build #139175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139175/testReport)** for PR 32721 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

AmplabJenkins removed a comment on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852448441 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43699/

[GitHub] [spark] AmplabJenkins commented on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

AmplabJenkins commented on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852448441 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43699/ --

[GitHub] [spark] SparkQA commented on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

SparkQA commented on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852448420 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43699/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

SparkQA commented on pull request #32735: URL: https://github.com/apache/spark/pull/32735#issuecomment-852440323 **[Test build #139182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139182/testReport)** for PR 32735 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32732: [SPARK-35600][TESTS] Move Set command related test cases to SetCommandSuite

AmplabJenkins removed a comment on pull request #32732: URL: https://github.com/apache/spark/pull/32732#issuecomment-852439927 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139174/

[GitHub] [spark] AmplabJenkins commented on pull request #32732: [SPARK-35600][TESTS] Move Set command related test cases to SetCommandSuite

AmplabJenkins commented on pull request #32732: URL: https://github.com/apache/spark/pull/32732#issuecomment-852439927 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139174/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32725: [SPARK-35595][TESTS] Support multiple loggers in testing method withLogAppender

AmplabJenkins removed a comment on pull request #32725: URL: https://github.com/apache/spark/pull/32725#issuecomment-852438777 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139178/

[GitHub] [spark] SparkQA removed a comment on pull request #32732: [SPARK-35600][TESTS] Move Set command related test cases to SetCommandSuite

SparkQA removed a comment on pull request #32732: URL: https://github.com/apache/spark/pull/32732#issuecomment-852286806 **[Test build #139174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139174/testReport)** for PR 32732 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

AmplabJenkins removed a comment on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-852438775 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139172/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

AmplabJenkins removed a comment on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852438773 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43698/

[GitHub] [spark] SparkQA commented on pull request #32732: [SPARK-35600][TESTS] Move Set command related test cases to SetCommandSuite

SparkQA commented on pull request #32732: URL: https://github.com/apache/spark/pull/32732#issuecomment-852438804 **[Test build #139174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139174/testReport)** for PR 32732 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32725: [SPARK-35595][TESTS] Support multiple loggers in testing method withLogAppender

AmplabJenkins commented on pull request #32725: URL: https://github.com/apache/spark/pull/32725#issuecomment-852438777 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139178/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

AmplabJenkins commented on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852438773 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43698/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

AmplabJenkins commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-852438775 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139172/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32725: [SPARK-35595][TESTS] Support multiple loggers in testing method withLogAppender

SparkQA removed a comment on pull request #32725: URL: https://github.com/apache/spark/pull/32725#issuecomment-852339936 **[Test build #139178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139178/testReport)** for PR 32725 at commit

[GitHub] [spark] SparkQA commented on pull request #32725: [SPARK-35595][TESTS] Support multiple loggers in testing method withLogAppender

SparkQA commented on pull request #32725: URL: https://github.com/apache/spark/pull/32725#issuecomment-85242 **[Test build #139178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139178/testReport)** for PR 32725 at commit

[GitHub] [spark] viirya opened a new pull request #32735: [SPARK-35580][SQL] Implement canonicalized method for HigherOrderFunction

viirya opened a new pull request #32735: URL: https://github.com/apache/spark/pull/32735 ### What changes were proposed in this pull request? This patch implements `canonicalized` method for `HigherOrderFunction`. Basically it canonicalizes the name of all

[GitHub] [spark] SparkQA commented on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

SparkQA commented on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852418160 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43698/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA removed a comment on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-852240807 **[Test build #139172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139172/testReport)** for PR 32558 at commit

[GitHub] [spark] SparkQA commented on pull request #32558: [SPARK-34953][CORE][SQL] Add the code change for adding the DateType in the infer schema while reading in CSV and JSON

SparkQA commented on pull request #32558: URL: https://github.com/apache/spark/pull/32558#issuecomment-852416174 **[Test build #139172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139172/testReport)** for PR 32558 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins removed a comment on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852412465 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43700/

[GitHub] [spark] AmplabJenkins commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852412465 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43700/ --

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852412434 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43700/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

AmplabJenkins removed a comment on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852408281 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139179/

[GitHub] [spark] AmplabJenkins commented on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

AmplabJenkins commented on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852408281 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139179/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

SparkQA removed a comment on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852368589 **[Test build #139179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139179/testReport)** for PR 32734 at commit

[GitHub] [spark] SparkQA commented on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

SparkQA commented on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852407828 **[Test build #139179 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139179/testReport)** for PR 32734 at commit

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852407741 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43700/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins removed a comment on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852405636 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43701/

[GitHub] [spark] AmplabJenkins commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852405636 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43701/ --

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852405608 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43701/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

AmplabJenkins removed a comment on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852404833 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43696/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins removed a comment on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852404832 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139181/

[GitHub] [spark] AmplabJenkins commented on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

AmplabJenkins commented on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852404833 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43696/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

AmplabJenkins commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852404832 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139181/ -- This

[GitHub] [spark] SparkQA commented on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

SparkQA commented on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852398034 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43698/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

SparkQA commented on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852397637 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43699/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA removed a comment on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852378386 **[Test build #139181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139181/testReport)** for PR 32698 at commit

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852397375 **[Test build #139181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139181/testReport)** for PR 32698 at commit

[GitHub] [spark] otterc commented on a change in pull request #30691: [SPARK-32920][SHUFFLE] Finalization of Shuffle push/merge with Push based shuffle and preparation step for the reduce stage

otterc commented on a change in pull request #30691: URL: https://github.com/apache/spark/pull/30691#discussion_r643429058 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1743,6 +1762,10 @@ private[spark] class DAGScheduler( }

[GitHub] [spark] srowen commented on a change in pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

srowen commented on a change in pull request #32734: URL: https://github.com/apache/spark/pull/32734#discussion_r643422274 ## File path: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala ## @@ -439,7 +439,8 @@ class RowMatrix @Since("1.0.0") (

[GitHub] [spark] SparkQA commented on pull request #32592: [WIP][SPARK-35343][PYTHON] Make conversion from/to pandas data-type-based

SparkQA commented on pull request #32592: URL: https://github.com/apache/spark/pull/32592#issuecomment-852382917 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43696/ -- This is an automated message from the

[GitHub] [spark] shahidki31 commented on a change in pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

shahidki31 commented on a change in pull request #32734: URL: https://github.com/apache/spark/pull/32734#discussion_r643412180 ## File path: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala ## @@ -439,7 +439,8 @@ class RowMatrix @Since("1.0.0") (

[GitHub] [spark] shahidki31 commented on a change in pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

shahidki31 commented on a change in pull request #32734: URL: https://github.com/apache/spark/pull/32734#discussion_r643412180 ## File path: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala ## @@ -439,7 +439,8 @@ class RowMatrix @Since("1.0.0") (

[GitHub] [spark] SparkQA commented on pull request #32698: [SPARK-35341][PYTHON] Introduce BooleanExtensionOps

SparkQA commented on pull request #32698: URL: https://github.com/apache/spark/pull/32698#issuecomment-852378386 **[Test build #139181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139181/testReport)** for PR 32698 at commit

[GitHub] [spark] srowen commented on a change in pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

srowen commented on a change in pull request #32734: URL: https://github.com/apache/spark/pull/32734#discussion_r643407060 ## File path: mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala ## @@ -439,7 +439,8 @@ class RowMatrix @Since("1.0.0") (

[GitHub] [spark] SparkQA commented on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

SparkQA commented on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852368921 **[Test build #139180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139180/testReport)** for PR 32388 at commit

[GitHub] [spark] SparkQA commented on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

SparkQA commented on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852368589 **[Test build #139179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139179/testReport)** for PR 32734 at commit

[GitHub] [spark] shahidki31 commented on pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

shahidki31 commented on pull request #32734: URL: https://github.com/apache/spark/pull/32734#issuecomment-852367252 cc @srowen Kindly review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32724: [SPARK-35585][SQL] Support propagate empty relation through project/filter

AmplabJenkins removed a comment on pull request #32724: URL: https://github.com/apache/spark/pull/32724#issuecomment-852366354 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139170/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

AmplabJenkins removed a comment on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-852366351 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139173/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32721: [SPARK-35077][SQL] Migrate to transformWithPruning for leftover optimizer rules

AmplabJenkins removed a comment on pull request #32721: URL: https://github.com/apache/spark/pull/32721#issuecomment-852366355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43695/

[GitHub] [spark] shahidki31 opened a new pull request #32734: [SPARK-35423][ML] PCA results should be consistent, If the Matrix contains both Sparse and Dense vectors

shahidki31 opened a new pull request #32734: URL: https://github.com/apache/spark/pull/32734 ### What changes were proposed in this pull request? If the dataset contains mix of sparse and dense vectors output of PCA seems different. The issue here is we check only the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32725: [SPARK-35595][TESTS] Support multiple loggers in testing method withLogAppender

AmplabJenkins removed a comment on pull request #32725: URL: https://github.com/apache/spark/pull/32725#issuecomment-852366352 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43697/

[GitHub] [spark] AmplabJenkins commented on pull request #32721: [SPARK-35077][SQL] Migrate to transformWithPruning for leftover optimizer rules

AmplabJenkins commented on pull request #32721: URL: https://github.com/apache/spark/pull/32721#issuecomment-852366355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43695/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32725: [SPARK-35595][TESTS] Support multiple loggers in testing method withLogAppender

AmplabJenkins commented on pull request #32725: URL: https://github.com/apache/spark/pull/32725#issuecomment-852366352 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43697/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32724: [SPARK-35585][SQL] Support propagate empty relation through project/filter

AmplabJenkins commented on pull request #32724: URL: https://github.com/apache/spark/pull/32724#issuecomment-852366354 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139170/ -- This

<    1   2   3   4   5   6   7   8   9   >