[GitHub] [spark] SparkQA removed a comment on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929848648 **[Test build #143706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143706/testReport)** for PR 34113 at commit

[GitHub] [spark] SparkQA commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929859580 **[Test build #143706 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143706/testReport)** for PR 34113 at commit

[GitHub] [spark] fishmandev commented on pull request #34129: [MINOR][DOCS] Typo fix in cloud-integration.md

2021-09-28 Thread GitBox
fishmandev commented on pull request #34129: URL: https://github.com/apache/spark/pull/34129#issuecomment-929858922 > Also, Github Actions in your forked repository should be enable to run CI Done it. > While we're here, mind checking if there are more typos to fix around

[GitHub] [spark] SparkQA commented on pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
SparkQA commented on pull request #34114: URL: https://github.com/apache/spark/pull/34114#issuecomment-929858675 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48215/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-929851391 **[Test build #143708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143708/testReport)** for PR 33936 at commit

[GitHub] [spark] SparkQA commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-28 Thread GitBox
SparkQA commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-929857581 **[Test build #143708 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143708/testReport)** for PR 33936 at commit

[GitHub] [spark] SparkQA commented on pull request #34139: [SPARK-36876][SQL] Support Dynamic Partition pruning for HiveTableScanExec

2021-09-28 Thread GitBox
SparkQA commented on pull request #34139: URL: https://github.com/apache/spark/pull/34139#issuecomment-929856165 **[Test build #143710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143710/testReport)** for PR 34139 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #34138: [SPARK-36883][INFRA] Upgrade R version to 4.1.1 in CI images

2021-09-28 Thread GitBox
dongjoon-hyun commented on pull request #34138: URL: https://github.com/apache/spark/pull/34138#issuecomment-929855453 Thank you, @HyukjinKwon . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] dongjoon-hyun commented on pull request #34134: [MINOR][DOCS] Mention other Python dependency tools in documentation

2021-09-28 Thread GitBox
dongjoon-hyun commented on pull request #34134: URL: https://github.com/apache/spark/pull/34134#issuecomment-929855305 +1, late LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon closed pull request #34134: [MINOR][DOCS] Mention other Python dependency tools in documentation

2021-09-28 Thread GitBox
HyukjinKwon closed pull request #34134: URL: https://github.com/apache/spark/pull/34134 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #34134: [MINOR][DOCS] Mention other Python dependency tools in documentation

2021-09-28 Thread GitBox
HyukjinKwon commented on pull request #34134: URL: https://github.com/apache/spark/pull/34134#issuecomment-929854333 Thanks guys. Merged to master. Let me merge this in branch-3.2 too - very trivial doc change. -- This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #34134: [MINOR][DOCS] Mention other Python dependency tools in documentation

2021-09-28 Thread GitBox
HyukjinKwon commented on pull request #34134: URL: https://github.com/apache/spark/pull/34134#issuecomment-929854421 Merged to master and branch-3.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AngersZhuuuu commented on pull request #34139: [SPARK-36876][SQL] Support Dynamic Partition pruning for HiveTableScanExec

2021-09-28 Thread GitBox
AngersZh commented on pull request #34139: URL: https://github.com/apache/spark/pull/34139#issuecomment-929854069 ping @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718170642 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List])

[GitHub] [spark] SparkQA commented on pull request #34139: [SPARK-36876][SQL] Support Dynamic Partition pruning for HiveTableScanExec

2021-09-28 Thread GitBox
SparkQA commented on pull request #34139: URL: https://github.com/apache/spark/pull/34139#issuecomment-929853595 **[Test build #143709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143709/testReport)** for PR 34139 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718170132 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List])

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718169889 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List])

[GitHub] [spark] AngersZhuuuu commented on pull request #28872: [SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2021-09-28 Thread GitBox
AngersZh commented on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-929853320 @whcdjj I have start a new work on this, pls refer to https://github.com/apache/spark/pull/34139 -- This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AngersZhuuuu opened a new pull request #34139: [SPARK-36876][SQL] Support Dynamic Partition pruning for HiveTableScanExec

2021-09-28 Thread GitBox
AngersZh opened a new pull request #34139: URL: https://github.com/apache/spark/pull/34139 ### What changes were proposed in this pull request? Current code just support dynamic partition pruning for DSV1 and DSV2, here we support HiveTableScan ### Why are the changes

[GitHub] [spark] HyukjinKwon commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
HyukjinKwon commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929852797 I'll leave it to @sarutak. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] itholic commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718164009 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List]) ->

[GitHub] [spark] SparkQA commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-28 Thread GitBox
SparkQA commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-929851391 **[Test build #143708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143708/testReport)** for PR 33936 at commit

[GitHub] [spark] itholic commented on a change in pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34114: URL: https://github.com/apache/spark/pull/34114#discussion_r718166170 ## File path: python/pyspark/pandas/tests/test_ops_on_diff_frames.py ## @@ -1830,6 +1830,47 @@ def _test_cov(self, pser1, pser2): pscov =

[GitHub] [spark] SparkQA commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929851118 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48218/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34138: [SPARK-36883][INFRA] Upgrade R version to 4.1.1 in CI images

2021-09-28 Thread GitBox
SparkQA commented on pull request #34138: URL: https://github.com/apache/spark/pull/34138#issuecomment-929851073 **[Test build #143707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143707/testReport)** for PR 34138 at commit

[GitHub] [spark] SparkQA commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929850767 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48217/ -- This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun commented on pull request #34138: [SPARK-36883][INFRA] Upgrade R version to 4.1.1 in CI images

2021-09-28 Thread GitBox
dongjoon-hyun commented on pull request #34138: URL: https://github.com/apache/spark/pull/34138#issuecomment-929850674 cc @HyukjinKwon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929849757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143690/

[GitHub] [spark] itholic commented on a change in pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34114: URL: https://github.com/apache/spark/pull/34114#discussion_r718166170 ## File path: python/pyspark/pandas/tests/test_ops_on_diff_frames.py ## @@ -1830,6 +1830,47 @@ def _test_cov(self, pser1, pser2): pscov =

[GitHub] [spark] dongjoon-hyun opened a new pull request #34138: [SPARK-36883][INFRA] Upgrade R version to 4.1.1 in CI images

2021-09-28 Thread GitBox
dongjoon-hyun opened a new pull request #34138: URL: https://github.com/apache/spark/pull/34138 ### What changes were proposed in this pull request? This PR aims to upgrade GitHub Action CI image to recover CRAN installation failure. ### Why are the changes needed?

[GitHub] [spark] AmplabJenkins commented on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929849757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143690/ -- This

[GitHub] [spark] itholic commented on a change in pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34114: URL: https://github.com/apache/spark/pull/34114#discussion_r718166170 ## File path: python/pyspark/pandas/tests/test_ops_on_diff_frames.py ## @@ -1830,6 +1830,47 @@ def _test_cov(self, pser1, pser2): pscov =

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929843984 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA removed a comment on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929732162 **[Test build #143690 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143690/testReport)** for PR 34127 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929845138 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143703/

[GitHub] [spark] SparkQA removed a comment on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929833756 **[Test build #143704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143704/testReport)** for PR 34113 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34121: [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command framework

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34121: URL: https://github.com/apache/spark/pull/34121#issuecomment-929845186 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA removed a comment on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929833737 **[Test build #143703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143703/testReport)** for PR 34135 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34114: URL: https://github.com/apache/spark/pull/34114#issuecomment-929843987 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143700/

[GitHub] [spark] SparkQA commented on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
SparkQA commented on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929849021 **[Test build #143690 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143690/testReport)** for PR 34127 at commit

[GitHub] [spark] SparkQA commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929848648 **[Test build #143706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143706/testReport)** for PR 34113 at commit

[GitHub] [spark] itholic commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718164009 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List]) ->

[GitHub] [spark] itholic commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718163223 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List]) ->

[GitHub] [spark] itholic commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718163223 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List]) ->

[GitHub] [spark] SparkQA commented on pull request #34137: [SPARK-36588] Migrate SHOW TABLES to use V2 command by default

2021-09-28 Thread GitBox
SparkQA commented on pull request #34137: URL: https://github.com/apache/spark/pull/34137#issuecomment-929846351 **[Test build #143705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143705/testReport)** for PR 34137 at commit

[GitHub] [spark] SparkQA commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929845810 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48216/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34121: [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command framework

2021-09-28 Thread GitBox
SparkQA commented on pull request #34121: URL: https://github.com/apache/spark/pull/34121#issuecomment-929845159 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48214/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #34121: [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command framework

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34121: URL: https://github.com/apache/spark/pull/34121#issuecomment-929845186 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48214/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929845045 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143704/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929845138 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143703/ -- This

[GitHub] [spark] SparkQA commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929844882 **[Test build #143703 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143703/testReport)** for PR 34135 at commit

[GitHub] [spark] SparkQA commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929844811 **[Test build #143704 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143704/testReport)** for PR 34113 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34121: [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command framework

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34121: URL: https://github.com/apache/spark/pull/34121#issuecomment-929843982 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143689/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929843984 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143702/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34114: URL: https://github.com/apache/spark/pull/34114#issuecomment-929843987 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143700/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929831534 **[Test build #143702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143702/testReport)** for PR 34113 at commit

[GitHub] [spark] SparkQA commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929842512 **[Test build #143702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143702/testReport)** for PR 34113 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #34114: URL: https://github.com/apache/spark/pull/34114#discussion_r718157825 ## File path: python/pyspark/pandas/tests/test_ops_on_diff_frames.py ## @@ -1830,6 +1830,47 @@ def _test_cov(self, pser1, pser2): pscov =

[GitHub] [spark] SparkQA removed a comment on pull request #34121: [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command framework

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34121: URL: https://github.com/apache/spark/pull/34121#issuecomment-929719190 **[Test build #143689 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143689/testReport)** for PR 34121 at commit

[GitHub] [spark] SparkQA commented on pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
SparkQA commented on pull request #34114: URL: https://github.com/apache/spark/pull/34114#issuecomment-929841161 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48215/ -- This is an automated message from the Apache

[GitHub] [spark] imback82 commented on a change in pull request #34137: [SPARK-36588] Migrate SHOW TABLES to use V2 command by default

2021-09-28 Thread GitBox
imback82 commented on a change in pull request #34137: URL: https://github.com/apache/spark/pull/34137#discussion_r718157446 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/ShowTablesSuiteBase.scala ## @@ -40,6 +42,10 @@ trait ShowTablesSuiteBase

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #34114: URL: https://github.com/apache/spark/pull/34114#discussion_r718157230 ## File path: python/pyspark/pandas/base.py ## @@ -394,7 +394,17 @@ def __abs__(self: IndexOpsLike) -> IndexOpsLike: # comparison operators

[GitHub] [spark] SparkQA commented on pull request #34121: [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command framework

2021-09-28 Thread GitBox
SparkQA commented on pull request #34121: URL: https://github.com/apache/spark/pull/34121#issuecomment-929840598 **[Test build #143689 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143689/testReport)** for PR 34121 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #33980: [SPARK-32285][PYTHON] Add PySpark support for nested timestamps with arrow

2021-09-28 Thread GitBox
HyukjinKwon commented on pull request #33980: URL: https://github.com/apache/spark/pull/33980#issuecomment-929838834 cc @BryanCutler FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] dohongdayi commented on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
dohongdayi commented on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929837708 @huaxingao Ok, Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] imback82 opened a new pull request #34137: [SPARK-36588] Migrate SHOW TABLES to use V2 command by default

2021-09-28 Thread GitBox
imback82 opened a new pull request #34137: URL: https://github.com/apache/spark/pull/34137 ### What changes were proposed in this pull request? This PR proposes to use V2 commands as default as outlined in [SPARK-36588](https://issues.apache.org/jira/browse/SPARK-36588), and

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718151080 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,42 @@ def intersection(self, other: Union[DataFrame, Series, Index, List])

[GitHub] [spark] SparkQA removed a comment on pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34114: URL: https://github.com/apache/spark/pull/34114#issuecomment-929824043 **[Test build #143700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143700/testReport)** for PR 34114 at commit

[GitHub] [spark] SparkQA commented on pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
SparkQA commented on pull request #34114: URL: https://github.com/apache/spark/pull/34114#issuecomment-929835364 **[Test build #143700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143700/testReport)** for PR 34114 at commit

[GitHub] [spark] huaxingao commented on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
huaxingao commented on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929834830 no need to worry about K8S failure. As long as all the tests pass or `All checks have passed`, you should be fine. -- This is an automated message from the Apache Git

[GitHub] [spark] dohongdayi edited a comment on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
dohongdayi edited a comment on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929831765 I don't think the K8S IT failure is related with this PR, it should be caused by K8S cluster was unstable or lack of resource, so I'm trying to start the test build

[GitHub] [spark] dohongdayi edited a comment on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
dohongdayi edited a comment on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929831765 I don't think the K8S IT failure is related with this PR, it should be caused by K8S was unstable or lack of resource, so I'm trying to start the test build again

[GitHub] [spark] dohongdayi edited a comment on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
dohongdayi edited a comment on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929831765 I don't think the K8S IT failure is related with this PR, it might be caused by K8S was unstable or lack of resource, so I'm trying to start the test build again --

[GitHub] [spark] SparkQA commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929833756 **[Test build #143704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143704/testReport)** for PR 34113 at commit

[GitHub] [spark] SparkQA commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929833737 **[Test build #143703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143703/testReport)** for PR 34135 at commit

[GitHub] [spark] dohongdayi edited a comment on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
dohongdayi edited a comment on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929831765 I think the K8S IT failure was caused by K8S was unstable or lack of resource, so I'm trying to start the test build again. -- This is an automated message from the

[GitHub] [spark] dohongdayi commented on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
dohongdayi commented on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929832000 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] dohongdayi commented on pull request #34127: [SPARK-36849][SQL][WIP] Migrate UseStatement to v2 command framework

2021-09-28 Thread GitBox
dohongdayi commented on pull request #34127: URL: https://github.com/apache/spark/pull/34127#issuecomment-929831765 I think the K8S IT failure was caused by K8S was unstable or lack of resource, so I'm trying to start the test build again. ok to test -- This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33872: [SPARK-36575][CORE] Should ignore task finished event if its task set is gone in TaskSchedulerImpl.handleSuccessfulTask

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #33872: URL: https://github.com/apache/spark/pull/33872#issuecomment-929831420 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48209/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34134: [MINOR][DOCS] Mention other Python dependency tools in documentation

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34134: URL: https://github.com/apache/spark/pull/34134#issuecomment-929831617 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48213/

[GitHub] [spark] AmplabJenkins commented on pull request #34134: [MINOR][DOCS] Mention other Python dependency tools in documentation

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34134: URL: https://github.com/apache/spark/pull/34134#issuecomment-929831617 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48213/ --

[GitHub] [spark] SparkQA commented on pull request #34134: [MINOR][DOCS] Mention other Python dependency tools in documentation

2021-09-28 Thread GitBox
SparkQA commented on pull request #34134: URL: https://github.com/apache/spark/pull/34134#issuecomment-929831577 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48213/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
SparkQA commented on pull request #34113: URL: https://github.com/apache/spark/pull/34113#issuecomment-929831534 **[Test build #143702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143702/testReport)** for PR 34113 at commit

[GitHub] [spark] SparkQA commented on pull request #33872: [SPARK-36575][CORE] Should ignore task finished event if its task set is gone in TaskSchedulerImpl.handleSuccessfulTask

2021-09-28 Thread GitBox
SparkQA commented on pull request #33872: URL: https://github.com/apache/spark/pull/33872#issuecomment-929831406 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48209/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33872: [SPARK-36575][CORE] Should ignore task finished event if its task set is gone in TaskSchedulerImpl.handleSuccessfulTask

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #33872: URL: https://github.com/apache/spark/pull/33872#issuecomment-929831420 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48209/ --

[GitHub] [spark] SparkQA commented on pull request #34121: [SPARK-36868][SQL] Migrate CreateFunctionStatement to v2 command framework

2021-09-28 Thread GitBox
SparkQA commented on pull request #34121: URL: https://github.com/apache/spark/pull/34121#issuecomment-929829415 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48214/ -- This is an automated message from the Apache

[GitHub] [spark] itholic commented on a change in pull request #34113: [SPARK-36435][PYTHON] Implement MultIndex.equal_levels

2021-09-28 Thread GitBox
itholic commented on a change in pull request #34113: URL: https://github.com/apache/spark/pull/34113#discussion_r718114641 ## File path: python/pyspark/pandas/indexes/multi.py ## @@ -1137,6 +1137,43 @@ def intersection(self, other: Union[DataFrame, Series, Index, List]) ->

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929827498 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143701/

[GitHub] [spark] SparkQA removed a comment on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA removed a comment on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929827004 **[Test build #143701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143701/testReport)** for PR 34135 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929827498 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143701/ -- This

[GitHub] [spark] SparkQA commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929827446 **[Test build #143701 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143701/testReport)** for PR 34135 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929820765 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48208/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34136: [SPARK-36884][PYTHON] Inline type hints for pyspark.sql.session

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #34136: URL: https://github.com/apache/spark/pull/34136#issuecomment-929823174 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48212/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union in AQE

2021-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-929820764 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
SparkQA commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929827004 **[Test build #143701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143701/testReport)** for PR 34135 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
HyukjinKwon commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929826887 cc @MaxGekk too FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon commented on pull request #34135: [SPARK-36882][PYTHON] Support ILIKE API on Python

2021-09-28 Thread GitBox
HyukjinKwon commented on pull request #34135: URL: https://github.com/apache/spark/pull/34135#issuecomment-929826783 @yoda-mon, FYI, there's a R linter failure going up globally that seems like an issue from external server (e.g., CRAN). So feel free to ignore it for now. -- This is an

[GitHub] [spark] SparkQA commented on pull request #34114: [SPARK-36438][PYTHON] Support list-like Python objects for Series comparison

2021-09-28 Thread GitBox
SparkQA commented on pull request #34114: URL: https://github.com/apache/spark/pull/34114#issuecomment-929824043 **[Test build #143700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143700/testReport)** for PR 34114 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34136: [SPARK-36884][PYTHON] Inline type hints for pyspark.sql.session

2021-09-28 Thread GitBox
AmplabJenkins commented on pull request #34136: URL: https://github.com/apache/spark/pull/34136#issuecomment-929823174 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48212/ --

[GitHub] [spark] SparkQA commented on pull request #34136: [SPARK-36884][PYTHON] Inline type hints for pyspark.sql.session

2021-09-28 Thread GitBox
SparkQA commented on pull request #34136: URL: https://github.com/apache/spark/pull/34136#issuecomment-929823157 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48212/ -- This is an automated message from the

  1   2   3   4   5   6   7   8   >