[GitHub] [spark] allisonwang-db commented on a change in pull request #30093: [SPARK-33183][SQL] Fix EliminateSorts bug when removing global sorts

2020-10-26 Thread GitBox
allisonwang-db commented on a change in pull request #30093: URL: https://github.com/apache/spark/pull/30093#discussion_r512161304 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/EliminateSortsSuite.scala ## @@ -97,12 +97,34 @@ class

[GitHub] [spark] zero323 closed pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-26 Thread GitBox
zero323 closed pull request #30143: URL: https://github.com/apache/spark/pull/30143 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-716712362 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-716712362 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-716522115 **[Test build #130287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130287/testReport)** for PR 28363 at commit

[GitHub] [spark] SparkQA commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-26 Thread GitBox
SparkQA commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-716710898 **[Test build #130287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130287/testReport)** for PR 28363 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30147: [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 session catalog

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30147: URL: https://github.com/apache/spark/pull/30147#issuecomment-716709779 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30147: [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 session catalog

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30147: URL: https://github.com/apache/spark/pull/30147#issuecomment-716709779 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30147: [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 session catalog

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #30147: URL: https://github.com/apache/spark/pull/30147#issuecomment-716525618 **[Test build #130288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130288/testReport)** for PR 30147 at commit

[GitHub] [spark] SparkQA commented on pull request #30147: [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 session catalog

2020-10-26 Thread GitBox
SparkQA commented on pull request #30147: URL: https://github.com/apache/spark/pull/30147#issuecomment-716708434 **[Test build #130288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130288/testReport)** for PR 30147 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30152: URL: https://github.com/apache/spark/pull/30152#issuecomment-716702456 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30152: URL: https://github.com/apache/spark/pull/30152#issuecomment-716702456 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
SparkQA commented on pull request #30152: URL: https://github.com/apache/spark/pull/30152#issuecomment-716702430 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34896/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716696300 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716696291 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716696291 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716518254 **[Test build #130286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130286/testReport)** for PR 29970 at commit

[GitHub] [spark] SparkQA commented on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
SparkQA commented on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716695392 **[Test build #130286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130286/testReport)** for PR 29970 at commit

[GitHub] [spark] SparkQA commented on pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
SparkQA commented on pull request #30152: URL: https://github.com/apache/spark/pull/30152#issuecomment-716694552 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34896/

[GitHub] [spark] c21 commented on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-26 Thread GitBox
c21 commented on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-716688999 Thanks @maropu , @viirya and @cloud-fan for review! This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya commented on pull request #30140: [SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
viirya commented on pull request #30140: URL: https://github.com/apache/spark/pull/30140#issuecomment-716687558 @dongjoon-hyun It only failed in branch-2.4. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on pull request #30140: [SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
dongjoon-hyun commented on pull request #30140: URL: https://github.com/apache/spark/pull/30140#issuecomment-716686602 @viirya . Wait. This PR passed the UT initially. This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
dongjoon-hyun commented on pull request #30152: URL: https://github.com/apache/spark/pull/30152#issuecomment-716686763 Please hold on this reverting. I'll take a look. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30089: URL: https://github.com/apache/spark/pull/30089#issuecomment-716682399 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30089: URL: https://github.com/apache/spark/pull/30089#issuecomment-716682399 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-26 Thread GitBox
SparkQA commented on pull request #30089: URL: https://github.com/apache/spark/pull/30089#issuecomment-716682374 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34895/

[GitHub] [spark] SparkQA commented on pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
SparkQA commented on pull request #30152: URL: https://github.com/apache/spark/pull/30152#issuecomment-716677497 **[Test build #130295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130295/testReport)** for PR 30152 at commit

[GitHub] [spark] viirya commented on pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
viirya commented on pull request #30152: URL: https://github.com/apache/spark/pull/30152#issuecomment-716677462 #30140 causes Python test failed in 2.4 (https://github.com/apache/spark/runs/1307296057) even I re-ran it. I'm going to revert it from 2.4.

[GitHub] [spark] viirya opened a new pull request #30152: Revert "[SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
viirya opened a new pull request #30152: URL: https://github.com/apache/spark/pull/30152 This reverts commit a85d69049c5ad994b3fb6cde1b3d739f3da336d4. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] viirya edited a comment on pull request #30140: [SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
viirya edited a comment on pull request #30140: URL: https://github.com/apache/spark/pull/30140#issuecomment-716672636 Hi @maropu @HyukjinKwon @dongjoon-hyun , this seem to cause Python test failed in 2.4 (https://github.com/apache/spark/runs/1307296057) even I re-ran it. I'm going to

[GitHub] [spark] SparkQA commented on pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-26 Thread GitBox
SparkQA commented on pull request #30089: URL: https://github.com/apache/spark/pull/30089#issuecomment-716668771 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34895/

[GitHub] [spark] viirya commented on pull request #30140: [SPARK-33228][SQL] Don't uncache data when replacing a view having the same logical plan

2020-10-26 Thread GitBox
viirya commented on pull request #30140: URL: https://github.com/apache/spark/pull/30140#issuecomment-716672636 Hi @maropu @HyukjinKwon @dongjoon-hyun , this seem to cause Python test failed in 2.4 (https://github.com/apache/spark/runs/1307296057). I'm going to revert it from 2.4.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716672014 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716672014 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716490495 **[Test build #130283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130283/testReport)** for PR 30097 at commit

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716669794 **[Test build #130283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130283/testReport)** for PR 30097 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716660833 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716660833 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-716660475 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-716660475 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716500496 **[Test build #130285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130285/testReport)** for PR 30151 at commit

[GitHub] [spark] SparkQA commented on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
SparkQA commented on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716659034 **[Test build #130285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130285/testReport)** for PR 30151 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30144: [SPARK-33229][SQL] Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-716493826 **[Test build #130284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130284/testReport)** for PR 30144 at commit

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-26 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-716658454 **[Test build #130284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130284/testReport)** for PR 30144 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30141: [SPARK-33230][SQL] Hadoop committers to get unique job ID in "spark.sql.sources.writeJobUUID"

2020-10-26 Thread GitBox
dongjoon-hyun commented on pull request #30141: URL: https://github.com/apache/spark/pull/30141#issuecomment-716656387 cc @sunchao This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-26 Thread GitBox
SparkQA commented on pull request #30089: URL: https://github.com/apache/spark/pull/30089#issuecomment-716640452 **[Test build #130294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130294/testReport)** for PR 30089 at commit

[GitHub] [spark] huaxingao commented on a change in pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-26 Thread GitBox
huaxingao commented on a change in pull request #30089: URL: https://github.com/apache/spark/pull/30089#discussion_r512069576 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/V2JDBCTest.scala ## @@ -73,6 +73,30 @@ trait V2JDBCTest

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716637075 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716637046 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34894/

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716637075 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716629325 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30134: [SPARK-33225][SQL] Extract AliasHelper trait

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30134: URL: https://github.com/apache/spark/pull/30134#issuecomment-716628638 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716629325 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716629298 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34891/

[GitHub] [spark] SparkQA commented on pull request #30134: [SPARK-33225][SQL] Extract AliasHelper trait

2020-10-26 Thread GitBox
SparkQA commented on pull request #30134: URL: https://github.com/apache/spark/pull/30134#issuecomment-716628607 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34893/

[GitHub] [spark] AmplabJenkins commented on pull request #30134: [SPARK-33225][SQL] Extract AliasHelper trait

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30134: URL: https://github.com/apache/spark/pull/30134#issuecomment-716628638 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716626493 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716626493 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-10-26 Thread GitBox
SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716626468 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34892/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30148: [SPARK-33244][SQL] Unify the code paths for spark.table and spark.read.table

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30148: URL: https://github.com/apache/spark/pull/30148#issuecomment-716624270 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30148: [SPARK-33244][SQL] Unify the code paths for spark.table and spark.read.table

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30148: URL: https://github.com/apache/spark/pull/30148#issuecomment-716624270 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30148: [SPARK-33244][SQL] Unify the code paths for spark.table and spark.read.table

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #30148: URL: https://github.com/apache/spark/pull/30148#issuecomment-716467556 **[Test build #130276 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130276/testReport)** for PR 30148 at commit

[GitHub] [spark] SparkQA commented on pull request #30148: [SPARK-33244][SQL] Unify the code paths for spark.table and spark.read.table

2020-10-26 Thread GitBox
SparkQA commented on pull request #30148: URL: https://github.com/apache/spark/pull/30148#issuecomment-716622608 **[Test build #130276 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130276/testReport)** for PR 30148 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30146: [SPARK-33241][SQL] Dynamic pruning on data column

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30146: URL: https://github.com/apache/spark/pull/30146#issuecomment-716621660 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30146: [SPARK-33241][SQL] Dynamic pruning on data column

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30146: URL: https://github.com/apache/spark/pull/30146#issuecomment-716621660 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] imback82 commented on a change in pull request #30079: [SPARK-33174][SQL] Migrate DROP TABLE to use UnresolvedTableOrView to resolve the identifier

2020-10-26 Thread GitBox
imback82 commented on a change in pull request #30079: URL: https://github.com/apache/spark/pull/30079#discussion_r512047429 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -368,9 +368,13 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #30146: [SPARK-33241][SQL] Dynamic pruning on data column

2020-10-26 Thread GitBox
SparkQA removed a comment on pull request #30146: URL: https://github.com/apache/spark/pull/30146#issuecomment-716467612 **[Test build #130277 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130277/testReport)** for PR 30146 at commit

[GitHub] [spark] SparkQA commented on pull request #30146: [SPARK-33241][SQL] Dynamic pruning on data column

2020-10-26 Thread GitBox
SparkQA commented on pull request #30146: URL: https://github.com/apache/spark/pull/30146#issuecomment-716619906 **[Test build #130277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130277/testReport)** for PR 30146 at commit

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716616940 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34894/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716616040 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716616007 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34890/

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716616040 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] farhan5900 edited a comment on pull request #30112: [SPARK-33199][MESOS] Mesos Task Failed when pyFiles and docker image option used together

2020-10-26 Thread GitBox
farhan5900 edited a comment on pull request #30112: URL: https://github.com/apache/spark/pull/30112#issuecomment-716613161 Hi, @dongjoon-hyun It is basically done to avoid shell-escaping of the `$MESOS_SANDBOX` used in the case of `--py-files` with the docker image option

[GitHub] [spark] farhan5900 commented on pull request #30112: [SPARK-33199][MESOS] Mesos Task Failed when pyFiles and docker image option used together

2020-10-26 Thread GitBox
farhan5900 commented on pull request #30112: URL: https://github.com/apache/spark/pull/30112#issuecomment-716613161 Hi, @dongjoon-hyun It is basically done to avoid shell-escaping of the `$MESOS_SANDBOX` used in the case of `--py-files` with the docker option

[GitHub] [spark] SparkQA commented on pull request #30134: [SPARK-33225][SQL] Extract AliasHelper trait

2020-10-26 Thread GitBox
SparkQA commented on pull request #30134: URL: https://github.com/apache/spark/pull/30134#issuecomment-716612926 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34893/

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-10-26 Thread GitBox
SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716610972 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34892/

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716609418 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34891/

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716601776 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34890/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30147: [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 session catalog

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30147: URL: https://github.com/apache/spark/pull/30147#issuecomment-716589732 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30147: [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 session catalog

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30147: URL: https://github.com/apache/spark/pull/30147#issuecomment-716589732 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30147: [SPARK-33240][SQL] Fail fast when fails to instantiate configured v2 session catalog

2020-10-26 Thread GitBox
SparkQA commented on pull request #30147: URL: https://github.com/apache/spark/pull/30147#issuecomment-716589689 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34889/

[GitHub] [spark] cloud-fan commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
cloud-fan commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r512009195 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/PruneHiveTablePartitions.scala ## @@ -27,7 +27,8 @@ import

[GitHub] [spark] cloud-fan commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
cloud-fan commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r512008622 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/DataSourceAnalysisSuite.scala ## @@ -196,6 +202,7 @@ class DataSourceAnalysisSuite

[GitHub] [spark] cloud-fan commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
cloud-fan commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r512008197 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/DataSourceAnalysisSuite.scala ## @@ -196,6 +202,7 @@ class DataSourceAnalysisSuite

[GitHub] [spark] cloud-fan commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
cloud-fan commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r512004978 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/DataSourceAnalysisSuite.scala ## @@ -35,6 +35,7 @@ class DataSourceAnalysisSuite

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-716583955 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-716583955 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716582534 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-26 Thread GitBox
SparkQA commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-716583927 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34888/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716582522 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-26 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716583128 **[Test build #130293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130293/testReport)** for PR 30145 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
cloud-fan commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r512000955 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/EliminateSortsSuite.scala ## @@ -32,7 +32,8 @@ import

[GitHub] [spark] SparkQA commented on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
SparkQA commented on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716582490 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34886/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716581925 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30151: [WIP][SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-716582522 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716581925 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
cloud-fan commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r512000413 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/AggregateOptimizeSuite.scala ## @@ -29,7 +29,8 @@ import

[GitHub] [spark] SparkQA commented on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

2020-10-26 Thread GitBox
SparkQA commented on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716581872 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34887/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716575599 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-26 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-716575599 This is an automated message from the Apache Git Service. To respond to the message, please log on to

<    1   2   3   4   5   6   7   8   >