[GitHub] [spark] AngersZhuuuu opened a new pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
AngersZh opened a new pull request #30145: URL: https://github.com/apache/spark/pull/30145 ### What changes were proposed in this pull request? Currently, we can't support use ordinal in CUBE/ROLLUP/GROUPING SETS, this pr make CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715772704 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715772704 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
SparkQA commented on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715772657 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34828/

[GitHub] [spark] AmplabJenkins commented on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-715822285 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-10-24 Thread GitBox
HeartSaVioR commented on a change in pull request #27333: URL: https://github.com/apache/spark/pull/27333#discussion_r511329896 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1019,6 +1019,56 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-715660984 **[Test build #130221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130221/testReport)** for PR 27649 at commit

[GitHub] [spark] SparkQA commented on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

2020-10-24 Thread GitBox
SparkQA commented on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-715819519 **[Test build #130221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130221/testReport)** for PR 27649 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-715661905 **[Test build #130224 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130224/testReport)** for PR 28363 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715830756 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715829887 **[Test build #130229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130229/testReport)** for PR 30145 at commit

[GitHub] [spark] SparkQA commented on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
SparkQA commented on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715829881 **[Test build #130228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130228/testReport)** for PR 30138 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715710242 **[Test build #130228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130228/testReport)** for PR 30138 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715760936 **[Test build #130229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130229/testReport)** for PR 30145 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30144: [SPARK-33229][SQL]Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-715680465 **[Test build #130227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130227/testReport)** for PR 30144 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715830054 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL]Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-715830759 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715832074 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715830786 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715832074 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL]Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-715830789 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-715832296 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-715832296 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715833374 **[Test build #130230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130230/testReport)** for PR 30143 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715830055 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30138: [SPARK-33075][SQL] Enable auto bucketed scan by default (disable only for cached query)

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30138: URL: https://github.com/apache/spark/pull/30138#issuecomment-715830756 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL]Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-715830759 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715760936 **[Test build #130229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130229/testReport)** for PR 30145 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-715822285 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
SparkQA commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715825878 **[Test build #130223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130223/testReport)** for PR 24173 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715661007 **[Test build #130223 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130223/testReport)** for PR 24173 at commit

[GitHub] [spark] zero323 commented on pull request #30094: [SPARK-33003][PYTHON][DOCS] Add type hints guidelines to the documentation

2020-10-24 Thread GitBox
zero323 commented on pull request #30094: URL: https://github.com/apache/spark/pull/30094#issuecomment-715842306 Thanks @HyukjinKwon! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715843160 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34829/

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715843164 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715843164 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715859220 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715809580 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34829/

[GitHub] [spark] HeartSaVioR closed pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-10-24 Thread GitBox
HeartSaVioR closed pull request #27333: URL: https://github.com/apache/spark/pull/27333 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-715832319 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715832093 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715858168 **[Test build #130230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130230/testReport)** for PR 30143 at commit

[GitHub] [spark] HeartSaVioR opened a new pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-10-24 Thread GitBox
HeartSaVioR opened a new pull request #27333: URL: https://github.com/apache/spark/pull/27333 ### What changes were proposed in this pull request? This patch adds new UTs to prevent SPARK-29438 for streaming aggregation as well as flatMapGroupsWithState, as we agree about the review

[GitHub] [spark] HeartSaVioR commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-10-24 Thread GitBox
HeartSaVioR commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-715810779 Accidentally closed this - don't get the UX on Github mobile app. (Don't know how to reopen in the app.) Will reopen soon.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715828422 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715661919 **[Test build #130225 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130225/testReport)** for PR 24173 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-715830054 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL]Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-10-24 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-715829884 **[Test build #130227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130227/testReport)** for PR 30144 at commit

[GitHub] [spark] SparkQA commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
SparkQA commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715829885 **[Test build #130225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130225/testReport)** for PR 24173 at commit

[GitHub] [spark] SparkQA commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-10-24 Thread GitBox
SparkQA commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-715829883 **[Test build #130224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130224/testReport)** for PR 28363 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-715828422 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715851068 **[Test build #130231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130231/testReport)** for PR 30143 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715833374 **[Test build #130230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130230/testReport)** for PR 30143 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715859220 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715851068 **[Test build #130231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130231/testReport)** for PR 30143 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715875784 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715875784 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715879506 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879581 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879580 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879580 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879029 **[Test build #130232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130232/testReport)** for PR 30097 at commit

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879577 **[Test build #130232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130232/testReport)** for PR 30097 at commit

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715879502 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34830/

[GitHub] [spark] AmplabJenkins commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715879506 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] mridulm commented on pull request #29906: [SPARK-32037][CORE] Rename blacklisting feature

2020-10-24 Thread GitBox
mridulm commented on pull request #29906: URL: https://github.com/apache/spark/pull/29906#issuecomment-715880777 Thanks for working on this Tom ! Looks good to me. This is an automated message from the Apache Git Service. To

[GitHub] [spark] mridulm commented on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

2020-10-24 Thread GitBox
mridulm commented on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-715882396 Also, CC @zhouyejoe This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715882828 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715887837 **[Test build #130234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130234/testReport)** for PR 30097 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #30131: [SPARK-33220][CORE]Use `scheduleWithFixedDelay` to avoid repeated unnecessary scheduling for a short time

2020-10-24 Thread GitBox
AngersZh commented on pull request #30131: URL: https://github.com/apache/spark/pull/30131#issuecomment-715889934 > if there is heavy gc after sending rpc request, but before task completes - fixed delay will be gc time + wait time vs just wait time. Double check the code of

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715876900 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34831/

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715876868 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34830/

[GitHub] [spark] mridulm commented on pull request #30131: [SPARK-33220][CORE]Use `scheduleWithFixedDelay` to avoid repeated unnecessary scheduling for a short time

2020-10-24 Thread GitBox
mridulm commented on pull request #30131: URL: https://github.com/apache/spark/pull/30131#issuecomment-715882017 Are you seeing issues with use of `scheduleAtFixedRate` which are fixed by `scheduleWithFixedDelay` ? There are nuances in the difference, which can have subtle impact. In

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715882824 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715880935 **[Test build #130233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130233/testReport)** for PR 30097 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715882824 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715882814 **[Test build #130233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130233/testReport)** for PR 30097 at commit

[GitHub] [spark] ScrapCodes commented on pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

2020-10-24 Thread GitBox
ScrapCodes commented on pull request #30089: URL: https://github.com/apache/spark/pull/30089#issuecomment-715884109 Hi @huaxingao, I wasn't aware of this parallel work here. And created another PR #30142. I am going to copy your rename test and may be you could take a look at the other

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715875705 **[Test build #130231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130231/testReport)** for PR 30143 at commit

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879029 **[Test build #130232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130232/testReport)** for PR 30097 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879838 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879838 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715886332 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34833/

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715889562 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715889557 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34833/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715889562 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715889564 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715895020 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715895016 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34834/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715895020 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
SparkQA commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715879219 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34831/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715879227 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

2020-10-24 Thread GitBox
AmplabJenkins commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-715879227 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715879841 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] mridulm commented on pull request #30139: [SPARK-31069][CORE] high cpu caused by chunksBeingTransferred in external shuffle service

2020-10-24 Thread GitBox
mridulm commented on pull request #30139: URL: https://github.com/apache/spark/pull/30139#issuecomment-715881337 +CC @otterc This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715880935 **[Test build #130233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130233/testReport)** for PR 30097 at commit

[GitHub] [spark] mridulm commented on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

2020-10-24 Thread GitBox
mridulm commented on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-715881096 +CC @zoelin7 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #30131: [SPARK-33220][CORE]Use `scheduleWithFixedDelay` to avoid repeated unnecessary scheduling for a short time

2020-10-24 Thread GitBox
AngersZh edited a comment on pull request #30131: URL: https://github.com/apache/spark/pull/30131#issuecomment-715889934 > if there is heavy gc after sending rpc request, but before task completes - fixed delay will be gc time + wait time vs just wait time. Double check the code

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

2020-10-24 Thread GitBox
SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-715892694 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34834/

[GitHub] [spark] github-actions[bot] closed pull request #29028: [SPARK-32212][CORE]RDD.takeOrdered can choose to merge intermediate r…

2020-10-24 Thread GitBox
github-actions[bot] closed pull request #29028: URL: https://github.com/apache/spark/pull/29028 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] SparkQA commented on pull request #29695: [SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2020-10-24 Thread GitBox
SparkQA commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-716058607 **[Test build #130238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130238/testReport)** for PR 29695 at commit

  1   2   >