[GitHub] [spark] AmplabJenkins commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-720876636 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29533: [SPARK-24266][K8S][3.0] Restart the watcher when we receive a version changed from k8s

2020-11-03 Thread GitBox
dongjoon-hyun commented on pull request #29533: URL: https://github.com/apache/spark/pull/29533#issuecomment-720893692 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30222: URL: https://github.com/apache/spark/pull/30222#issuecomment-720280772 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-720905619 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] zero323 commented on pull request #30216: [SPARK-33304][R][SQL] Add from_avro and to_avro functions to SparkR

2020-11-03 Thread GitBox
zero323 commented on pull request #30216: URL: https://github.com/apache/spark/pull/30216#issuecomment-720312377 I am going to rebase it to master, to fix AppVeyor failure. This is an automated message from the Apache Git

[GitHub] [spark] SparkQA removed a comment on pull request #30228: [SPARK-33319][SQL][TEST] Add all built-in SerDes to HiveSerDeReadWriteSuite

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30228: URL: https://github.com/apache/spark/pull/30228#issuecomment-720515948 **[Test build #130528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130528/testReport)** for PR 30228 at commit

[GitHub] [spark] bersprockets commented on a change in pull request #30207: [SPARK-33098][SQL] Avoid MetaException by not pushing down partition filters with incompatible types

2020-11-03 Thread GitBox
bersprockets commented on a change in pull request #30207: URL: https://github.com/apache/spark/pull/30207#discussion_r516069825 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ## @@ -726,33 +726,79 @@ private[client] class Shim_v0_13

[GitHub] [spark] xuanyuanking commented on pull request #30148: [SPARK-33244][SQL] Unify the code paths for spark.table and spark.read.table

2020-11-03 Thread GitBox
xuanyuanking commented on pull request #30148: URL: https://github.com/apache/spark/pull/30148#issuecomment-720391093 Sorry for the late reply, and thanks for the discussion. ``` cc. @cloud-fan as I remember we had a related discussion in other PR. ``` Find the discussion

[GitHub] [spark] HeartSaVioR commented on pull request #30151: [SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-11-03 Thread GitBox
HeartSaVioR commented on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-720287073 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30164: [SPARK-32919][SHUFFLE] Driver side changes for coordinating push based shuffle by selecting external shuffle services for mergi

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-720725934 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30232: [SPARK-33156][INFRA][2.4] Upgrade GithubAction image from 18.04 to 20.04

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30232: URL: https://github.com/apache/spark/pull/30232#issuecomment-720895587 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30221: URL: https://github.com/apache/spark/pull/30221#issuecomment-720887109 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30231: [SPARK-33156][INFRA][3.0] Upgrade GithubAction image from 18.04 to 20.04

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30231: URL: https://github.com/apache/spark/pull/30231#issuecomment-720884752 **[Test build #130546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130546/testReport)** for PR 30231 at commit

[GitHub] [spark] dongjoon-hyun closed pull request #30223: [SPARK-33306][SQL][FOLLOWUP] Group DateType and TimestampType together in `needsTimeZone()`

2020-11-03 Thread GitBox
dongjoon-hyun closed pull request #30223: URL: https://github.com/apache/spark/pull/30223 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA removed a comment on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-720851948 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29082: [SPARK-32288][UI] Add exception summary for failed tasks in stage page

2020-11-03 Thread GitBox
SparkQA commented on pull request #29082: URL: https://github.com/apache/spark/pull/29082#issuecomment-720852047 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] xuanyuanking commented on pull request #30210: [SPARK-33259][SS] Disable streaming query with possible correctness issue by default

2020-11-03 Thread GitBox
xuanyuanking commented on pull request #30210: URL: https://github.com/apache/spark/pull/30210#issuecomment-720378892 I think it's ok to change the original param to a SQL config for end users. ``` This change may break some query which may work if end users are super careful and

[GitHub] [spark] AmplabJenkins commented on pull request #30181: [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in SQL (pyspark.sql.*)

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30181: URL: https://github.com/apache/spark/pull/30181#issuecomment-720821511 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30231: [SPARK-33156][INFRA][3.0] Upgrade GithubAction image from 18.04 to 20.04

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30231: URL: https://github.com/apache/spark/pull/30231#issuecomment-720885119 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30233: [SPARK-33324][K8S][BUILD] Upgrade kubernetes-client to 4.11.1

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30233: URL: https://github.com/apache/spark/pull/30233#issuecomment-720921250 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-720467422 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

2020-11-03 Thread GitBox
dongjoon-hyun commented on a change in pull request #30222: URL: https://github.com/apache/spark/pull/30222#discussion_r516165401 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -510,6 +510,10 @@ object

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-720251110 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29247: [SPARK-32446][SHS] Add new executor metrics summary REST APIs

2020-11-03 Thread GitBox
SparkQA commented on pull request #29247: URL: https://github.com/apache/spark/pull/29247#issuecomment-720889773 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

2020-11-03 Thread GitBox
HyukjinKwon commented on a change in pull request #30221: URL: https://github.com/apache/spark/pull/30221#discussion_r515851255 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala ## @@ -171,9 +171,15 @@ private[sql] object AvroUtils extends

[GitHub] [spark] gengliangwang commented on pull request #30224: [SPARK-33316][SQL] Support user provided nullable Avro schema for non-nullable catalyst schema in Avro writing

2020-11-03 Thread GitBox
gengliangwang commented on pull request #30224: URL: https://github.com/apache/spark/pull/30224#issuecomment-720383451 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30151: [SPARK-33223][SS][UI]Structured Streaming Web UI state information

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30151: URL: https://github.com/apache/spark/pull/30151#issuecomment-721055509 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-720230639 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30228: [SPARK-33319][SQL][TEST] Add all built-in SerDes to HiveSerDeReadWriteSuite

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30228: URL: https://github.com/apache/spark/pull/30228#issuecomment-720562718 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #30181: [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in SQL (pyspark.sql.*)

2020-11-03 Thread GitBox
dongjoon-hyun commented on pull request #30181: URL: https://github.com/apache/spark/pull/30181#issuecomment-720640499 Could you resolve the conflicts, @HyukjinKwon ? This is an automated message from the Apache Git Service.

[GitHub] [spark] gengliangwang commented on a change in pull request #30224: [SPARK-33316][SQL] Support user provided nullable Avro schema for non-nullable catalyst schema in Avro writing

2020-11-03 Thread GitBox
gengliangwang commented on a change in pull request #30224: URL: https://github.com/apache/spark/pull/30224#discussion_r515960190 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroFunctionsSuite.scala ## @@ -201,4 +201,40 @@ class AvroFunctionsSuite

[GitHub] [spark] bersprockets commented on a change in pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

2020-11-03 Thread GitBox
bersprockets commented on a change in pull request #30221: URL: https://github.com/apache/spark/pull/30221#discussion_r516073775 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala ## @@ -171,9 +171,15 @@ private[sql] object AvroUtils extends

[GitHub] [spark] mridulm commented on a change in pull request #29090: [SPARK-32293] Fix inconsistency between Spark memory configs and JVM option

2020-11-03 Thread GitBox
mridulm commented on a change in pull request #29090: URL: https://github.com/apache/spark/pull/29090#discussion_r516543107 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -249,7 +249,7 @@ private[deploy] class

[GitHub] [spark] AmplabJenkins commented on pull request #29533: [SPARK-24266][K8S][3.0] Restart the watcher when we receive a version changed from k8s

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #29533: URL: https://github.com/apache/spark/pull/29533#issuecomment-720922922 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

2020-11-03 Thread GitBox
SparkQA commented on pull request #30222: URL: https://github.com/apache/spark/pull/30222#issuecomment-720280772 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA removed a comment on pull request #30233: [SPARK-33324][K8S][BUILD] Upgrade kubernetes-client to 4.11.1

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30233: URL: https://github.com/apache/spark/pull/30233#issuecomment-720901020 **[Test build #130553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130553/testReport)** for PR 30233 at commit

[GitHub] [spark] zero323 edited a comment on pull request #30227: [SPARK-33257][PYTHON][SQL] Support Column inputs in PySpark ordering functions (asc*, desc*)

2020-11-03 Thread GitBox
zero323 edited a comment on pull request #30227: URL: https://github.com/apache/spark/pull/30227#issuecomment-720484504 I'll adjust this, once SPARK-33250 / https://github.com/apache/spark/pull/30181 is merged. This is an

[GitHub] [spark] AmplabJenkins commented on pull request #30223: [SPARK-33306][SQL][FOLLOWUP] Group DateType and TimestampType together in `needsTimeZone()`

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30223: URL: https://github.com/apache/spark/pull/30223#issuecomment-720382265 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] srowen commented on a change in pull request #30181: [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in SQL (pyspark.sql.*)

2020-11-03 Thread GitBox
srowen commented on a change in pull request #30181: URL: https://github.com/apache/spark/pull/30181#discussion_r515968632 ## File path: python/pyspark/sql/column.py ## @@ -244,9 +251,14 @@ def __contains__(self, item): _bitwiseOR_doc = """ Compute bitwise OR of this

[GitHub] [spark] SparkQA commented on pull request #30224: [SPARK-33316][SQL] Support user provided nullable Avro schema for non-nullable catalyst schema in Avro writing

2020-11-03 Thread GitBox
SparkQA commented on pull request #30224: URL: https://github.com/apache/spark/pull/30224#issuecomment-720389307 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] github-actions[bot] closed pull request #29021: [SPARK-32201][SQL] More general skew join pattern matching

2020-11-03 Thread GitBox
github-actions[bot] closed pull request #29021: URL: https://github.com/apache/spark/pull/29021 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-720467422 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] wangyum commented on pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

2020-11-03 Thread GitBox
wangyum commented on pull request #30222: URL: https://github.com/apache/spark/pull/30222#issuecomment-720320498 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] dongjoon-hyun commented on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

2020-11-03 Thread GitBox
dongjoon-hyun commented on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-720568294 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #30181: [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in SQL (pyspark.sql.*)

2020-11-03 Thread GitBox
HyukjinKwon commented on pull request #30181: URL: https://github.com/apache/spark/pull/30181#issuecomment-720812329 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] SparkQA removed a comment on pull request #29533: [SPARK-24266][K8S][3.0] Restart the watcher when we receive a version changed from k8s

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #29533: URL: https://github.com/apache/spark/pull/29533#issuecomment-720917585 **[Test build #130558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130558/testReport)** for PR 29533 at commit

[GitHub] [spark] warrenzhu25 commented on a change in pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

2020-11-03 Thread GitBox
warrenzhu25 commented on a change in pull request #30186: URL: https://github.com/apache/spark/pull/30186#discussion_r516384584 ## File path: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html ## @@ -86,6 +86,22 @@ Executors

[GitHub] [spark] Ngone51 commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

2020-11-03 Thread GitBox
Ngone51 commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-720998937 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] wangyum commented on a change in pull request #30228: [SPARK-33319][SQL][TEST] Add all built-in SerDes to HiveSerDeReadWriteSuite

2020-11-03 Thread GitBox
wangyum commented on a change in pull request #30228: URL: https://github.com/apache/spark/pull/30228#discussion_r516021085 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveSerDeReadWriteSuite.scala ## @@ -135,11 +135,12 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30181: [SPARK-33250][PYTHON][DOCS] Migration to NumPy documentation style in SQL (pyspark.sql.*)

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30181: URL: https://github.com/apache/spark/pull/30181#issuecomment-720821511 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-720209654 **[Test build #130514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130514/testReport)** for PR 28841 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30227: [SPARK-33257][PYTHON][SQL] Support Column inputs in PySpark ordering functions (asc*, desc*)

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30227: URL: https://github.com/apache/spark/pull/30227#issuecomment-720494098 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] gatorsmile commented on pull request #30224: [SPARK-33316][SQL] Support user provided nullable Avro schema for non-nullable catalyst schema in Avro writing

2020-11-03 Thread GitBox
gatorsmile commented on pull request #30224: URL: https://github.com/apache/spark/pull/30224#issuecomment-720879048 cc @dbtsai This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] viirya commented on a change in pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

2020-11-03 Thread GitBox
viirya commented on a change in pull request #30221: URL: https://github.com/apache/spark/pull/30221#discussion_r515794920 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala ## @@ -171,9 +171,15 @@ private[sql] object AvroUtils extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30221: [SPARK-33314][SQL] Avoid dropping rows in Avro reader

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30221: URL: https://github.com/apache/spark/pull/30221#issuecomment-720887109 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] PedroCorreiaLuis commented on pull request #26319: [SPARK-29594][SQL] Provide better error message when creating a Dataset from a Sequence of Case class where a field name started wit

2020-11-03 Thread GitBox
PedroCorreiaLuis commented on pull request #26319: URL: https://github.com/apache/spark/pull/26319#issuecomment-720675875 > I agree with avoiding the compilation error. On the other hand, I think that we need to provide the better error message regarding the following case by seeing

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30216: [SPARK-33304][R][SQL] Add from_avro and to_avro functions to SparkR

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30216: URL: https://github.com/apache/spark/pull/30216#issuecomment-720328716 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #30223: [SPARK-33306][SQL][FOLLOWUP] Group DateType and TimestampType together in `needsTimeZone()`

2020-11-03 Thread GitBox
cloud-fan commented on pull request #30223: URL: https://github.com/apache/spark/pull/30223#issuecomment-720593185 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30222: URL: https://github.com/apache/spark/pull/30222#issuecomment-720308627 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

2020-11-03 Thread GitBox
SparkQA commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-720851948 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA removed a comment on pull request #30186: [SPARK-23432][UI] Add executor peak jvm memory metrics in executors page

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30186: URL: https://github.com/apache/spark/pull/30186#issuecomment-720845266 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30216: [SPARK-33304][R][SQL] Add from_avro and to_avro functions to SparkR

2020-11-03 Thread GitBox
SparkQA commented on pull request #30216: URL: https://github.com/apache/spark/pull/30216#issuecomment-720311708 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] imback82 commented on a change in pull request #30229: [SPARK-33321][SQL] Migrate ANALYZE TABLE commands to use UnresolvedTable/UnresolvedTableOrView to resolve the identifier

2020-11-03 Thread GitBox
imback82 commented on a change in pull request #30229: URL: https://github.com/apache/spark/pull/30229#discussion_r516433011 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -175,7 +175,10 @@ abstract class SQLViewSuite extends

[GitHub] [spark] SparkQA removed a comment on pull request #30038: [SPARK-33130][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect)

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30038: URL: https://github.com/apache/spark/pull/30038#issuecomment-720274768 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29935: [SPARK-33055][PYTHON][SQL] Add Python CalendarIntervalType

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #29935: URL: https://github.com/apache/spark/pull/29935#issuecomment-721059608 **[Test build #130565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130565/testReport)** for PR 29935 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-720610136 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] imback82 opened a new pull request #30229: [SPARK-33321][SQL] Migrate ANALYZE TABLE commands to use UnresolvedTable/UnresolvedTableOrView to resolve the identifier

2020-11-03 Thread GitBox
imback82 opened a new pull request #30229: URL: https://github.com/apache/spark/pull/30229 ### What changes were proposed in this pull request? This PR proposes to migrate `ANALYZE TABLE` and `ANALYZE TABLE ... FOR COLUMNS` to use `UnresolvedTable` and

[GitHub] [spark] AmplabJenkins commented on pull request #29935: [SPARK-33055][PYTHON][SQL] Add Python CalendarIntervalType

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #29935: URL: https://github.com/apache/spark/pull/29935#issuecomment-721069588 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-11-03 Thread GitBox
SparkQA commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-720291462 **[Test build #130514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130514/testReport)** for PR 28841 at commit

[GitHub] [spark] SparkQA commented on pull request #29533: [SPARK-24266][K8S][3.0] Restart the watcher when we receive a version changed from k8s

2020-11-03 Thread GitBox
SparkQA commented on pull request #29533: URL: https://github.com/apache/spark/pull/29533#issuecomment-720917585 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] wangyum opened a new pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

2020-11-03 Thread GitBox
wangyum opened a new pull request #30222: URL: https://github.com/apache/spark/pull/30222 ### What changes were proposed in this pull request? This pr simplify `CaseWhen` with `EqualTo`, for exmaple: ```sql create table t(a int, b int, c int) using parquet; SELECT * FROM

[GitHub] [spark] SparkQA removed a comment on pull request #30230: [SPARK-33323][SQL] Add query resolved check before convert hive relation

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30230: URL: https://github.com/apache/spark/pull/30230#issuecomment-720875095 **[Test build #130543 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130543/testReport)** for PR 30230 at commit

[GitHub] [spark] kiszk edited a comment on pull request #26319: [SPARK-29594][SQL] Provide better error message when creating a Dataset from a Sequence of Case class where a field name started with a

2020-11-03 Thread GitBox
kiszk edited a comment on pull request #26319: URL: https://github.com/apache/spark/pull/26319#issuecomment-720634523 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30231: [SPARK-33156][INFRA][3.0] Upgrade GithubAction image from 18.04 to 20.04

2020-11-03 Thread GitBox
AmplabJenkins removed a comment on pull request #30231: URL: https://github.com/apache/spark/pull/30231#issuecomment-720885119 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30224: [SPARK-33316][SQL] Support user provided nullable Avro schema for non-nullable catalyst schema in Avro writing

2020-11-03 Thread GitBox
AmplabJenkins commented on pull request #30224: URL: https://github.com/apache/spark/pull/30224#issuecomment-720385125 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30229: [SPARK-33321][SQL] Migrate ANALYZE TABLE commands to use UnresolvedTable/UnresolvedTableOrView to resolve the identifier

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30229: URL: https://github.com/apache/spark/pull/30229#issuecomment-720821389 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30227: [SPARK-33257][PYTHON][SQL] Support Column inputs in PySpark ordering functions (asc*, desc*)

2020-11-03 Thread GitBox
SparkQA removed a comment on pull request #30227: URL: https://github.com/apache/spark/pull/30227#issuecomment-720482484 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #30222: [SPARK-33315][SQL] Simplify CaseWhen with EqualTo

2020-11-03 Thread GitBox
dongjoon-hyun commented on pull request #30222: URL: https://github.com/apache/spark/pull/30222#issuecomment-720639579 Also, cc @cloud-fan and @sunchao This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] dongjoon-hyun closed pull request #30233: [SPARK-33324][K8S][BUILD] Upgrade kubernetes-client to 4.11.1

2020-11-03 Thread GitBox
dongjoon-hyun closed pull request #30233: URL: https://github.com/apache/spark/pull/30233 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] MaxGekk commented on a change in pull request #30224: [SPARK-33316][SQL] Support user provided nullable Avro schema for non-nullable catalyst schema in Avro writing

2020-11-03 Thread GitBox
MaxGekk commented on a change in pull request #30224: URL: https://github.com/apache/spark/pull/30224#discussion_r515990828 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -1015,6 +1015,69 @@ abstract class AvroSuite } } +

<    2   3   4   5   6   7