[GitHub] [spark] SparkQA removed a comment on pull request #30488: [SPARK-33071][SPARK-33536][SQL] Avoid changing dataset_id of LogicalPlan in join() to not break DetectAmbiguousSelfJoin

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30488: URL: https://github.com/apache/spark/pull/30488#issuecomment-733450217 **[Test build #131728 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131728/testReport)** for PR 30488 at commit

[GitHub] [spark] SparkQA commented on pull request #30488: [SPARK-33071][SPARK-33536][SQL] Avoid changing dataset_id of LogicalPlan in join() to not break DetectAmbiguousSelfJoin

2020-11-24 Thread GitBox
SparkQA commented on pull request #30488: URL: https://github.com/apache/spark/pull/30488#issuecomment-733533102 **[Test build #131728 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131728/testReport)** for PR 30488 at commit

[GitHub] [spark] wangyum commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

2020-11-24 Thread GitBox
wangyum commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733527228 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] HyukjinKwon commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
HyukjinKwon commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733526016 retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon closed pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

2020-11-24 Thread GitBox
HyukjinKwon closed pull request #30408: URL: https://github.com/apache/spark/pull/30408 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

2020-11-24 Thread GitBox
HyukjinKwon commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733525530 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733433490 **[Test build #131725 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131725/testReport)** for PR 30421 at commit

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733520649 **[Test build #131725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131725/testReport)** for PR 30421 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733467470 **[Test build #131734 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131734/testReport)** for PR 30478 at commit

[GitHub] [spark] SparkQA commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

2020-11-24 Thread GitBox
SparkQA commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733520238 **[Test build #131734 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131734/testReport)** for PR 30478 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733471851 **[Test build #131740 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131740/testReport)** for PR 30408 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30242: [SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop consuming after the task ends.

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-733415179 **[Test build #131717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131717/testReport)** for PR 30242 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733415048 **[Test build #131716 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131716/testReport)** for PR 30412 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30484: [SPARK-33532][SQL] Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30484: URL: https://github.com/apache/spark/pull/30484#issuecomment-733433369 **[Test build #131724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131724/testReport)** for PR 30484 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733512605 **[Test build #131748 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131748/testReport)** for PR 30475 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733418271 **[Test build #131719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131719/testReport)** for PR 29066 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

2020-11-24 Thread GitBox
HyukjinKwon commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733519983 Thank you @dongjoon-hyun! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] dongjoon-hyun commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

2020-11-24 Thread GitBox
dongjoon-hyun commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733519344 +1, LGTM (Pending CI) This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

2020-11-24 Thread GitBox
SparkQA commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733516303 **[Test build #131751 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131751/testReport)** for PR 30408 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733515623 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] beliefer commented on a change in pull request #30387: [SPARK-33443][SQL] LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-11-24 Thread GitBox
beliefer commented on a change in pull request #30387: URL: https://github.com/apache/spark/pull/30387#discussion_r530151304 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -938,8 +938,40 @@ object functions { * @group window_funcs *

[GitHub] [spark] SparkQA commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

2020-11-24 Thread GitBox
SparkQA commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733515605 **[Test build #131748 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131748/testReport)** for PR 30475 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733515306 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] wangyum commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

2020-11-24 Thread GitBox
wangyum commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733515064 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
SparkQA commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733514734 **[Test build #131719 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131719/testReport)** for PR 29066 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733513051 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
SparkQA commented on pull request #30289: URL: https://github.com/apache/spark/pull/30289#issuecomment-733512958 **[Test build #131749 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131749/testReport)** for PR 30289 at commit

[GitHub] [spark] SparkQA commented on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

2020-11-24 Thread GitBox
SparkQA commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733512932 **[Test build #131750 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131750/testReport)** for PR 29893 at commit

[GitHub] [spark] SparkQA commented on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
SparkQA commented on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-733512705 **[Test build #131747 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131747/testReport)** for PR 30479 at commit

[GitHub] [spark] SparkQA commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

2020-11-24 Thread GitBox
SparkQA commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733512605 **[Test build #131748 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131748/testReport)** for PR 30475 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30242: [SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop consuming after the task ends.

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-733511510 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30484: [SPARK-33532][SQL] Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30484: URL: https://github.com/apache/spark/pull/30484#issuecomment-733510794 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733510497 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733510493 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733510488 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733510503 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30242: [SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop consuming after the task ends.

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-733510490 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733510495 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30242: [SPARK-33277][PYSPARK][SQL] Use ContextAwareIterator to stop consuming after the task ends.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30242: URL: https://github.com/apache/spark/pull/30242#issuecomment-733510321 **[Test build #131717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131717/testReport)** for PR 30242 at commit

[GitHub] [spark] SparkQA commented on pull request #30484: [SPARK-33532][SQL] Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

2020-11-24 Thread GitBox
SparkQA commented on pull request #30484: URL: https://github.com/apache/spark/pull/30484#issuecomment-733509871 **[Test build #131724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131724/testReport)** for PR 30484 at commit

[GitHub] [spark] luluorta commented on pull request #30495: [SPARK-33548][WEBUI] display the jvm peak memory usage on the executor ui

2020-11-24 Thread GitBox
luluorta commented on pull request #30495: URL: https://github.com/apache/spark/pull/30495#issuecomment-733508470 cc @cloud-fan Please review this patch, many thanks! This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore support filter by date type

2020-11-24 Thread GitBox
SparkQA commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733506446 **[Test build #131740 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131740/testReport)** for PR 30408 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

2020-11-24 Thread GitBox
HyukjinKwon commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733506294 @mcg1969 too FYI [conda-pack](https://conda.github.io/conda-pack/). With this change, users can use conda-pack in other cluster modes not only Yarn.

[GitHub] [spark] SparkQA commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733505877 **[Test build #131716 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131716/testReport)** for PR 30412 at commit

[GitHub] [spark] imback82 commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

2020-11-24 Thread GitBox
imback82 commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733505521 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] gengliangwang commented on a change in pull request #30493: [SPARK-33549][SQL] Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread GitBox
gengliangwang commented on a change in pull request #30493: URL: https://github.com/apache/spark/pull/30493#discussion_r530140422 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala ## @@ -1311,20 +1311,6 @@ class CastSuite

[GitHub] [spark] yaooqinn removed a comment on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

2020-11-24 Thread GitBox
yaooqinn removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733501539 retest this please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] yaooqinn commented on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

2020-11-24 Thread GitBox
yaooqinn commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733501529 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] luluorta commented on a change in pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on a change in pull request #30289: URL: https://github.com/apache/spark/pull/30289#discussion_r530133325 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala ## @@ -361,11 +364,34 @@ object ViewHelper { } } +

[GitHub] [spark] luluorta commented on pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on pull request #30289: URL: https://github.com/apache/spark/pull/30289#issuecomment-733500255 > can we copy-paste more context from JIRA tickets to the PR description? I added more background information to the PR description.

[GitHub] [spark] mridulm commented on pull request #30450: [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to fetch driver log links in yarn.Client

2020-11-24 Thread GitBox
mridulm commented on pull request #30450: URL: https://github.com/apache/spark/pull/30450#issuecomment-733500240 Given vacation time, I will leave this open so that @otterc @tgravescs and @HeartSaVioR have sufficient time to get to it.

[GitHub] [spark] mridulm commented on a change in pull request #30450: [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to fetch driver log links in yarn.Client

2020-11-24 Thread GitBox
mridulm commented on a change in pull request #30450: URL: https://github.com/apache/spark/pull/30450#discussion_r530136636 ## File path: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala ## @@ -230,6 +230,37 @@ class YarnClusterSuite

[GitHub] [spark] MaxGekk commented on a change in pull request #30493: [SPARK-33549][SQL] Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30493: URL: https://github.com/apache/spark/pull/30493#discussion_r530136005 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala ## @@ -1311,20 +1311,6 @@ class CastSuite extends

[GitHub] [spark] luluorta commented on a change in pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on a change in pull request #30289: URL: https://github.com/apache/spark/pull/30289#discussion_r530134316 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala ## @@ -361,11 +379,38 @@ object ViewHelper { } } +

[GitHub] [spark] luluorta commented on a change in pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on a change in pull request #30289: URL: https://github.com/apache/spark/pull/30289#discussion_r530133390 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala ## @@ -414,6 +433,8 @@ object CatalogTable { val

[GitHub] [spark] luluorta commented on a change in pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on a change in pull request #30289: URL: https://github.com/apache/spark/pull/30289#discussion_r530133325 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala ## @@ -361,11 +364,34 @@ object ViewHelper { } } +

[GitHub] [spark] SparkQA removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733488765 **[Test build #131745 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131745/testReport)** for PR 30403 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733492330 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733492330 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733492307 **[Test build #131745 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131745/testReport)** for PR 30403 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

2020-11-24 Thread GitBox
dongjoon-hyun commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733492363 It's a little weird because it passed locally. ``` $ build/sbt "core/testOnly *.FallbackStorageSuite" ... [info] FallbackStorageSuite: [info] - fallback

[GitHub] [spark] luluorta commented on a change in pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on a change in pull request #30289: URL: https://github.com/apache/spark/pull/30289#discussion_r530130202 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -748,4 +748,30 @@ abstract class SQLViewSuite extends

[GitHub] [spark] luluorta commented on a change in pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on a change in pull request #30289: URL: https://github.com/apache/spark/pull/30289#discussion_r530130052 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala ## @@ -771,22 +771,24 @@ class AnalysisSuite

[GitHub] [spark] luluorta commented on a change in pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
luluorta commented on a change in pull request #30289: URL: https://github.com/apache/spark/pull/30289#discussion_r530129632 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -132,9 +132,11 @@ object AnalysisContext { */

[GitHub] [spark] gaborgsomogyi commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

2020-11-24 Thread GitBox
gaborgsomogyi commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733490462 Thank you all for taking care! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733490038 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733490070 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733490038 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733490070 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733419129 **[Test build #131721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131721/testReport)** for PR 30440 at commit

[GitHub] [spark] SparkQA commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
SparkQA commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733489487 **[Test build #131721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131721/testReport)** for PR 30440 at commit

[GitHub] [spark] SparkQA commented on pull request #30289: [SPARK-33141][SQL] Capture SQL configs when creating permanent views

2020-11-24 Thread GitBox
SparkQA commented on pull request #30289: URL: https://github.com/apache/spark/pull/30289#issuecomment-733488853 **[Test build #131746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131746/testReport)** for PR 30289 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30493: [SPARK-33549][SQL] Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30493: URL: https://github.com/apache/spark/pull/30493#issuecomment-733470894 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733488765 **[Test build #131745 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131745/testReport)** for PR 30403 at commit

[GitHub] [spark] SparkQA commented on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-24 Thread GitBox
SparkQA commented on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-733488754 **[Test build #131744 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131744/testReport)** for PR 30442 at commit

[GitHub] [spark] SparkQA commented on pull request #30493: [SPARK-33549][SQL] Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread GitBox
SparkQA commented on pull request #30493: URL: https://github.com/apache/spark/pull/30493#issuecomment-733488636 **[Test build #131742 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131742/testReport)** for PR 30493 at commit

[GitHub] [spark] SparkQA commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

2020-11-24 Thread GitBox
SparkQA commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733488641 **[Test build #131743 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131743/testReport)** for PR 30486 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29994: [DONOTMERGE][WHITESPACE] workflow exercise

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #29994: URL: https://github.com/apache/spark/pull/29994#issuecomment-733488127 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29994: [DONOTMERGE][WHITESPACE] workflow exercise

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29994: URL: https://github.com/apache/spark/pull/29994#issuecomment-733488127 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30495: [SPARK-33548][WEBUI] display the jvm peak memory usage on the executor ui

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30495: URL: https://github.com/apache/spark/pull/30495#issuecomment-733487363 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733486871 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733486877 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733486873 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733486874 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733486872 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733486871 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733486872 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733486884 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733486883 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733486877 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733450215 **[Test build #131727 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131727/testReport)** for PR 30492 at commit

[GitHub] [spark] SparkQA commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

2020-11-24 Thread GitBox
SparkQA commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733485444 **[Test build #131727 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131727/testReport)** for PR 30492 at commit

[GitHub] [spark] LuciferYang closed pull request #30353: [SPARK-33431][CORE][SQL][DSTREAM] Use Option.contains instead of instanceOfOption == Some(x)

2020-11-24 Thread GitBox
LuciferYang closed pull request #30353: URL: https://github.com/apache/spark/pull/30353 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA removed a comment on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733433901 **[Test build #131726 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131726/testReport)** for PR 29066 at commit

[GitHub] [spark] imback82 commented on a change in pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
imback82 commented on a change in pull request #30403: URL: https://github.com/apache/spark/pull/30403#discussion_r530121226 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -679,3 +679,30 @@ case class

[GitHub] [spark] SparkQA commented on pull request #29066: [SPARK-23889][SQL] DataSourceV2: required sorting and clustering for writes

2020-11-24 Thread GitBox
SparkQA commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-733480531 **[Test build #131726 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131726/testReport)** for PR 29066 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733470435 **[Test build #131738 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131738/testReport)** for PR 30494 at commit

[GitHub] [spark] SparkQA commented on pull request #30494: [SPARK-33551][SQL] Do not use custom shuffle reader for repartition

2020-11-24 Thread GitBox
SparkQA commented on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-733480069 **[Test build #131738 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131738/testReport)** for PR 30494 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733473558 **[Test build #131741 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131741/testReport)** for PR 30403 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

2020-11-24 Thread GitBox
HyukjinKwon commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733477920 Thanks @maropu and @dongjoon-hyun. I believe I addressed the comments. This is an automated message from

  1   2   3   4   5   6   7   8   9   10   >