[GitHub] [spark] SparkQA commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF

2020-01-06 Thread GitBox
SparkQA commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF URL: https://github.com/apache/spark/pull/25024#issuecomment-571339836 **[Test build #116183 has

[GitHub] [spark] SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571332914 Kubernetes integration test starting URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-571330348 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-571330331 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-571330348 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571329537 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-571330331 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-571234526 **[Test build #116182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116182/testReport)**

[GitHub] [spark] SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571327718 **[Test build #116190 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571329524 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571329524 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571329510 **[Test build #116190 has

[GitHub] [spark] SparkQA commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-06 Thread GitBox
SparkQA commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-571329654 **[Test build #116182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116182/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571329537 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571327718 **[Test build #116190 has

[GitHub] [spark] viirya commented on a change in pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
viirya commented on a change in pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#discussion_r363491931 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571316985 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571316219 **[Test build #116189 has

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571316985 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571316959 **[Test build #116189 has

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571316975 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571316975 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571316219 **[Test build #116189 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571313973 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571313967 Merged build finished. Test PASSed.

[GitHub] [spark] tgravescs commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-06 Thread GitBox
tgravescs commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571314271 I added in the pyspark support This is

[GitHub] [spark] AmplabJenkins commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571313967 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571313973 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
SparkQA commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571313406 **[Test build #116188 has

[GitHub] [spark] tgravescs commented on issue #26696: [WIP][SPARK-18886][CORE] Make locality wait time be the time since a TSM's available slots were fully utilized

2020-01-06 Thread GitBox
tgravescs commented on issue #26696: [WIP][SPARK-18886][CORE] Make locality wait time be the time since a TSM's available slots were fully utilized URL: https://github.com/apache/spark/pull/26696#issuecomment-571311572 > One remaining case that isn't handled: > Before any "all free

[GitHub] [spark] joshrosen-stripe commented on a change in pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
joshrosen-stripe commented on a change in pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#discussion_r363479947 ## File path:

[GitHub] [spark] tinhto-000 commented on a change in pull request #26955: [SPARK-30310] [Core] Resolve missing match case in SparkUncaughtExceptionHandler and added tests

2020-01-06 Thread GitBox
tinhto-000 commented on a change in pull request #26955: [SPARK-30310] [Core] Resolve missing match case in SparkUncaughtExceptionHandler and added tests URL: https://github.com/apache/spark/pull/26955#discussion_r363475923 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363471020 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363470570 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363473266 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363470002 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363471925 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363470718 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363471618 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363472016 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363474668 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363471411 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363469587 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363467451 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363468030 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on a change in pull request #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r363472397 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-571305449 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-571305460 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-571305449 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-571305460 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] zero323 commented on a change in pull request #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-06 Thread GitBox
zero323 commented on a change in pull request #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#discussion_r363472878 ## File path: python/pyspark/sql/dataframe.py ## @@ -31,23

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-06 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-571304820 **[Test build #116187 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][CORE]: repartition after join is not optimized away

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][CORE]: repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-570843855 Can one of the admins verify this patch?

[GitHub] [spark] dbtsai commented on issue #27096: [SPARK-28148][CORE]: repartition after join is not optimized away

2020-01-06 Thread GitBox
dbtsai commented on issue #27096: [SPARK-28148][CORE]: repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-571303226 Jenkins, ok to test. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571302669 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571302669 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571302657 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571302657 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571213066 **[Test build #116181 has

[GitHub] [spark] SparkQA commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-06 Thread GitBox
SparkQA commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571302080 **[Test build #116181 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-571299651 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-571299660 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-571299651 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-571299660 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-06 Thread GitBox
SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-571299086 **[Test build #116186 has

[GitHub] [spark] dongjoon-hyun commented on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost

2020-01-06 Thread GitBox
dongjoon-hyun commented on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost URL: https://github.com/apache/spark/pull/24457#issuecomment-571294006 While preparing at 2.4.5 release, I just noticed that this was closed recently and we might

[GitHub] [spark] AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571284825 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost URL: https://github.com/apache/spark/pull/24457#issuecomment-571283979 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571284808 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571284825 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571284808 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost URL: https://github.com/apache/spark/pull/24457#issuecomment-571284551 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost URL: https://github.com/apache/spark/pull/24457#issuecomment-571283979 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
SparkQA commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571284101 **[Test build #116185 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost URL: https://github.com/apache/spark/pull/24457#issuecomment-531894048 Can one of the admins verify this patch?

[GitHub] [spark] viirya commented on a change in pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
viirya commented on a change in pull request #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#discussion_r363451729 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost

2020-01-06 Thread GitBox
dongjoon-hyun commented on a change in pull request #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost URL: https://github.com/apache/spark/pull/24457#discussion_r363451556 ## File path:

[GitHub] [spark] LiangchangZ opened a new pull request #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost

2020-01-06 Thread GitBox
LiangchangZ opened a new pull request #24457: [SPARK-27340][SS] Alias on TimeWindow expression may cause watermark metadata lost URL: https://github.com/apache/spark/pull/24457 ## What changes were proposed in this pull request? `window($"fooTime", "2 seconds").alias("fooWindow")`

[GitHub] [spark] vanzin commented on issue #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-06 Thread GitBox
vanzin commented on issue #26440: [WIP][SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-571282142 > recomissioning is something I considered out of scope Recommissioning might be tricky,

[GitHub] [spark] gengliangwang commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-01-06 Thread GitBox
gengliangwang commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r363444748 ## File path:

[GitHub] [spark] joshrosen-stripe commented on issue #27089: [SPARK-30414][SQL] ParquetRowConverter optimizations: arrays, maps, plus misc. constant factors

2020-01-06 Thread GitBox
joshrosen-stripe commented on issue #27089: [SPARK-30414][SQL] ParquetRowConverter optimizations: arrays, maps, plus misc. constant factors URL: https://github.com/apache/spark/pull/27089#issuecomment-571276738 @cloud-fan @HyukjinKwon @dongjoon-hyun @viirya, could you take a look at this

[GitHub] [spark] tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-06 Thread GitBox
tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-571276795 looks like new test added that I wasn't upmerged to, upmerging and looking

[GitHub] [spark] gatorsmile commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-01-06 Thread GitBox
gatorsmile commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-571276597 cc @viirya Sorry for the late reply. Are you fine to address the above comment?

[GitHub] [spark] gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-01-06 Thread GitBox
gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r363444039 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571275165 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] joshrosen-stripe edited a comment on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
joshrosen-stripe edited a comment on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571273025 @cloud-fan @dongjoon-hyun @viirya, could you take a look at this PR optimizing nested

[GitHub] [spark] SparkQA removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
SparkQA removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571274416 **[Test build #116184 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571275154 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
SparkQA commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571275144 **[Test build #116184 has

[GitHub] [spark] AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571275154 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571275165 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
SparkQA commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571274416 **[Test build #116184 has

[GitHub] [spark] joshrosen-stripe commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

2020-01-06 Thread GitBox
joshrosen-stripe commented on issue #26993: [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter URL: https://github.com/apache/spark/pull/26993#issuecomment-571273025 @cloud-fan @dongjoon-hyun @viirya, could you take a look at this PR optimizing nested struct

[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571272335 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571272321 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571272335 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571272321 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571271761 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins removed a comment on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571271770 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-06 Thread GitBox
AmplabJenkins commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571271761 Merged build finished. Test PASSed. This

<    2   3   4   5   6   7   8   9   10   11   >