[GitHub] [spark] jzhuge edited a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

jzhuge edited a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212984 There are 2 major design points in this PR: 1. Create TableIdentifierLike interface to ease the migration

[GitHub] [spark] jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212984 There are 2 major design points in this PR: 1. Create TableIdentifierLike interface to ease the migration from

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212241 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212238 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212238 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210112 **[Test build #105947 has

[GitHub] [spark] SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212225 **[Test build #105947 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210973 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212241 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211197 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211192 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211192 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211197 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210973 Can one of the admins verify this patch? This is

[GitHub] [spark] jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210795 This PR depends on #24686. It'd easier to review commit c504b2f only.

[GitHub] [spark] dongjoon-hyun closed pull request #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources

dongjoon-hyun closed pull request #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources URL: https://github.com/apache/spark/pull/24731 This is an automated message from the Apache Git Service.

[GitHub] [spark] SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210112 **[Test build #105947 has

[GitHub] [spark] jzhuge opened a new pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

jzhuge opened a new pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741 ## What changes were proposed in this pull request? Support multi-catalog in the following SELECT code paths: - SELECT *

[GitHub] [spark] dongjoon-hyun commented on issue #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources

dongjoon-hyun commented on issue #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources URL: https://github.com/apache/spark/pull/24731#issuecomment-497209414 @felixcheung . We can make `src/main/sh`(?), but it's more natural to consider this as a resource or

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208441 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192893 **[Test build #105944 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208438 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208441 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208295 **[Test build #105944 has

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208438 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206204 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206196 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206196 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497184193 **[Test build #105940 has

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206204 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205781 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205775 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206041 **[Test build #105940 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105940/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205775 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205781 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205721 Kubernetes integration test status failure URL:

[GitHub] [spark] SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497204145 Kubernetes integration test starting URL:

[GitHub] [spark] felixcheung commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

felixcheung commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497203881 @squito ?

[GitHub] [spark] felixcheung commented on a change in pull request #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses

felixcheung commented on a change in pull request #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses URL: https://github.com/apache/spark/pull/24730#discussion_r288858863 ## File path: core/src/main/scala/org/apache/spark/ResourceDiscoverer.scala

[GitHub] [spark] felixcheung commented on issue #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses

felixcheung commented on issue #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses URL: https://github.com/apache/spark/pull/24730#issuecomment-497203564 LGTM This is an automated message

[GitHub] [spark] SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497202172 **[Test build #105946 has

[GitHub] [spark] felixcheung commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

felixcheung commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-497202240 if this is performance, is there benchmarking result before/after?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200236 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200239 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200236 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200239 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

SparkQA removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497174193 **[Test build #105939 has

[GitHub] [spark] SparkQA commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

SparkQA commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497199962 **[Test build #105939 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199393 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199389 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199393 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199389 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497160400 **[Test build #105936 has

[GitHub] [spark] SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199060 **[Test build #105936 has

[GitHub] [spark] jzhuge commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

jzhuge commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288854088 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[GitHub] [spark] SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197434 **[Test build #105945 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197158 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197164 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197158 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197164 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

viirya commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497196750 retest this please This is an automated

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#discussion_r288850939 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#discussion_r288850842 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193766 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193770 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193770 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193766 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192893 **[Test build #105944 has

[GitHub] [spark] dongjoon-hyun commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

dongjoon-hyun commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192724 Retest this please This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192238 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192238 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192231 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192216 **[Test build #105943 has

[GitHub] [spark] SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497190475 **[Test build #105943 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192231 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191782 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191778 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191782 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191778 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

SparkQA removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497172744 **[Test build #105938 has

[GitHub] [spark] SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191624 **[Test build #105938 has

[GitHub] [spark] cxzl25 commented on a change in pull request #24497: [SPARK-27630][CORE] Stage retry causes totalRunningTasks calculation to be negative

cxzl25 commented on a change in pull request #24497: [SPARK-27630][CORE] Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#discussion_r288847965 ## File path:

[GitHub] [spark] gengliangwang edited a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

gengliangwang edited a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497190819 There are some test suites need to update later after this PR is merged: SQLMetricsSuite, FileStreamSinkSuite,

[GitHub] [spark] AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190717 Test FAILed. Refer to this link

[GitHub] [spark] turboFei commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

turboFei commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497191007 I will check it and resolve the unit test.

[GitHub] [spark] gengliangwang commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

gengliangwang commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497190819 There are some test suites need to finish later after this PR is merged: SQLMetricsSuite, FileStreamSinkSuite,

[GitHub] [spark] SparkQA removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

SparkQA removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190451 **[Test build #105942 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190712 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190712 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190703 **[Test build #105942 has

[GitHub] [spark] AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190717 Test FAILed. Refer to this link for build

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497190475 **[Test build #105943 has

[GitHub] [spark] ueshin commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

ueshin commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#discussion_r288847266 ## File path:

[GitHub] [spark] SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190451 **[Test build #105942 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190241 Test PASSed. Refer to this link

[GitHub] [spark] AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190241 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190236 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190236 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497190169 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497190167 Merged build finished. Test PASSed. This is an

  1   2   3   4   5   6   7   8   9   10   >