[GitHub] [spark] sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472714817 cc @gatorsmile

[GitHub] [spark] weixiuli commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

weixiuli commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-472714229 retest this please. This is an automated message from the Apache Git

[GitHub] [spark] dilipbiswal commented on issue #24073: [SPARK-27134][SQL] array_distinct function does not work correctly with columns containing array of array

dilipbiswal commented on issue #24073: [SPARK-27134][SQL] array_distinct function does not work correctly with columns containing array of array URL: https://github.com/apache/spark/pull/24073#issuecomment-472713494 @HyukjinKwon Hello.. the test seems to be stuck in

[GitHub] [spark] AmplabJenkins removed a comment on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

AmplabJenkins removed a comment on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#issuecomment-472709899 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

AmplabJenkins removed a comment on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#issuecomment-472709903 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

AmplabJenkins commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#issuecomment-472709903 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

AmplabJenkins commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#issuecomment-472709899 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

SparkQA commented on issue #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#issuecomment-472708906 **[Test build #103477 has

[GitHub] [spark] wangyum commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

wangyum commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#discussion_r265421635 ## File path:

[GitHub] [spark] wangyum commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

wangyum commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#discussion_r265421635 ## File path:

[GitHub] [spark] wangyum commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage

wangyum commented on a change in pull request #24018: [SPARK-23749][SQL] Replace built-in Hive API (isSub/toKryo) and remove OrcProto.Type usage URL: https://github.com/apache/spark/pull/24018#discussion_r265421635 ## File path:

[GitHub] [spark] SparkQA commented on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist

SparkQA commented on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist URL: https://github.com/apache/spark/pull/24069#issuecomment-472705028 **[Test build #103476 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist

AmplabJenkins removed a comment on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist URL: https://github.com/apache/spark/pull/24069#issuecomment-472704665 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist

AmplabJenkins removed a comment on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist URL: https://github.com/apache/spark/pull/24069#issuecomment-472704661 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist

AmplabJenkins commented on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist URL: https://github.com/apache/spark/pull/24069#issuecomment-472704661 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist

AmplabJenkins commented on issue #24069: [SPARK-27136][SQL] Remove data source option check_files_exist URL: https://github.com/apache/spark/pull/24069#issuecomment-472704665 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

AmplabJenkins removed a comment on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-472702317 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

AmplabJenkins commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-472702317 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

AmplabJenkins removed a comment on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-472702318 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

AmplabJenkins commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-472702318 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

SparkQA commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-472701445 **[Test build #103475 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

AmplabJenkins removed a comment on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-464177493 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

HyukjinKwon commented on issue #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#issuecomment-472701161 ok to test This is an

[GitHub] [spark] HyukjinKwon commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService.

HyukjinKwon commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService. URL: https://github.com/apache/spark/pull/23839#issuecomment-472700421 Yup, I think in the same way of @srowen's. This is an

[GitHub] [spark] lipzhu commented on a change in pull request #24086: [SPARK-27155][Build]update oracle docker image name

lipzhu commented on a change in pull request #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#discussion_r265416964 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

HyukjinKwon commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-472699571 BTW, what does this set of expressions support and enable usecases? My impression is that we can relatively easily workaround most

[GitHub] [spark] maropu commented on issue #23712: [SPARK-26798][SQL] HandleNullInputsForUDF should trust nullability

maropu commented on issue #23712: [SPARK-26798][SQL] HandleNullInputsForUDF should trust nullability URL: https://github.com/apache/spark/pull/23712#issuecomment-472698123 Never mind, @HyukjinKwon! Thanks! This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

AmplabJenkins removed a comment on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087#issuecomment-472697860 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

AmplabJenkins removed a comment on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087#issuecomment-472697859 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

AmplabJenkins commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087#issuecomment-472697860 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

AmplabJenkins commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087#issuecomment-472697859 Merged build finished. Test PASSed.

[GitHub] [spark] vanzin commented on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log

vanzin commented on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log URL: https://github.com/apache/spark/pull/23827#issuecomment-472697270 You don't need more support; I -1'ed the patch, so now you need to convince me to change my opinion.

[GitHub] [spark] dilipbiswal edited a comment on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

dilipbiswal edited a comment on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087#issuecomment-472697104 @cloud-fan Very sorry. i wasn't aware that we do

[GitHub] [spark] dilipbiswal commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

dilipbiswal commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087#issuecomment-472697104 @cloud-fan Very sorry. i wasn't aware that we do the join

[GitHub] [spark] SparkQA commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

SparkQA commented on issue #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087#issuecomment-472697083 **[Test build #103474 has

[GitHub] [spark] dilipbiswal opened a new pull request #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r

dilipbiswal opened a new pull request #24087: [SPARK-27096][SQL][FOLLOWUP] Do the correct validation of join types in R side and fix join docs for scala, python and r URL: https://github.com/apache/spark/pull/24087 ## What changes were proposed in this pull request? This is a minor

[GitHub] [spark] HyukjinKwon commented on issue #20826: [Spark-2489][SQL] Unsupported parquet datatype optional fixed_len_byte_array

HyukjinKwon commented on issue #20826: [Spark-2489][SQL] Unsupported parquet datatype optional fixed_len_byte_array URL: https://github.com/apache/spark/pull/20826#issuecomment-472695593 cc @rdblue for review since it;s a Parquet one.

[GitHub] [spark] felixcheung commented on a change in pull request #24086: [SPARK-27155][Build]update oracle docker image name

felixcheung commented on a change in pull request #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#discussion_r265411140 ## File path:

[GitHub] [spark] cloud-fan commented on issue #24050: [SPARK-27127][SQL] Deduplicate codes reading from/writing to unsafe object

cloud-fan commented on issue #24050: [SPARK-27127][SQL] Deduplicate codes reading from/writing to unsafe object URL: https://github.com/apache/spark/pull/24050#issuecomment-472690397 I'm worried about refactoring performance critical code like this. A lot of efforts are needed to prove

[GitHub] [spark] cloud-fan commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn

cloud-fan commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-472689934 I think it's hard to rewrite the comparison expressions to match the behavior of overflow. What's worse,

[GitHub] [spark] cloud-fan commented on issue #24028: [SPARK-26917][SQL] Further reduce locks in CacheManager

cloud-fan commented on issue #24028: [SPARK-26917][SQL] Further reduce locks in CacheManager URL: https://github.com/apache/spark/pull/24028#issuecomment-472689268 LGTM, pending jenkins This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on issue #23712: [SPARK-26798][SQL] HandleNullInputsForUDF should trust nullability

HyukjinKwon commented on issue #23712: [SPARK-26798][SQL] HandleNullInputsForUDF should trust nullability URL: https://github.com/apache/spark/pull/23712#issuecomment-472689061 Oops, I completely missed this thread. Sorry I noticed this one late :(.

[GitHub] [spark] cloud-fan commented on issue #24053: [SPARK-27126][SQL] Consolidate Scala and Java type deserializerFor

cloud-fan commented on issue #24053: [SPARK-27126][SQL] Consolidate Scala and Java type deserializerFor URL: https://github.com/apache/spark/pull/24053#issuecomment-472688959 sounds good, thanks! This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24086: [SPARK-27155][Build]update oracle docker image name

AmplabJenkins removed a comment on issue #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#issuecomment-472687614 Can one of the admins verify this patch? This is an

[GitHub] [spark] cloud-fan commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

cloud-fan commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-472688822 sounds good. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on issue #24086: [SPARK-27155][Build]update oracle docker image name

AmplabJenkins commented on issue #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#issuecomment-472688586 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24086: [SPARK-27155][Build]update oracle docker image name

AmplabJenkins removed a comment on issue #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#issuecomment-472687544 Can one of the admins verify this patch? This is an

[GitHub] [spark] wangyum commented on a change in pull request #24086: [SPARK-27155][Build]update oracle docker image name

wangyum commented on a change in pull request #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#discussion_r265406338 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24086: [SPARK-27155][Build]update oracle docker image name

AmplabJenkins commented on issue #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#issuecomment-472687614 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #24086: [SPARK-27155][Build]update oracle docker image name

AmplabJenkins commented on issue #24086: [SPARK-27155][Build]update oracle docker image name URL: https://github.com/apache/spark/pull/24086#issuecomment-472687544 Can one of the admins verify this patch? This is an

[GitHub] [spark] viirya commented on issue #24053: [SPARK-27126][SQL] Consolidate Scala and Java type deserializerFor

viirya commented on issue #24053: [SPARK-27126][SQL] Consolidate Scala and Java type deserializerFor URL: https://github.com/apache/spark/pull/24053#issuecomment-472686917 @cloud-fan How about I add WIP to this and refactor it to the direction?

[GitHub] [spark] lipzhu opened a new pull request #24086: update oracle docker image name

lipzhu opened a new pull request #24086: update oracle docker image name URL: https://github.com/apache/spark/pull/24086 ## What changes were proposed in this pull request? Update Oracle docker image name. ## How was this patch tested? ./build/mvn test

[GitHub] [spark] AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472686278 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472686282 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472686278 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472686282 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

SparkQA removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472628971 **[Test build #103458 has

[GitHub] [spark] SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472685759 **[Test build #103458 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472685380 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472685376 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472685380 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

AmplabJenkins commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472685376 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

SparkQA commented on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472684864 **[Test build #103456 has

[GitHub] [spark] SparkQA removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1

SparkQA removed a comment on issue #23993: [SPARK-26742][K8s]Update k8s client version to 4.1.2 for Spark 2.4.1 URL: https://github.com/apache/spark/pull/23993#issuecomment-472626334 **[Test build #103456 has

[GitHub] [spark] sujith71955 edited a comment on issue #23899: [SPARK-26969][spark-thriftserver] Bigdecimal values shall be converted to HiveDecimal type for succesful processing of query using ODBC c

sujith71955 edited a comment on issue #23899: [SPARK-26969][spark-thriftserver] Bigdecimal values shall be converted to HiveDecimal type for succesful processing of query using ODBC client URL: https://github.com/apache/spark/pull/23899#issuecomment-472683049 @cloud-fan @dongjoon-hyun -

[GitHub] [spark] sujith71955 commented on issue #23899: [SPARK-26969][spark-thriftserver] Bigdecimal values shall be converted to HiveDecimal type for succesful processing of query using ODBC client

sujith71955 commented on issue #23899: [SPARK-26969][spark-thriftserver] Bigdecimal values shall be converted to HiveDecimal type for succesful processing of query using ODBC client URL: https://github.com/apache/spark/pull/23899#issuecomment-472683049 @cloud-fan @dongjoon-hyun - please

[GitHub] [spark] AmplabJenkins removed a comment on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe

AmplabJenkins removed a comment on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe URL: https://github.com/apache/spark/pull/24085#issuecomment-472680479 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

HyukjinKwon commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#discussion_r265402165 ## File path:

[GitHub] [spark] sujith71955 commented on issue #24036: [SPARK-27036][SPARK-SQL] Cancel the running jobs in the background if broadcast future timeout error occurs

sujith71955 commented on issue #24036: [SPARK-27036][SPARK-SQL] Cancel the running jobs in the background if broadcast future timeout error occurs URL: https://github.com/apache/spark/pull/24036#issuecomment-472681947 @HyukjinKwon @cloud-fan @srowen Please let me know any further

[GitHub] [spark] SparkQA commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

SparkQA commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472681102 **[Test build #103473 has

[GitHub] [spark] AmplabJenkins commented on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe

AmplabJenkins commented on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe URL: https://github.com/apache/spark/pull/24085#issuecomment-472681000 Can one of the admins verify this patch?

[GitHub] [spark] sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472680896 Above failure is not related to this PR. Please review and

[GitHub] [spark] AmplabJenkins removed a comment on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

AmplabJenkins removed a comment on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472680707 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

AmplabJenkins removed a comment on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472680710 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

AmplabJenkins commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472680707 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

AmplabJenkins commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472680710 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe

AmplabJenkins removed a comment on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe URL: https://github.com/apache/spark/pull/24085#issuecomment-472680339 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe

AmplabJenkins commented on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe URL: https://github.com/apache/spark/pull/24085#issuecomment-472680479 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe

AmplabJenkins commented on issue #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe URL: https://github.com/apache/spark/pull/24085#issuecomment-472680339 Can one of the admins verify this patch?

[GitHub] [spark] mwlon opened a new pull request #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe

mwlon opened a new pull request #24085: [SPARK-26555][SQL] make ScalaReflection subtype checking thread safe URL: https://github.com/apache/spark/pull/24085 ## What changes were proposed in this pull request? Make ScalaReflection subtype checking thread safe by adding a lock. There

[GitHub] [spark] sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472679011 retest this please

[GitHub] [spark] SparkQA commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

SparkQA commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-472678914 **[Test build #103472 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103472/testReport)** for PR

[GitHub] [spark] sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS"

sujith71955 commented on issue #24075: [SPARK-26176][SQL] Invalid column names validation is been added when we create a table using the Hive serde "STORED AS" URL: https://github.com/apache/spark/pull/24075#issuecomment-472678944 > **[Test build #103390 has

[GitHub] [spark] DaveDeCaprio commented on issue #24028: [SPARK-26917][SQL] Further reduce locks in CacheManager

DaveDeCaprio commented on issue #24028: [SPARK-26917][SQL] Further reduce locks in CacheManager URL: https://github.com/apache/spark/pull/24028#issuecomment-472678933 It looks like the build for the latest commit got messed up. It says here that it is still going, but on the Jenkins

[GitHub] [spark] AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-472678475 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-472678482 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-472678482 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-472678475 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor

zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r265398892 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] [spark] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor

zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r265398764 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] [spark] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor

zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r265398794 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] [spark] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor

zjf2012 commented on a change in pull request #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r265398720 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] [spark] maropu commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand extends IgnoreCahedData to avoid plan node copys

maropu commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand extends IgnoreCahedData to avoid plan node copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472677069 @dongjoon-hyun could you check again? Thanks!

[GitHub] [spark] SparkQA commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

SparkQA commented on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472675877 **[Test build #103470 has

[GitHub] [spark] SparkQA commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

SparkQA commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#issuecomment-472675876 **[Test build #103471 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

AmplabJenkins removed a comment on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#issuecomment-472675474 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter

AmplabJenkins removed a comment on issue #20793: [WIP][SPARK-23643] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-472675457 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

AmplabJenkins removed a comment on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#issuecomment-472675482 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys

AmplabJenkins removed a comment on issue #24081: [SPARK-27151][SQL] ClearCacheCommand should be case-object to avoid copys URL: https://github.com/apache/spark/pull/24081#issuecomment-472675452 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables

AmplabJenkins commented on issue #24047: [SPARK-25196][SQL] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/24047#issuecomment-472675482 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   8   9   10   >