[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] AmplabJenkins removed a comment on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator

AmplabJenkins removed a comment on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator URL: https://github.com/apache/spark/pull/24652#issuecomment-494107216 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator

AmplabJenkins removed a comment on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator URL: https://github.com/apache/spark/pull/24652#issuecomment-494107206 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator

SparkQA commented on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator URL: https://github.com/apache/spark/pull/24652#issuecomment-494107836 **[Test build #105577 has

[GitHub] [spark] AmplabJenkins commented on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator

AmplabJenkins commented on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator URL: https://github.com/apache/spark/pull/24652#issuecomment-494107206 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator

AmplabJenkins commented on issue #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator URL: https://github.com/apache/spark/pull/24652#issuecomment-494107216 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] dilipbiswal opened a new pull request #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator

dilipbiswal opened a new pull request #24652: [SPARK-27782][SQL] Use '#' to mark expression id embedded in the name field of SubqueryExec operator URL: https://github.com/apache/spark/pull/24652 ## What changes were proposed in this pull request? This is a minor pr to use `#` as a

[GitHub] [spark] skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto edited a comment on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-494104863 @erikerlandson @vanzin are you ok with the current status of things? Should it be merged?

[GitHub] [spark] pattern commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

pattern commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#discussion_r285721308 ## File path:

[GitHub] [spark] skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System

skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a Hadoop Compatible File System URL: https://github.com/apache/spark/pull/23546#issuecomment-494104863 @erikerlandson @vanzin are you ok with the current status of things? Should it be merged?

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285717901 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-494098743 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-494098755 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-494098743 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-494098755 Test PASSed. Refer to this link for build results

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] SparkQA commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

SparkQA commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-494096605 **[Test build #105576 has

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285707828 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494092490 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494092500 Test PASSed. Refer to this link for build results

[GitHub] [spark] skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the

[GitHub] [spark] skonto commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494092510 @gaborgsomogyi @HeartSaVioR what if I introduce queryOptions at the `query.start()`

[GitHub] [spark] AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494092490 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494092500 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

SparkQA removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494046578 **[Test build #105575 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285708266 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285708214 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285708176 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285708120 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285708070 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285708024 ## File path:

[GitHub] [spark] SparkQA commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

SparkQA commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494091860 **[Test build #105575 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

dongjoon-hyun commented on a change in pull request #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#discussion_r285707828 ## File path:

[GitHub] [spark] cryeo edited a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions

cryeo edited a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-494086108 I have just found four products which provide this function: Facebook Presto, Google BigQuery, IBM Informix, Microsoft Excel. Only

[GitHub] [spark] cryeo commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

cryeo commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-494086108 I have just found four products which provide this function: Facebook Presto, Google BigQuery, IBM Informix, Microsoft Excel. Only Presto

[GitHub] [spark] AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-494083839 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-494083850 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-494083839 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

AmplabJenkins commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-494083850 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

SparkQA removed a comment on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-494013583 **[Test build #105572 has

[GitHub] [spark] SparkQA commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan

SparkQA commented on issue #24626: [SPARK-27747][SQL] add a logical plan link in the physical plan URL: https://github.com/apache/spark/pull/24626#issuecomment-494083213 **[Test build #105572 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

AmplabJenkins removed a comment on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#issuecomment-494081892 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

AmplabJenkins removed a comment on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#issuecomment-494081904 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA removed a comment on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

SparkQA removed a comment on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#issuecomment-494007087 **[Test build #105571 has

[GitHub] [spark] AmplabJenkins commented on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

AmplabJenkins commented on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#issuecomment-494081892 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

AmplabJenkins commented on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#issuecomment-494081904 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level

SparkQA commented on issue #24221: [SPARK-27248][SQL] `refreshTable` should recreate cache with same cache name and storage level URL: https://github.com/apache/spark/pull/24221#issuecomment-494081249 **[Test build #105571 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494080300 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

SparkQA removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494030590 **[Test build #105574 has

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494080300 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494080293 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494080293 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494079657 **[Test build #105574 has

[GitHub] [spark] turboFei removed a comment on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive

turboFei removed a comment on issue #24533: [SPARK-27637][Shuffle] For nettyBlockTransferService, if IOException occurred while fetching data, check whether relative executor is alive before retry URL: https://github.com/apache/spark/pull/24533#issuecomment-494001269 > LGTM, also cc

[GitHub] [spark] dongjoon-hyun commented on issue #24620: [SPARK-27737][SQL] Upgrade to 2.3.5 for Hive Metastore Client 2.3

dongjoon-hyun commented on issue #24620: [SPARK-27737][SQL] Upgrade to 2.3.5 for Hive Metastore Client 2.3 URL: https://github.com/apache/spark/pull/24620#issuecomment-494061447 Thank you for updating, @wangyum . After https://github.com/apache/spark/pull/24639 is merged, I'll retrigger

[GitHub] [spark] dvogelbacher commented on issue #24650: [SPARK-27778][PySpark] Fix toPandas conversion using arrow for DFs with no partitions

dvogelbacher commented on issue #24650: [SPARK-27778][PySpark] Fix toPandas conversion using arrow for DFs with no partitions URL: https://github.com/apache/spark/pull/24650#issuecomment-494059226 @BryanCutler can you take a look at this one

[GitHub] [spark] squito commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

squito commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494056482 I think the versioning change should be its own jira & pr -- sorry I started this discussion here as it related

[GitHub] [spark] dongjoon-hyun commented on issue #24646: [SPARK-27757][CORE] Bump Jackson to 2.9.9

dongjoon-hyun commented on issue #24646: [SPARK-27757][CORE] Bump Jackson to 2.9.9 URL: https://github.com/apache/spark/pull/24646#issuecomment-494056035 cc @gatorsmile This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property

dongjoon-hyun commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#discussion_r285668687 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494049137 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins removed a comment on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494049146 Test PASSed. Refer to this link for build results

[GitHub] [spark] rdblue commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property

rdblue commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#discussion_r285665452 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1767,6

[GitHub] [spark] rdblue commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property

rdblue commented on a change in pull request #24594: [SPARK-27693][SQL] Add default catalog property URL: https://github.com/apache/spark/pull/24594#discussion_r285665290 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1767,6

[GitHub] [spark] AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494049137 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

AmplabJenkins commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494049146 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

SparkQA commented on issue #24616: [SPARK-27726] [Core] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads URL: https://github.com/apache/spark/pull/24616#issuecomment-494046578 **[Test build #105575 has

[GitHub] [spark] dongjoon-hyun closed pull request #24649: [MINOR][EXAMPLES] Don't use internal Spark logging in user examples

dongjoon-hyun closed pull request #24649: [MINOR][EXAMPLES] Don't use internal Spark logging in user examples URL: https://github.com/apache/spark/pull/24649 This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285654229 ## File path:

[GitHub] [spark] cloud-fan commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

cloud-fan commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494039545 Let's start doing versioning in the new shuffle protocol. The new message `FetchShuffleBlocks` should contain

[GitHub] [spark] HyukjinKwon commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

HyukjinKwon commented on issue #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644#issuecomment-494038664 Thanks, @dongjoon-hyun

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error

dongjoon-hyun edited a comment on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error URL: https://github.com/apache/spark/pull/24639#issuecomment-494037941 I checked the used profile. It looks correct. ``` [info] Building Spark using

[GitHub] [spark] dongjoon-hyun commented on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error

dongjoon-hyun commented on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error URL: https://github.com/apache/spark/pull/24639#issuecomment-494037941 I checked the used profile. It looks correct. ``` [info] Building Spark using Maven

[GitHub] [spark] AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494033225 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins removed a comment on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494033219 Merged build finished. Test PASSed.

[GitHub] [spark] viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

viirya commented on a change in pull request #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#discussion_r285647400 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

AmplabJenkins commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651#issuecomment-494029463 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

AmplabJenkins removed a comment on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651#issuecomment-494029184 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

AmplabJenkins removed a comment on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651#issuecomment-494027026 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

AmplabJenkins commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651#issuecomment-494029184 Can one of the admins verify this patch?

[GitHub] [spark] xuanyuanking commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

xuanyuanking commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494031201 Thanks for the advice from all reviewers. I agree with @squito on the suggestion about new spark job

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494033219 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

AmplabJenkins commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494033225 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks

SparkQA commented on issue #24565: [SPARK-27665][Core] Split fetch shuffle blocks protocol from OpenBlocks URL: https://github.com/apache/spark/pull/24565#issuecomment-494030590 **[Test build #105574 has

[GitHub] [spark] AmplabJenkins commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

AmplabJenkins commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651#issuecomment-494027026 Can one of the admins verify this patch?

[GitHub] [spark] sekikn opened a new pull request #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

sekikn opened a new pull request #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651 ## What changes were proposed in this pull request? KinesisInputDStream currently does

[GitHub] [spark] gaborgsomogyi edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

gaborgsomogyi edited a comment on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494025320 > Is there a way for the user to optionally provide a full group.id

[GitHub] [spark] gaborgsomogyi commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

gaborgsomogyi commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494025320 > Is there a way for the user to optionally provide a full group.id per

[GitHub] [spark] HeartSaVioR commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

HeartSaVioR commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-494024240 > Is there a way for the user to optionally provide a full group.id per Spark

[GitHub] [spark] SparkQA commented on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error

SparkQA commented on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error URL: https://github.com/apache/spark/pull/24639#issuecomment-494023903 **[Test build #105573 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error

AmplabJenkins removed a comment on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error URL: https://github.com/apache/spark/pull/24639#issuecomment-494022918 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error

AmplabJenkins removed a comment on issue #24639: [SPARK-27699][FOLLOW-UP][SQL][test-hadoop3.2][test-maven] Fix hadoop-3.2 test error URL: https://github.com/apache/spark/pull/24639#issuecomment-494022927 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] dongjoon-hyun closed pull request #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now

dongjoon-hyun closed pull request #24644: [SPARK-27402][INFRA][FOLLOW-UP] Exclude 'hive-thriftserver' in modules to test for hadoop3.2 for now URL: https://github.com/apache/spark/pull/24644 This is an automated message

<    1   2   3   4   5   6   7   8   >