[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655089650 **[Test build #125251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125251/testReport)** for PR 26935 at commit [`9a066c1`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

SparkQA commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-655089674 **[Test build #125249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125249/testReport)** for PR 28904 at commit [`8034ca4`](https://github.com

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655088754 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] HeartSaVioR commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

HeartSaVioR commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655088482 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] HeartSaVioR commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

HeartSaVioR commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-655088167 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] HeartSaVioR commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value Int.MinValue to fill the map index when the event logs from the old Spark version

HeartSaVioR commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-655086958 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

dongjoon-hyun commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451101775 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala ## @@ -46,10 +49,15 @@ class InMemoryTable( private

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655086077 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29028: [SPARK-32212][CORE]RDD.takeOrdered can choose to merge intermediate r…

AmplabJenkins removed a comment on pull request #29028: URL: https://github.com/apache/spark/pull/29028#issuecomment-655084829 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655086077 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29028: [SPARK-32212][CORE]RDD.takeOrdered can choose to merge intermediate r…

AmplabJenkins commented on pull request #29028: URL: https://github.com/apache/spark/pull/29028#issuecomment-655085626 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655084932 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655084932 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

dongjoon-hyun commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451101176 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/InsertIntoTests.scala ## @@ -446,8 +446,7 @@ trait InsertIntoSQLOnlyTests

[GitHub] [spark] dongjoon-hyun commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

dongjoon-hyun commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655085022 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] AmplabJenkins commented on pull request #29028: [SPARK-32212][CORE]RDD.takeOrdered can choose to merge intermediate r…

AmplabJenkins commented on pull request #29028: URL: https://github.com/apache/spark/pull/29028#issuecomment-655084829 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] izchen opened a new pull request #29028: [SPARK-32212][CORE]RDD.takeOrdered can choose to merge intermediate r…

izchen opened a new pull request #29028: URL: https://github.com/apache/spark/pull/29028 …esults in executor or driver ### What changes were proposed in this pull request? Add an optional config to determine whether the intermediate results(local TopK) of each partition in RDD.tak

[GitHub] [spark] SparkQA removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654990313 **[Test build #125238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125238/testReport)** for PR 28969 at commit [`7abf2b5`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655082989 **[Test build #125238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125238/testReport)** for PR 28969 at commit [`7abf2b5`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-655065285 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-655065285 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

SparkQA removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-654802053 **[Test build #125214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125214/testReport)** for PR 27366 at commit [`6921415`](https://gi

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-655062411 **[Test build #125214 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125214/testReport)** for PR 27366 at commit [`6921415`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-655060983 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-655060973 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

AmplabJenkins commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-655060973 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655060454 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655060454 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655059872 **[Test build #125246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125246/testReport)** for PR 29020 at commit [`cc4018a`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

SparkQA removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654961115 **[Test build #125234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125234/testReport)** for PR 29024 at commit [`8caa8e7`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

SparkQA commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-655058944 **[Test build #125234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125234/testReport)** for PR 29024 at commit [`8caa8e7`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29027: [SPARK-32163][SQL][BRANCH-3.0] Nested pruning should work even with cosmetic variations

AmplabJenkins removed a comment on pull request #29027: URL: https://github.com/apache/spark/pull/29027#issuecomment-655053258 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29027: [SPARK-32163][SQL][BRANCH-3.0] Nested pruning should work even with cosmetic variations

SparkQA commented on pull request #29027: URL: https://github.com/apache/spark/pull/29027#issuecomment-655056268 **[Test build #125245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125245/testReport)** for PR 29027 at commit [`5e4a420`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29027: [SPARK-32163][SQL][BRANCH-3.0] Nested pruning should work even with cosmetic variations

AmplabJenkins commented on pull request #29027: URL: https://github.com/apache/spark/pull/29027#issuecomment-655053258 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] viirya opened a new pull request #29027: [SPARK-32163][SQL][BRANCH-3.0] Nested pruning should work even with cosmetic variations

viirya opened a new pull request #29027: URL: https://github.com/apache/spark/pull/29027 ### What changes were proposed in this pull request? This patch proposes to deal with cosmetic variations when processing nested column extractors in `NestedColumnAliasing`. Currently

[GitHub] [spark] rdblue commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

rdblue commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451067375 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala ## @@ -46,10 +49,15 @@ class InMemoryTable( private val al

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655046564 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] srowen commented on a change in pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

srowen commented on a change in pull request #28998: URL: https://github.com/apache/spark/pull/28998#discussion_r451065329 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala ## @@ -1229,24 +1203,87 @@ case class FromUT

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655045884 **[Test build #125244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125244/testReport)** for PR 29020 at commit [`bbeab0e`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655046553 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655046553 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655046534 **[Test build #125244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125244/testReport)** for PR 29020 at commit [`bbeab0e`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655046217 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655045884 **[Test build #125244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125244/testReport)** for PR 29020 at commit [`bbeab0e`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655046217 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

dongjoon-hyun commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451063160 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala ## @@ -46,10 +49,15 @@ class InMemoryTable( private

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

dongjoon-hyun commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451063160 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala ## @@ -46,10 +49,15 @@ class InMemoryTable( private

[GitHub] [spark] imback82 commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

imback82 commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655045020 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

dongjoon-hyun commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451062236 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala ## @@ -46,10 +49,15 @@ class InMemoryTable( private

[GitHub] [spark] viirya commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

viirya commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-655041608 Thanks all. Sure, let me create a backporting PR for branch-3.0. This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun closed pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

dongjoon-hyun closed pull request #28988: URL: https://github.com/apache/spark/pull/28988 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

dongjoon-hyun commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-655039036 Could you adjust the test case and make a backporting PR against branch-3.0, @viirya? cc @dbtsai

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655031402 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655031402 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655030684 **[Test build #125243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125243/testReport)** for PR 28986 at commit [`0faac2a`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655027169 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655026966 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655026966 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655027169 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

SparkQA commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655026521 **[Test build #125242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125242/testReport)** for PR 28926 at commit [`8c4ffaa`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655026445 **[Test build #125240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125240/testReport)** for PR 28986 at commit [`aeed617`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655026411 **[Test build #125241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125241/testReport)** for PR 28972 at commit [`06f456d`](https://github.com

[GitHub] [spark] dongjoon-hyun commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

dongjoon-hyun commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655024226 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655023119 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] dongjoon-hyun commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

dongjoon-hyun commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655023691 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655023082 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655023082 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-654856716 **[Test build #125221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125221/testReport)** for PR 28972 at commit [`b48cabc`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655021517 **[Test build #125221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125221/testReport)** for PR 28972 at commit [`b48cabc`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655015489 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655015483 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655015894 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655015894 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654899416 **[Test build #125229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125229/testReport)** for PR 28986 at commit [`aeed617`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655015205 **[Test build #125239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125239/testReport)** for PR 28972 at commit [`0d3a5ea`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655015483 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] MaxGekk commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

MaxGekk commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655014888 @dongjoon-hyun @srowen May I ask you review this refactoring. This is an automated message from the Apache Git S

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655014761 **[Test build #125229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125229/testReport)** for PR 28986 at commit [`aeed617`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655011976 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655011976 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

SparkQA removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-654770478 **[Test build #125209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125209/testReport)** for PR 28998 at commit [`e06fb0c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655010440 **[Test build #125209 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125209/testReport)** for PR 28998 at commit [`e06fb0c`](https://github.co

[GitHub] [spark] baohe-zhang commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

baohe-zhang commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655002716 I measured the memory usage of some smaller apps, the results are: * 200 jobs, 400 tasks for each job: 265 MB file size, 57.9 MB memory usage. * 100 jobs, 400 ta

[GitHub] [spark] wypoon commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

wypoon commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-655000416 Thanks @dongjoon-hyun for the move to disable the doc generation in Jenkins. This is an automated message from th

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654998901 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654998890 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654998890 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

SparkQA removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654837665 **[Test build #125219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125219/testReport)** for PR 28412 at commit [`b71a923`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654994583 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654994574 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

AmplabJenkins commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654994574 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

SparkQA removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654809085 **[Test build #125215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125215/testReport)** for PR 29021 at commit [`607eb08`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

SparkQA commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654994212 **[Test build #125219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125219/testReport)** for PR 28412 at commit [`b71a923`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

SparkQA commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654993639 **[Test build #125215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125215/testReport)** for PR 29021 at commit [`607eb08`](https://github.co

[GitHub] [spark] fqaiser94 commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

fqaiser94 commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654992303 Done, and thank you all for a great experience! This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654991355 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654991355 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654990313 **[Test build #125238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125238/testReport)** for PR 28969 at commit [`7abf2b5`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-654644357 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/125

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-654644343 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

<    3   4   5   6   7   8   9   10   11   12   >