[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655165362 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655165362 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

AmplabJenkins removed a comment on pull request #29029: URL: https://github.com/apache/spark/pull/29029#issuecomment-655162418 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] baohe-zhang commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

baohe-zhang commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655165640 @HeartSaVioR @tgravescs These are the measurement of memory usage on zstd compressed log files: * 200 jobs, 400 tasks for each job: 8.6 MB file size, 50.5 MB memory

[GitHub] [spark] SparkQA commented on pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

SparkQA commented on pull request #29029: URL: https://github.com/apache/spark/pull/29029#issuecomment-655165177 **[Test build #125261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125261/testReport)** for PR 29029 at commit

[GitHub] [spark] SparkQA commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

SparkQA commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655165176 **[Test build #125262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125262/testReport)** for PR 28683 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655164088 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655164079 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

dongjoon-hyun commented on a change in pull request #28683: URL: https://github.com/apache/spark/pull/28683#discussion_r451174096 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2106,6 +2106,15 @@ object SQLConf {

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655164079 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

dongjoon-hyun commented on a change in pull request #28683: URL: https://github.com/apache/spark/pull/28683#discussion_r451174203 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2106,6 +2106,15 @@ object SQLConf {

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

dongjoon-hyun commented on a change in pull request #28683: URL: https://github.com/apache/spark/pull/28683#discussion_r451173748 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveHints.scala ## @@ -278,4 +278,15 @@ object ResolveHints {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655163296 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

dongjoon-hyun commented on a change in pull request #28683: URL: https://github.com/apache/spark/pull/28683#discussion_r451173322 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2106,6 +2106,15 @@ object SQLConf {

[GitHub] [spark] AmplabJenkins commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

AmplabJenkins commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655163296 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

dongjoon-hyun commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655163424 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

AmplabJenkins commented on pull request #29029: URL: https://github.com/apache/spark/pull/29029#issuecomment-655162418 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655030684 **[Test build #125243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125243/testReport)** for PR 28986 at commit

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655162279 **[Test build #125243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125243/testReport)** for PR 28986 at commit

[GitHub] [spark] sarutak opened a new pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

sarutak opened a new pull request #29029: URL: https://github.com/apache/spark/pull/29029 ### What changes were proposed in this pull request? This PR fixes a bug in `EvaluatePython`. `makeFromJava` in `EvaluatePython` create a type conversion function for some Java/Scala types.

[GitHub] [spark] dongjoon-hyun commented on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

dongjoon-hyun commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655161606 Thanks, @HeartSaVioR . @HyukjinKwon is also working on the Spark private list toward GitHub Action migration.

[GitHub] [spark] SparkQA commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

SparkQA commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-655150275 **[Test build #125260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125260/testReport)** for PR 28939 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-655147779 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

AmplabJenkins commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-655147779 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-654563669 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] sarutak commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

sarutak commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-655146938 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655146156 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

HeartSaVioR commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655146331 I also saw two cases today - sharing one: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125258/console

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655146151 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

SparkQA removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655133391 **[Test build #125258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125258/testReport)** for PR 28975 at commit

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655145969 **[Test build #125258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125258/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655146151 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655143930 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655143921 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655026445 **[Test build #125240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125240/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655143921 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

SparkQA commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655143704 **[Test build #125259 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125259/testReport)** for PR 28983 at commit

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655143390 **[Test build #125240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125240/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655141320 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655141320 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

AmplabJenkins commented on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-655139581 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

AmplabJenkins removed a comment on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-655139581 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

SparkQA removed a comment on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-654884556 **[Test build #125226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125226/testReport)** for PR 29012 at commit

[GitHub] [spark] SparkQA commented on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

SparkQA commented on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-655137842 **[Test build #125226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125226/testReport)** for PR 29012 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655137371 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

SparkQA removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655129657 **[Test build #125257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125257/testReport)** for PR 28975 at commit

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

[GitHub] [spark] viirya commented on a change in pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

viirya commented on a change in pull request #29026: URL: https://github.com/apache/spark/pull/29026#discussion_r451145695 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Sum.scala ## @@ -58,39 +58,50 @@ case class Sum(child:

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655137323 **[Test build #125257 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125257/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655137361 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655137361 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

dongjoon-hyun commented on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-655136545 Thank you, @MaxGekk and all. Merged to master. This is an automated message from the Apache Git Service.

[GitHub] [spark] dongjoon-hyun closed pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

dongjoon-hyun closed pull request #29012: URL: https://github.com/apache/spark/pull/29012 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655134500 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655134510 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655133900 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655134500 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655133900 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655015205 **[Test build #125239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125239/testReport)** for PR 28972 at commit

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655133391 **[Test build #125258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125258/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655132111 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655133384 **[Test build #125239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125239/testReport)** for PR 28972 at commit

[GitHub] [spark] HeartSaVioR commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

HeartSaVioR commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r451142047 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala ## @@ -259,6 +269,9 @@

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655132102 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HeartSaVioR commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

HeartSaVioR commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r451140973 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala ## @@ -259,6 +269,9 @@

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655132102 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] baohe-zhang commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

baohe-zhang commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655130806 @tgravescs Sure I will run some tests on zstd. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655130454 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655026411 **[Test build #125241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125241/testReport)** for PR 28972 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

AmplabJenkins removed a comment on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655130288 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655130332 **[Test build #125241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125241/testReport)** for PR 28972 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655130454 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

AmplabJenkins commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655130288 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

SparkQA commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655129680 **[Test build #125256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125256/testReport)** for PR 28993 at commit

[GitHub] [spark] tgravescs commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

tgravescs commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655129919 could you run just a couple of the same test with Zstd ( you don't need to run all those combinations)? Note thanks again for running all those, I know it takes time.

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655129657 **[Test build #125257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125257/testReport)** for PR 28975 at commit

[GitHub] [spark] baohe-zhang commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

baohe-zhang commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655128958 @tgravescs The latest number is based on uncompressed files. This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655127557 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

HeartSaVioR commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655128492 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] tgravescs commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

tgravescs commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655127979 @baohe-zhang what compression codec was used in the latest numbers? This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655127547 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655127547 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] rdblue commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

rdblue commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451135737 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/InsertIntoTests.scala ## @@ -446,8 +446,7 @@ trait InsertIntoSQLOnlyTests }

[GitHub] [spark] imback82 closed pull request #28435: [SPARK-31625][YARN] Unregister application from YARN RM outside the shutdown hook if it succeeds

imback82 closed pull request #28435: URL: https://github.com/apache/spark/pull/28435 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

AmplabJenkins removed a comment on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655126608 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655126355 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] imback82 commented on pull request #28435: [SPARK-31625][YARN] Unregister application from YARN RM outside the shutdown hook if it succeeds

imback82 commented on pull request #28435: URL: https://github.com/apache/spark/pull/28435#issuecomment-655127074 Late update: There was a custom logger that registered a shutdown hook which calls `LogManager.shutdown()`, which can interfere with other loggers during clean up. Thanks

[GitHub] [spark] AmplabJenkins commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

AmplabJenkins commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655126608 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655126355 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

HeartSaVioR edited a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655125113 @baohe-zhang Thanks for the update. This is really helpful. So the small event log file shows there's a chance the ratio can be beyond 1/2. (There's information

[GitHub] [spark] SparkQA commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

SparkQA commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655125865 **[Test build #125255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125255/testReport)** for PR 28676 at commit

[GitHub] [spark] SparkQA commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

SparkQA commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655125800 **[Test build #125254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125254/testReport)** for PR 29026 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

HeartSaVioR commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655125113 @baohe-zhang Thanks for the update. This is really helpful. So the small event log file shows there's a chance the ratio can be beyond 1/2. Personally it seems OK

[GitHub] [spark] SparkQA removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

SparkQA removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-654846216 **[Test build #125220 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125220/testReport)** for PR 28983 at commit

[GitHub] [spark] viirya commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

viirya commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655124998 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] imback82 commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

imback82 commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655124035 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

SparkQA commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655123921 **[Test build #125220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125220/testReport)** for PR 28983 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655116319 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655116303 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655116303 This is an automated message from the Apache Git Service. To respond to the message, please log on to

<    1   2   3   4   5   6   7   8   9   10   >