[GitHub] [spark] AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600996889 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120022/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600996889 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120022/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600996881 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600996881 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
SparkQA removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600977511 **[Test build #120022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120022/testReport)** for PR 27954 at commit [`1455987`](https://github.com/apache/spark/commit/1455987ef350cad1a190d8f1c26ad553fe8b2751). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
SparkQA commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600996537 **[Test build #120022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120022/testReport)** for PR 27954 at commit [`1455987`](https://github.com/apache/spark/commit/1455987ef350cad1a190d8f1c26ad553fe8b2751). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jiangxb1987 edited a comment on issue #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
jiangxb1987 edited a comment on issue #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill URL: https://github.com/apache/spark/pull/24618#issuecomment-600996032 This PR looks pretty good, it would be great if we can add some new benchmark case to ensure it doesn't bring in performance regression with config values properly chosen. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jiangxb1987 commented on issue #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
jiangxb1987 commented on issue #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill URL: https://github.com/apache/spark/pull/24618#issuecomment-600996032 This PR looks pretty good, it would be great if we can add some new benchmark case to ensure it doesn't bring in performance regression if config values are properly chosen. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jiangxb1987 commented on a change in pull request #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
jiangxb1987 commented on a change in pull request #24618:
[SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
URL: https://github.com/apache/spark/pull/24618#discussion_r394796886
##
File path: core/src/main/scala/org/apache/spark/internal/config/package.scala
##
@@ -998,6 +998,26 @@ package object config {
.intConf
.createWithDefault(Integer.MAX_VALUE)
+ private[spark] val SHUFFLE_SPILL_MAP_MAX_SIZE_FORCE_SPILL_THRESHOLD =
+ConfigBuilder("spark.shuffle.spill.map.maxRecordsSizeForSpillThreshold")
Review comment:
Why is it necessary to have different threshold between map task and reduce
task?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jiangxb1987 commented on a change in pull request #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
jiangxb1987 commented on a change in pull request #24618:
[SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
URL: https://github.com/apache/spark/pull/24618#discussion_r394796465
##
File path: core/src/main/scala/org/apache/spark/internal/config/package.scala
##
@@ -998,6 +998,26 @@ package object config {
.intConf
.createWithDefault(Integer.MAX_VALUE)
+ private[spark] val SHUFFLE_SPILL_MAP_MAX_SIZE_FORCE_SPILL_THRESHOLD =
+ConfigBuilder("spark.shuffle.spill.map.maxRecordsSizeForSpillThreshold")
Review comment:
What does the "map" mean inside this config name?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jiangxb1987 commented on a change in pull request #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
jiangxb1987 commented on a change in pull request #24618:
[SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
URL: https://github.com/apache/spark/pull/24618#discussion_r394796229
##
File path:
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java
##
@@ -396,8 +407,11 @@ public void insertRecord(
logger.info("Spilling data because number of spilledRecords crossed the
threshold " +
numElementsForSpillThreshold);
spill();
+} else if (inMemRecordsSize >= maxRecordsSizeForSpillThreshold) {
+ logger.info("Spilling data because size of spilledRecords crossed the
threshold " +
Review comment:
Should we also include the number of records and threshold here?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jiangxb1987 commented on a change in pull request #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill
jiangxb1987 commented on a change in pull request #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill URL: https://github.com/apache/spark/pull/24618#discussion_r394795894 ## File path: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java ## @@ -416,6 +428,7 @@ public void insertRecord(Object recordBase, long recordOffset, int length, int p Platform.copyMemory(recordBase, recordOffset, base, pageCursor, length); pageCursor += length; inMemSorter.insertRecord(recordAddress, partitionId); +inMemRecordsSize += length; Review comment: Should we also include the uaoSize? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11
AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-600992569 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120010/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11
AmplabJenkins removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-600992564 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11
AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-600992569 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120010/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11
AmplabJenkins commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-600992564 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11
SparkQA removed a comment on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-600891967 **[Test build #120010 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120010/testReport)** for PR 27929 at commit [`678e5d6`](https://github.com/apache/spark/commit/678e5d6b4d17f5f97750b433f939411241059987). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11
SparkQA commented on issue #27929: [WIP][SPARK-31168][BUILD][test-maven] Upgrade Scala to 2.12.11 URL: https://github.com/apache/spark/pull/27929#issuecomment-600992255 **[Test build #120010 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120010/testReport)** for PR 27929 at commit [`678e5d6`](https://github.com/apache/spark/commit/678e5d6b4d17f5f97750b433f939411241059987). * This patch **fails from timeout after a configured wait of `400m`**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] rednaxelafx edited a comment on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using s
rednaxelafx edited a comment on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch statement in generated code URL: https://github.com/apache/spark/pull/27872#issuecomment-600990551 @HeartSaVioR thank you so much for sorting it out! It's great to see the problems fixed on the Janino side. My preference on the version to upgrade to is on the conservative side. It'd be nice if we can take a baby step at this stage of Spark 3.0 release... so +1 on 3.0.16 from me for 3.0 (and maybe 2.4 too), and 3.1.2 on master. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] rednaxelafx commented on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch s
rednaxelafx commented on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch statement in generated code URL: https://github.com/apache/spark/pull/27872#issuecomment-600990551 @HeartSaVioR thank you so much for sorting it out! It's great to see the problems fixed on the Janino side. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
SparkQA commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600989390 **[Test build #120024 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120024/testReport)** for PR 27897 at commit [`b15a32b`](https://github.com/apache/spark/commit/b15a32bb0db5d2ddcc90b791c3aee2246342cdd8). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600987654 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24742/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600987649 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600987649 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600987654 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24742/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan closed pull request #27915: [SPARK-31159][SQL] Rebase date/timestamp from/to Julian calendar in parquet
cloud-fan closed pull request #27915: [SPARK-31159][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan commented on issue #27915: [SPARK-31159][SQL] Rebase date/timestamp from/to Julian calendar in parquet
cloud-fan commented on issue #27915: [SPARK-31159][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-600987193 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600985687 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600985695 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24741/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600985695 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24741/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
AmplabJenkins removed a comment on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600985687 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
SparkQA commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600985402 **[Test build #120023 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120023/testReport)** for PR 27897 at commit [`6e6d848`](https://github.com/apache/spark/commit/6e6d848a35e3227789f0cffbb7bcbe9fcdf202cb). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan commented on issue #27807: [SPARK-31076][SQL] Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via local date-time
cloud-fan commented on issue #27807: [SPARK-31076][SQL] Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via local date-time URL: https://github.com/apache/spark/pull/27807#issuecomment-600984145 It's only a bug in 3.0 as we switch the calendar. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120011/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120011/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979498 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979498 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979314 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979318 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120013/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979314 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600979318 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120013/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
SparkQA commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600978750 **[Test build #120011 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120011/testReport)** for PR 27935 at commit [`4628aa0`](https://github.com/apache/spark/commit/4628aa064e72e2ad6f8d254dad741735eebbcb56). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
SparkQA removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600909191 **[Test build #120011 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120011/testReport)** for PR 27935 at commit [`4628aa0`](https://github.com/apache/spark/commit/4628aa064e72e2ad6f8d254dad741735eebbcb56). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
SparkQA removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600914176 **[Test build #120013 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120013/testReport)** for PR 27935 at commit [`70c994a`](https://github.com/apache/spark/commit/70c994a968cda89958a91c5ebb9143a0c2eb9825). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
SparkQA commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600978761 **[Test build #120013 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120013/testReport)** for PR 27935 at commit [`70c994a`](https://github.com/apache/spark/commit/70c994a968cda89958a91c5ebb9143a0c2eb9825). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] srowen commented on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch statem
srowen commented on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch statement in generated code URL: https://github.com/apache/spark/pull/27872#issuecomment-600978381 I don't have a strong preference, but if 3.1.2 works, seems like the time to jump to it is in Spark 3.0, all else equal? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600978191 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120012/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600978183 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600978183 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
AmplabJenkins commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600978191 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120012/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core
AmplabJenkins removed a comment on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core URL: https://github.com/apache/spark/pull/27931#issuecomment-600977833 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600977806 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24739/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins removed a comment on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600977802 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core
AmplabJenkins removed a comment on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core URL: https://github.com/apache/spark/pull/27931#issuecomment-600977841 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24740/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core
AmplabJenkins commented on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core URL: https://github.com/apache/spark/pull/27931#issuecomment-600977841 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24740/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600977802 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
AmplabJenkins commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600977806 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24739/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
SparkQA commented on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600977700 **[Test build #120012 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120012/testReport)** for PR 27935 at commit [`5a0b4ed`](https://github.com/apache/spark/commit/5a0b4ed0966a8555a31366c447443f305410a91a). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core
AmplabJenkins commented on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core URL: https://github.com/apache/spark/pull/27931#issuecomment-600977833 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution
SparkQA removed a comment on issue #27935: [SPARK-25121][SQL] Supports multi-part table names for broadcast hint resolution URL: https://github.com/apache/spark/pull/27935#issuecomment-600911629 **[Test build #120012 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120012/testReport)** for PR 27935 at commit [`5a0b4ed`](https://github.com/apache/spark/commit/5a0b4ed0966a8555a31366c447443f305410a91a). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core
SparkQA commented on issue #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core URL: https://github.com/apache/spark/pull/27931#issuecomment-600977518 **[Test build #120021 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120021/testReport)** for PR 27931 at commit [`5b18ed8`](https://github.com/apache/spark/commit/5b18ed8956e0e22b0efb3c1943dc9c99eb33adf3). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector
SparkQA commented on issue #27954: [SPARK-31185][ML] Implement VarianceThresholdSelector URL: https://github.com/apache/spark/pull/27954#issuecomment-600977511 **[Test build #120022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120022/testReport)** for PR 27954 at commit [`1455987`](https://github.com/apache/spark/commit/1455987ef350cad1a190d8f1c26ad553fe8b2751). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core
beliefer commented on a change in pull request #27931: [SPARK-31002][CORE][DOC][FOLLOWUP] Add version information to the configuration of Core URL: https://github.com/apache/spark/pull/27931#discussion_r394778967 ## File path: docs/configuration.md ## @@ -1904,14 +1932,14 @@ Apart from these, the following properties are also available, and may be useful For users who enabled external shuffle service, this feature can only work when external shuffle service is at least 2.3.0. - + 3.0.0 Review comment: SPARK-26700, commit ID: d8613571bc1847775dd5c1945757279234cb388c#diff-6bdad48cfc34314e89599655442ff210 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch s
HeartSaVioR commented on issue #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch statement in generated code URL: https://github.com/apache/spark/pull/27872#issuecomment-600975879 I've finally updated my two WIP PRs to official releases, which invalidates the purpose of this PR. Let's move on, but decide which version would be better before moving on, 3.1.2 vs 3.0.16. (For sure, looks like Janino maintainer wants to see us adopt 3.1.x, but the decision is up to us.) #27860 for Janino 3.1.2 #27932 for Janino 3.0.16 cc. to everyone commented here to see preference for Janino version. @squito @dongjoon-hyun @maropu @kiszk @rednaxelafx @srowen @viirya This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR closed pull request #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch
HeartSaVioR closed pull request #27872: [SPARK-31115][SQL] Detect known Janino bug janino-compiler/janino#113 and apply workaround automatically as a fail-back via avoid using switch statement in generated code URL: https://github.com/apache/spark/pull/27872 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600973395 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24737/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600973390 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600973414 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24738/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600973411 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600973395 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24737/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600973390 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600973414 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24738/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600973411 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
SparkQA commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600973054 **[Test build #120020 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120020/testReport)** for PR 27860 at commit [`9e70c57`](https://github.com/apache/spark/commit/9e70c5721711184c456d670f39bdd727db0ac7be). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
SparkQA commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600973059 **[Test build #120019 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120019/testReport)** for PR 27932 at commit [`ff25ac5`](https://github.com/apache/spark/commit/ff25ac53104005ae6348a7caeb9f7e9bad0934d3). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
HeartSaVioR commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600972111 ``` org.apache.spark.scheduler.BarrierTaskContextSuite.successively sync with allGather and barrier Error Details org.apache.spark.SparkException: Job aborted due to stage failure: Could not recover from a failed barrier ResultStage. Most recent failure reason: Stage failed because barrier task ResultTask(0, 3) finished unsuccessfully. com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input at [Source: (String)""; line: 1, column: 0] at com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59) at com.fasterxml.jackson.databind.DeserializationContext.reportInputMismatch(DeserializationContext.java:1442) at com.fasterxml.jackson.databind.ObjectReader._initForReading(ObjectReader.java:360) at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1704) at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:1261) at org.json4s.jackson.JsonMethods.parse(JsonMethods.scala:25) at org.json4s.jackson.JsonMethods.parse$(JsonMethods.scala:19) at org.json4s.jackson.JsonMethods$.parse(JsonMethods.scala:55) at org.apache.spark.BarrierTaskContext.allGather(BarrierTaskContext.scala:222) at org.apache.spark.scheduler.BarrierTaskContextSuite.$anonfun$new$12(BarrierTaskContextSuite.scala:118) at org.apache.spark.rdd.RDDBarrier.$anonfun$mapPartitions$2(RDDBarrier.scala:51) at org.apache.spark.rdd.RDDBarrier.$anonfun$mapPartitions$2$adapted(RDDBarrier.scala:51) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349) at org.apache.spark.rdd.RDD.iterator(RDD.scala:313) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:460) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:463) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) ``` Doesn't seem to be related. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
HeartSaVioR commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600972198 retest this, please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
HeartSaVioR commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600972172 ``` org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) Error Details org.scalatest.exceptions.TestFailedException: java.lang.StackOverflowError did not equal null Stack Trace sbt.ForkMain$ForkError: org.scalatest.exceptions.TestFailedException: java.lang.StackOverflowError did not equal null at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:530) at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:529) at org.scalatest.FunSuite.newAssertionFailedException(FunSuite.scala:1560) at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:503) at org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.$anonfun$new$1(LocalityPlacementStrategySuite.scala:49) at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) at org.scalatest.Transformer.apply(Transformer.scala:22) at org.scalatest.Transformer.apply(Transformer.scala:20) at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:186) at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:151) at org.scalatest.FunSuiteLike.invokeWithFixture$1(FunSuiteLike.scala:184) at org.scalatest.FunSuiteLike.$anonfun$runTest$1(FunSuiteLike.scala:196) at org.scalatest.SuperEngine.runTestImpl(Engine.scala:286) at org.scalatest.FunSuiteLike.runTest(FunSuiteLike.scala:196) at org.scalatest.FunSuiteLike.runTest$(FunSuiteLike.scala:178) at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:58) at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:221) at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:214) at org.apache.spark.SparkFunSuite.runTest(SparkFunSuite.scala:58) at org.scalatest.FunSuiteLike.$anonfun$runTests$1(FunSuiteLike.scala:229) at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:393) at scala.collection.immutable.List.foreach(List.scala:392) at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:381) at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:376) at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:458) at org.scalatest.FunSuiteLike.runTests(FunSuiteLike.scala:229) at org.scalatest.FunSuiteLike.runTests$(FunSuiteLike.scala:228) at org.scalatest.FunSuite.runTests(FunSuite.scala:1560) at org.scalatest.Suite.run(Suite.scala:1124) at org.scalatest.Suite.run$(Suite.scala:1106) at org.scalatest.FunSuite.org$scalatest$FunSuiteLike$$super$run(FunSuite.scala:1560) at org.scalatest.FunSuiteLike.$anonfun$run$1(FunSuiteLike.scala:233) at org.scalatest.SuperEngine.runImpl(Engine.scala:518) at org.scalatest.FunSuiteLike.run(FunSuiteLike.scala:233) at org.scalatest.FunSuiteLike.run$(FunSuiteLike.scala:232) at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:58) at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) at org.apache.spark.SparkFunSuite.run(SparkFunSuite.scala:58) at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:317) at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:510) at sbt.ForkMain$Run$2.call(ForkMain.java:296) at sbt.ForkMain$Run$2.call(ForkMain.java:286) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) ``` Doesn't seem to be related. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For
[GitHub] [spark] HeartSaVioR commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
HeartSaVioR commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600972192 retest this, please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600968355 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120017/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600968347 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600968355 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120017/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
AmplabJenkins removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600968347 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
SparkQA removed a comment on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600939979 **[Test build #120017 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120017/testReport)** for PR 27860 at commit [`9e70c57`](https://github.com/apache/spark/commit/9e70c5721711184c456d670f39bdd727db0ac7be). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1
SparkQA commented on issue #27860: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.1.1 URL: https://github.com/apache/spark/pull/27860#issuecomment-600968039 **[Test build #120017 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120017/testReport)** for PR 27860 at commit [`9e70c57`](https://github.com/apache/spark/commit/9e70c5721711184c456d670f39bdd727db0ac7be). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600965676 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120016/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600965670 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600965670 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] Eric5553 commented on a change in pull request #27952: [SPARK-31184][SQL] Support getTablesByType API of Hive Client
Eric5553 commented on a change in pull request #27952: [SPARK-31184][SQL]
Support getTablesByType API of Hive Client
URL: https://github.com/apache/spark/pull/27952#discussion_r394767919
##
File path:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
##
@@ -363,6 +370,15 @@ private[client] class Shim_v0_12 extends Shim with
Logging {
conf.getIntVar(HiveConf.ConfVars.METASTORE_CLIENT_CONNECT_RETRY_DELAY) *
1000L
}
+ override def getTablesByType(
+ hive: Hive,
+ dbName: String,
+ pattern: String,
+ tableType: TableType): Seq[String] = {
+throw new UnsupportedOperationException("Hive 2.2 and lower versions don't
support " +
+ "getTablesByType. Please use Hive 2.3 or higher version.")
Review comment:
Sure, that's a mismatch. Updated the description, thanks :-)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
AmplabJenkins commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600965676 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120016/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
SparkQA removed a comment on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600935927 **[Test build #120016 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120016/testReport)** for PR 27932 at commit [`ff25ac5`](https://github.com/apache/spark/commit/ff25ac53104005ae6348a7caeb9f7e9bad0934d3). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16
SparkQA commented on issue #27932: [WIP][SPARK-31101][SQL][BUILD][test-hadoop3.2][test-java11] Upgrade Janino to 3.0.16 URL: https://github.com/apache/spark/pull/27932#issuecomment-600965434 **[Test build #120016 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120016/testReport)** for PR 27932 at commit [`ff25ac5`](https://github.com/apache/spark/commit/ff25ac53104005ae6348a7caeb9f7e9bad0934d3). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #27951: [SPARK-30667][FOLLOW-UP][CORE] Change BarrierTaskContext allGather method return type
HyukjinKwon commented on issue #27951: [SPARK-30667][FOLLOW-UP][CORE] Change BarrierTaskContext allGather method return type URL: https://github.com/apache/spark/pull/27951#issuecomment-600965094 Merged to master and branch-3.0. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #27951: [SPARK-30667][CORE] Change BarrierTaskContext allGather method return type
HyukjinKwon closed pull request #27951: [SPARK-30667][CORE] Change BarrierTaskContext allGather method return type URL: https://github.com/apache/spark/pull/27951 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF
AmplabJenkins commented on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF URL: https://github.com/apache/spark/pull/27937#issuecomment-600964701 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF
AmplabJenkins removed a comment on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF URL: https://github.com/apache/spark/pull/27937#issuecomment-600964701 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF
AmplabJenkins commented on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF URL: https://github.com/apache/spark/pull/27937#issuecomment-600964708 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24736/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF
AmplabJenkins removed a comment on issue #27937: [WIP][SPARK-30127][SQL] Support case class parameter for typed Scala UDF URL: https://github.com/apache/spark/pull/27937#issuecomment-600964708 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24736/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
HyukjinKwon commented on issue #27897: [SPARK-31113][SQL] Add SHOW VIEWS command URL: https://github.com/apache/spark/pull/27897#issuecomment-600964599 As Dongjoon guided at https://github.com/apache/spark/pull/27897#pullrequestreview-376388787, seems the PRs can be completely separate without depending on each other. Let's cleanly separate them. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on a change in pull request #27897: [SPARK-31113][SQL] Add SHOW VIEWS command
HyukjinKwon commented on a change in pull request #27897: [SPARK-31113][SQL]
Add SHOW VIEWS command
URL: https://github.com/apache/spark/pull/27897#discussion_r394766551
##
File path:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
##
@@ -363,6 +370,15 @@ private[client] class Shim_v0_12 extends Shim with
Logging {
conf.getIntVar(HiveConf.ConfVars.METASTORE_CLIENT_CONNECT_RETRY_DELAY) *
1000L
}
+ override def getTablesByType(
+ hive: Hive,
+ dbName: String,
+ pattern: String,
+ tableType: TableType): Seq[String] = {
+throw new UnsupportedOperationException("Hive 2.2 and lower versions don't
support " +
Review comment:
Can we implement without adding the method in `HiveShim` first, and improve
with using `listTables`? Seems like it's not a must given my reading. Adding a
method here requires to test in multiple profiles with multiple versions.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
