[GitHub] [spark] AmplabJenkins commented on pull request #28418: [SPARK-28424][TESTS][FOLLOW-UP] Add test cases for all interval units

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28418: URL: https://github.com/apache/spark/pull/28418#issuecomment-621629272 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] xuanyuanking commented on pull request #28418: [SPARK-28424][TESTS][FOLLOW-UP] Add test cases for all interval units

2020-04-29 Thread GitBox
xuanyuanking commented on pull request #28418: URL: https://github.com/apache/spark/pull/28418#issuecomment-621628698 cc @gatorsmile This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] xuanyuanking opened a new pull request #28418: [SPARK-28424][TESTS][FOLLOW-UP] Add test cases for all interval units

2020-04-29 Thread GitBox
xuanyuanking opened a new pull request #28418: URL: https://github.com/apache/spark/pull/28418 ### What changes were proposed in this pull request? Add test cases covering all interval units: MICROSECOND MILLISECOND SECOND MINUTE HOUR DAY WEEK MONTH YEAR ### Why are the changes

[GitHub] [spark] cloud-fan commented on pull request #28415: [SPARK-31030] [DOCS] [FOLLOWUP] Replace HTML Table by Markdown Table

2020-04-29 Thread GitBox
cloud-fan commented on pull request #28415: URL: https://github.com/apache/spark/pull/28415#issuecomment-621626101 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] MichaelChirico edited a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
MichaelChirico edited a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621620800 @HyukjinKwon 7fccb3ab4b9658aa57a1ebab3aedc0c1633d5bc8 failed linting on Jenkins, but not on GH Actions. The error: ``` inst/worker/worker.R:81:62: style:

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621621691 **[Test build #122112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122112/testReport)** for PR 28379 at commit

[GitHub] [spark] MichaelChirico commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
MichaelChirico commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621620800 @HyukjinKwon 7fccb3ab4b9658aa57a1ebab3aedc0c1633d5bc8 failed linting on Jenkins, but not on GH Actions. The error: ``` inst/worker/worker.R:81:62: style:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621619823 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621619823 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417756062 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417759512 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621617763 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621615333 **[Test build #122111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122111/testReport)** for PR 28379 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621617753 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621617738 **[Test build #122111 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122111/testReport)** for PR 28379 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621617753 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417758295 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] maropu commented on a change in pull request #28402: [SPARK-31586][SQL][FOLLOWUP] Restore SQL string for datetime - interval operations

2020-04-29 Thread GitBox
maropu commented on a change in pull request #28402: URL: https://github.com/apache/spark/pull/28402#discussion_r417757366 ## File path: sql/core/src/test/resources/sql-tests/results/ansi/interval.sql.out ## @@ -689,7 +689,7 @@ select interval '2-2' year to month + dateval

[GitHub] [spark] dongjoon-hyun commented on pull request #28401: [SPARK-31601][K8S] Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread GitBox
dongjoon-hyun commented on pull request #28401: URL: https://github.com/apache/spark/pull/28401#issuecomment-621616588 :) This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] ScrapCodes commented on pull request #28401: [SPARK-31601][K8S] Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread GitBox
ScrapCodes commented on pull request #28401: URL: https://github.com/apache/spark/pull/28401#issuecomment-621616133 @dongjoon-hyun honestly, I was about to say that, thanks for doing it. :) This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621615681 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #28401: [SPARK-31601][K8S] Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread GitBox
dongjoon-hyun commented on pull request #28401: URL: https://github.com/apache/spark/pull/28401#issuecomment-621615775 Since the bug exists in `branch-2.4`, I cherry-pick this to branch-2.4, too. cc @holdenk This is

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621615681 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] ScrapCodes commented on pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-04-29 Thread GitBox
ScrapCodes commented on pull request #28370: URL: https://github.com/apache/spark/pull/28370#issuecomment-621615584 Alright this make sense, especially for a voluntary scale down. Thank you @holdenk for explaining. This is

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621615333 **[Test build #122111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122111/testReport)** for PR 28379 at commit

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417756062 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] cloud-fan commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417755773 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] cloud-fan commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417755827 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] cloud-fan commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417755344 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] cloud-fan commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417754723 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,93 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621612324 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621612324 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
SparkQA removed a comment on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621607471 **[Test build #122109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122109/testReport)** for PR 28417 at commit

[GitHub] [spark] SparkQA commented on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
SparkQA commented on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621612199 **[Test build #122109 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122109/testReport)** for PR 28417 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #28401: [SPARK-31601][K8S] Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread GitBox
dongjoon-hyun commented on pull request #28401: URL: https://github.com/apache/spark/pull/28401#issuecomment-621610888 Thank you for review and merging, @ScrapCodes . Ya. Bot is popular in these days. :) This is an

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621609889 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621607429 **[Test build #122110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122110/testReport)** for PR 28379 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621609880 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621609872 **[Test build #122110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122110/testReport)** for PR 28379 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621609880 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] huaxingao commented on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
huaxingao commented on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621608841 cc @gatorsmile @maropu In the first round of clean-up, I will focus on syntax and typos. After I finish this, I will remove all the html syntax following this PR

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621607813 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621607770 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621607813 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621607770 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
SparkQA commented on pull request #28417: URL: https://github.com/apache/spark/pull/28417#issuecomment-621607471 **[Test build #122109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122109/testReport)** for PR 28417 at commit

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621607429 **[Test build #122110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122110/testReport)** for PR 28379 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #28194: URL: https://github.com/apache/spark/pull/28194#discussion_r417739349 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -0,0 +1,341 @@ + +## Summary + - Number of queries: 333 + -

[GitHub] [spark] igreenfield commented on pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-621606974 @Ngone51 To clarify: We have one single long-running spark application to which we continuously submit jobs which are non-related to one another. These jobs may be

[GitHub] [spark] huaxingao opened a new pull request #28417: [SPARK-31612][SQL][DOCS] SQL Reference clean up

2020-04-29 Thread GitBox
huaxingao opened a new pull request #28417: URL: https://github.com/apache/spark/pull/28417 ### What changes were proposed in this pull request? SQL Reference cleanup ### Why are the changes needed? To complete SQL Reference ### Does this PR introduce _any_

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28408: [SPARK-31557][SQL] Fix timestamps rebasing in legacy parsers

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28408: URL: https://github.com/apache/spark/pull/28408#issuecomment-621605697 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28408: [SPARK-31557][SQL] Fix timestamps rebasing in legacy parsers

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28408: URL: https://github.com/apache/spark/pull/28408#issuecomment-621605697 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28408: [SPARK-31557][SQL] Fix timestamps rebasing in legacy parsers

2020-04-29 Thread GitBox
SparkQA commented on pull request #28408: URL: https://github.com/apache/spark/pull/28408#issuecomment-621605413 **[Test build #122108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122108/testReport)** for PR 28408 at commit

[GitHub] [spark] beliefer commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-29 Thread GitBox
beliefer commented on a change in pull request #28194: URL: https://github.com/apache/spark/pull/28194#discussion_r417744634 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -0,0 +1,341 @@ + +## Summary + - Number of queries: 333 + -

[GitHub] [spark] MaxGekk commented on pull request #28408: [SPARK-31557][SQL] Fix timestamps rebasing in legacy parsers

2020-04-29 Thread GitBox
MaxGekk commented on pull request #28408: URL: https://github.com/apache/spark/pull/28408#issuecomment-621603881 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] gatorsmile commented on a change in pull request #26965: [SPARK-30330][SQL]Support single quotes json parsing for get_json_object and json_tuple

2020-04-29 Thread GitBox
gatorsmile commented on a change in pull request #26965: URL: https://github.com/apache/spark/pull/26965#discussion_r417744870 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala ## @@ -101,8 +101,9 @@ private[this] object

[GitHub] [spark] beliefer commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-29 Thread GitBox
beliefer commented on a change in pull request #28194: URL: https://github.com/apache/spark/pull/28194#discussion_r417744634 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -0,0 +1,341 @@ + +## Summary + - Number of queries: 333 + -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621601808 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621599699 **[Test build #122107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122107/testReport)** for PR 28379 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621601802 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621601790 **[Test build #122107 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122107/testReport)** for PR 28379 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621601802 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28395: [SPARK-31549][PYSPARK] Add a develop API invoking collect on Python RDD with user-specified job group

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28395: URL: https://github.com/apache/spark/pull/28395#issuecomment-621600902 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28395: [SPARK-31549][PYSPARK] Add a develop API invoking collect on Python RDD with user-specified job group

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28395: URL: https://github.com/apache/spark/pull/28395#issuecomment-621600899 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28395: [SPARK-31549][PYSPARK] Add a develop API invoking collect on Python RDD with user-specified job group

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28395: URL: https://github.com/apache/spark/pull/28395#issuecomment-621600899 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28395: [SPARK-31549][PYSPARK] Add a develop API invoking collect on Python RDD with user-specified job group

2020-04-29 Thread GitBox
SparkQA removed a comment on pull request #28395: URL: https://github.com/apache/spark/pull/28395#issuecomment-621565816 **[Test build #122100 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122100/testReport)** for PR 28395 at commit

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417726395 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@ -674,6 +677,18 @@ private[spark] class Executor( } } +

[GitHub] [spark] SparkQA commented on pull request #28395: [SPARK-31549][PYSPARK] Add a develop API invoking collect on Python RDD with user-specified job group

2020-04-29 Thread GitBox
SparkQA commented on pull request #28395: URL: https://github.com/apache/spark/pull/28395#issuecomment-621600566 **[Test build #122100 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122100/testReport)** for PR 28395 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-62166 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-62166 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] beliefer commented on pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-29 Thread GitBox
beliefer commented on pull request #28194: URL: https://github.com/apache/spark/pull/28194#issuecomment-621599982 @cloud-fan @gatorsmile @maropu Thanks for all your help! This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621599699 **[Test build #122107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122107/testReport)** for PR 28379 at commit

[GitHub] [spark] MichaelChirico commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-29 Thread GitBox
MichaelChirico commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-621599753 > what could cause this? I believe it was the use in `worker.R` of `SparkR:::writeObject`; since there were no S3 methods registered in `NAMESPACE` we get that

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28402: [SPARK-31586][SQL][FOLLOWUP] Restore SQL string for datetime - interval operations

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28402: URL: https://github.com/apache/spark/pull/28402#issuecomment-621597473 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28416: [SPARK-31611][YARN] Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28416: URL: https://github.com/apache/spark/pull/28416#issuecomment-621595949 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-621596401 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28402: [SPARK-31586][SQL][FOLLOWUP] Restore SQL string for datetime - interval operations

2020-04-29 Thread GitBox
SparkQA removed a comment on pull request #28402: URL: https://github.com/apache/spark/pull/28402#issuecomment-621503725 **[Test build #122093 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122093/testReport)** for PR 28402 at commit

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417736687 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,110 @@ package org.apache.spark.util +import

[GitHub] [spark] cloud-fan commented on pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-29 Thread GitBox
cloud-fan commented on pull request #28194: URL: https://github.com/apache/spark/pull/28194#issuecomment-621598090 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #28194: URL: https://github.com/apache/spark/pull/28194#discussion_r417739349 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -0,0 +1,341 @@ + +## Summary + - Number of queries: 333 + -

[GitHub] [spark] cloud-fan commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #28194: URL: https://github.com/apache/spark/pull/28194#discussion_r417739349 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -0,0 +1,341 @@ + +## Summary + - Number of queries: 333 + -

[GitHub] [spark] AmplabJenkins commented on pull request #28402: [SPARK-31586][SQL][FOLLOWUP] Restore SQL string for datetime - interval operations

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28402: URL: https://github.com/apache/spark/pull/28402#issuecomment-621597473 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28402: [SPARK-31586][SQL][FOLLOWUP] Restore SQL string for datetime - interval operations

2020-04-29 Thread GitBox
SparkQA commented on pull request #28402: URL: https://github.com/apache/spark/pull/28402#issuecomment-621596785 **[Test build #122093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122093/testReport)** for PR 28402 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-621596401 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28416: [SPARK-31611][YARN] Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28416: URL: https://github.com/apache/spark/pull/28416#issuecomment-621596264 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-29 Thread GitBox
SparkQA commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-621596096 **[Test build #122106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122106/testReport)** for PR 27978 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28416: [SPARK-31611][YARN] Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28416: URL: https://github.com/apache/spark/pull/28416#issuecomment-621595949 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] huaxingao commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-29 Thread GitBox
huaxingao commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-621595854 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417737364 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,110 @@ package org.apache.spark.util +import

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417736687 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,110 @@ package org.apache.spark.util +import

[GitHub] [spark] cloud-fan commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417736547 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,110 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] adrian-wang commented on pull request #28393: [SPARK-31595][SQL] Spark sql should allow unescaped quote mark in quoted string

2020-04-29 Thread GitBox
adrian-wang commented on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-621594675 @xuanyuanking This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] manuzhang opened a new pull request #28416: [SPARK-31611][YARN] Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread GitBox
manuzhang opened a new pull request #28416: URL: https://github.com/apache/spark/pull/28416 ### What changes were proposed in this pull request? 1. Register `NettyMemoryMetrics` into Node Manager's metrics system through `YarnShuffleServiceMetrics`. 2. Remove duplicate

[GitHub] [spark] ScrapCodes commented on pull request #28401: [SPARK-31601][K8S] Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread GitBox
ScrapCodes commented on pull request #28401: URL: https://github.com/apache/spark/pull/28401#issuecomment-621594610 I am going to merge this into Master and branch-3.0. This is an automated message from the Apache Git

[GitHub] [spark] Ngone51 commented on pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
Ngone51 commented on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-621593916 So you're running one application but tasks are running on distributed nodes because of spark-server and logs separately. And you want to collect logs for the application by

[GitHub] [spark] cloud-fan commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417735793 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,110 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] cloud-fan commented on a change in pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
cloud-fan commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r417735716 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -17,21 +17,110 @@ package org.apache.spark.util +import java.util

[GitHub] [spark] Ngone51 edited a comment on pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-29 Thread GitBox
Ngone51 edited a comment on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-621593916 > we are running one-app but submit to it many tasks using spark-server so it has many tasks that belong to different requests. So you're running one application

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-04-29 Thread GitBox
AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-621592632 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-04-29 Thread GitBox
AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-621592632 This is an automated message from the Apache Git Service. To respond to the message, please log on to

  1   2   3   4   5   6   7   >