[GitHub] [spark] SparkQA commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
SparkQA commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620354669 **[Test build #121941 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121941/testReport)** for PR 28365 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28377: [SPARK-27340][SS][2.4] Alias on TimeWindow expression may cause watermark metadata lost

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28377: URL: https://github.com/apache/spark/pull/28377#issuecomment-620353939 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] igreenfield opened a new pull request #26624: [SPARK-8981][core] Add MDC support in Executor

2020-04-27 Thread GitBox
igreenfield opened a new pull request #26624: URL: https://github.com/apache/spark/pull/26624 ### What changes were proposed in this pull request? Added MDC support in all thread pulls TheardUtils create new pools that pass over MDC. ### Why are the changes needed? In many

[GitHub] [spark] AmplabJenkins commented on pull request #28377: [SPARK-27340][SS][2.4] Alias on TimeWindow expression may cause watermark metadata lost

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28377: URL: https://github.com/apache/spark/pull/28377#issuecomment-620353939 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative t

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620353604 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28377: [SPARK-27340][SS][2.4] Alias on TimeWindow expression may cause watermark metadata lost

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28377: URL: https://github.com/apache/spark/pull/28377#issuecomment-620283680 **[Test build #121930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121930/testReport)** for PR 28377 at commit

[GitHub] [spark] pandareen commented on pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-27 Thread GitBox
pandareen commented on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620353682 Even I need this in production, Thanks for the work so far This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620353604 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28377: [SPARK-27340][SS][2.4] Alias on TimeWindow expression may cause watermark metadata lost

2020-04-27 Thread GitBox
SparkQA commented on pull request #28377: URL: https://github.com/apache/spark/pull/28377#issuecomment-620353423 **[Test build #121930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121930/testReport)** for PR 28377 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620290577 **[Test build #121932 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121932/testReport)** for PR 26339 at commit

[GitHub] [spark] SparkQA commented on pull request #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-27 Thread GitBox
SparkQA commented on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620352663 **[Test build #121932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121932/testReport)** for PR 26339 at commit

[GitHub] [spark] SparkQA commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
SparkQA commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620351597 **[Test build #121947 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121947/testReport)** for PR 27978 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620349716 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620349716 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620348801 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620348794 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] huaxingao commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
huaxingao commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620349123 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620348476 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620348794 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620348466 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620299461 **[Test build #121935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121935/testReport)** for PR 28359 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-620347983 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620348466 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-620347976 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-620316504 **[Test build #121938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121938/testReport)** for PR 27627 at commit

[GitHub] [spark] SparkQA commented on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
SparkQA commented on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620348124 **[Test build #121935 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121935/testReport)** for PR 28359 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-620347976 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-04-27 Thread GitBox
SparkQA commented on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-620347882 **[Test build #121938 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121938/testReport)** for PR 27627 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620286082 **[Test build #121931 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121931/testReport)** for PR 27978 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620347166 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

2020-04-27 Thread GitBox
SparkQA commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620347706 **[Test build #121931 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121931/testReport)** for PR 27978 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620347161 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620337851 **[Test build #121942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121942/testReport)** for PR 28379 at commit

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620347131 **[Test build #121942 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121942/testReport)** for PR 28379 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620347161 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] MichaelChirico commented on pull request #28380: [SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
MichaelChirico commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620345743 OK so it's not an easy fix, should be addressed in a separate PR. NVM for now. This is an automated

[GitHub] [spark] HyukjinKwon commented on pull request #28380: [SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620345365 `devtools` is used in other places too, e.g. `devtools::document`. I would just like to stick to it rather than having another dependency specifically in the CI.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28381: [SPARK-31586][SQL] Replace expression TimeSub(l, r) with TimeAdd(l -r)

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28381: URL: https://github.com/apache/spark/pull/28381#issuecomment-620345133 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28381: [SPARK-31586][SQL] Replace expression TimeSub(l, r) with TimeAdd(l -r)

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28381: URL: https://github.com/apache/spark/pull/28381#issuecomment-620345133 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28381: [SPARK-31586][SQL] Replace expression TimeSub(l, r) with TimeAdd(l -r)

2020-04-27 Thread GitBox
SparkQA commented on pull request #28381: URL: https://github.com/apache/spark/pull/28381#issuecomment-620344715 **[Test build #121946 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121946/testReport)** for PR 28381 at commit

[GitHub] [spark] MichaelChirico commented on a change in pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
MichaelChirico commented on a change in pull request #28379: URL: https://github.com/apache/spark/pull/28379#discussion_r416285299 ## File path: .github/workflows/master.yml ## @@ -105,7 +105,7 @@ jobs: java-version: '11' - name: install R run: | -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27026: [SPARK-29596][Web UI] Task duration not updating for running tasks

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27026: URL: https://github.com/apache/spark/pull/27026#issuecomment-620343738 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27026: [SPARK-29596][Web UI] Task duration not updating for running tasks

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27026: URL: https://github.com/apache/spark/pull/27026#issuecomment-620343732 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] yaooqinn opened a new pull request #28381: [SPARK-31586][SQL] Replace expression TimeSub(l, r) with TimeAdd(l -r)

2020-04-27 Thread GitBox
yaooqinn opened a new pull request #28381: URL: https://github.com/apache/spark/pull/28381 ### What changes were proposed in this pull request? The implementation of TimeSub for the operation of timestamp subtracting interval is almost repetitive with TimeAdd. We can replace it with

[GitHub] [spark] MichaelChirico commented on pull request #28380: [SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
MichaelChirico commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620343694 While we're in this file, maybe update: ``` Rscript -e "devtools::install_github('jimhester/lintr')" && \ ``` to use `remotes` instead? It's a more

[GitHub] [spark] AmplabJenkins commented on pull request #27026: [SPARK-29596][Web UI] Task duration not updating for running tasks

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #27026: URL: https://github.com/apache/spark/pull/27026#issuecomment-620343732 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27026: [SPARK-29596][Web UI] Task duration not updating for running tasks

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #27026: URL: https://github.com/apache/spark/pull/27026#issuecomment-620292701 **[Test build #121933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121933/testReport)** for PR 27026 at commit

[GitHub] [spark] yqwang-ms edited a comment on pull request #28323: [SPARK-31551][CORE] Fix createSparkUser lost user's non-Hadoop credentials

2020-04-27 Thread GitBox
yqwang-ms edited a comment on pull request #28323: URL: https://github.com/apache/spark/pull/28323#issuecomment-620338444 Thanks for the review :) For testing, until now, I have did: 1. End to end simple spark job test (like spark word count) on secure Hadoop cluster. 2. All

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28380: [SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620342933 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27026: [SPARK-29596][Web UI] Task duration not updating for running tasks

2020-04-27 Thread GitBox
SparkQA commented on pull request #27026: URL: https://github.com/apache/spark/pull/27026#issuecomment-620343086 **[Test build #121933 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121933/testReport)** for PR 27026 at commit

[GitHub] [spark] yqwang-ms edited a comment on pull request #28323: [SPARK-31551][CORE] Fix createSparkUser lost user's non-Hadoop credentials

2020-04-27 Thread GitBox
yqwang-ms edited a comment on pull request #28323: URL: https://github.com/apache/spark/pull/28323#issuecomment-620338444 Thanks for the review :) For testing, until now, I have did: 1. End to end simple spark job test (like spark word count) on secure Hadoop cluster. 2. All

[GitHub] [spark] yqwang-ms edited a comment on pull request #28323: [SPARK-31551][CORE] Fix createSparkUser lost user's non-Hadoop credentials

2020-04-27 Thread GitBox
yqwang-ms edited a comment on pull request #28323: URL: https://github.com/apache/spark/pull/28323#issuecomment-620338444 For testing, until now, I have did: 1. End to end simple spark job test (like spark word count) on secure Hadoop cluster. 2. All existing unit tests are passed

[GitHub] [spark] AmplabJenkins commented on pull request #28380: [SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620342933 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28379: URL: https://github.com/apache/spark/pull/28379#discussion_r416283905 ## File path: .github/workflows/master.yml ## @@ -105,7 +105,7 @@ jobs: java-version: '11' - name: install R run: | -

[GitHub] [spark] SparkQA commented on pull request #28380: [SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
SparkQA commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620342487 **[Test build #121945 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121945/testReport)** for PR 28380 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #28380: [SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620342482 Yup, maybe it just needs some time to sync. Thanks for pointing these out @MichaelChirico and @dongjoon-hyun.

[GitHub] [spark] dongjoon-hyun commented on pull request #28380: [WIP][SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
dongjoon-hyun commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620342031 Thank you so much. Although I have no clue yet, Ubuntu OS might be changed by GitHub Action. Both Ubuntu and R released a new version.

[GitHub] [spark] HyukjinKwon commented on pull request #28380: [WIP][SPARK-31587][R][INFRA] Uses R 4.0.0 in Github Actions

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620341530 Yes .. I just checked too. Let me investigate a bit more. This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
dongjoon-hyun commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620341343 FYI, I checked the official README. - https://cloud.r-project.org/bin/linux/ubuntu/README.html ``` deb https://cloud.r-project.org/bin/linux/ubuntu bionic-cran35/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620340604 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620340604 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28380: URL: https://github.com/apache/spark/pull/28380#discussion_r416281840 ## File path: .github/workflows/master.yml ## @@ -105,7 +105,7 @@ jobs: java-version: '11' - name: install R run: | -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620340583 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620340583 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #28380: URL: https://github.com/apache/spark/pull/28380#discussion_r416281556 ## File path: .github/workflows/master.yml ## @@ -105,7 +105,7 @@ jobs: java-version: '11' - name: install R run: | -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620338252 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
SparkQA commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620340283 **[Test build #121943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121943/testReport)** for PR 28380 at commit

[GitHub] [spark] MichaelChirico commented on a change in pull request #28380: [WIP][SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
MichaelChirico commented on a change in pull request #28380: URL: https://github.com/apache/spark/pull/28380#discussion_r416281264 ## File path: .github/workflows/master.yml ## @@ -105,7 +105,7 @@ jobs: java-version: '11' - name: install R run: | -

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620340295 **[Test build #121944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121944/testReport)** for PR 28379 at commit

[GitHub] [spark] yqwang-ms edited a comment on pull request #28323: [SPARK-31551][CORE] Fix createSparkUser lost user's non-Hadoop credentials

2020-04-27 Thread GitBox
yqwang-ms edited a comment on pull request #28323: URL: https://github.com/apache/spark/pull/28323#issuecomment-620338444 For testing, until now, I have did: 1. End to end simple spark job test (like spark word count) on secure Hadoop cluster. 2. All existing unit tests are passed

[GitHub] [spark] yqwang-ms edited a comment on pull request #28323: [SPARK-31551][CORE] Fix createSparkUser lost user's non-Hadoop credentials

2020-04-27 Thread GitBox
yqwang-ms edited a comment on pull request #28323: URL: https://github.com/apache/spark/pull/28323#issuecomment-620338444 For testing, until now, I have did: 1. End to end simple spark job test (like spark word count) on secure Hadoop cluster. 2. All existing unit tests are passed

[GitHub] [spark] AmplabJenkins commented on pull request #28380: [SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620338252 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620338239 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] yqwang-ms commented on pull request #28323: [SPARK-31551][CORE] Fix createSparkUser lost user's non-Hadoop credentials

2020-04-27 Thread GitBox
yqwang-ms commented on pull request #28323: URL: https://github.com/apache/spark/pull/28323#issuecomment-620338444 For testing, until now, I have did: 1. End to end simple spark job test (like spark word count) on secure Hadoop cluster. 2. All existing unit tests are passed

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620338239 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] MichaelChirico commented on pull request #28380: [SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
MichaelChirico commented on pull request #28380: URL: https://github.com/apache/spark/pull/28380#issuecomment-620338539 There's another reference to this in `dev/create-release/spark-rm/Dockerfile` This is an automated

[GitHub] [spark] HyukjinKwon commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620338157 Thanks for pointing it out. I just opened a PR :-) This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620335910 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620337851 **[Test build #121942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121942/testReport)** for PR 28379 at commit

[GitHub] [spark] HyukjinKwon opened a new pull request #28380: [SPARK-31587][R][INFRA] Fixes the repository for downloading R in Github Actions

2020-04-27 Thread GitBox
HyukjinKwon opened a new pull request #28380: URL: https://github.com/apache/spark/pull/28380 ### What changes were proposed in this pull request? Currently R installation seems being failed in Github Actions: ``` Get:61 https://dl.bintray.com/sbt/debian Packages [4174 B]

[GitHub] [spark] MichaelChirico commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
MichaelChirico commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620337520 @HyukjinKwon oh! actually the issue is not transient. > The repository 'https://cloud.r-project.org/bin/linux/ubuntu bionic-cran35/ Release that file

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620335910 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] MichaelChirico opened a new pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

2020-04-27 Thread GitBox
MichaelChirico opened a new pull request #28379: URL: https://github.com/apache/spark/pull/28379 Re-filing stale https://github.com/apache/spark/pull/24888 ### What changes were proposed in this pull request? Migrate `write*` internals to use an S3 generic

[GitHub] [spark] SparkQA commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
SparkQA commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620335594 **[Test build #121941 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121941/testReport)** for PR 28365 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26257: [SPARK-29606][SQL] Improve EliminateOuterJoin performance

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #26257: URL: https://github.com/apache/spark/pull/26257#issuecomment-620333717 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620333651 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28375: [SPARK-30282][SQL][FOLLOWUP] SHOW TBLPROPERTIES should support views

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28375: URL: https://github.com/apache/spark/pull/28375#issuecomment-620333625 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28378: [SPARK-31584][WebUI] Fix NullPointerException when parsing event log with InMemoryStore

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28378: URL: https://github.com/apache/spark/pull/28378#issuecomment-620333143 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620334061 cc @felixcheung and @shivaram FYI This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620333651 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28378: [SPARK-31584][WebUI] Fix NullPointerException when parsing event log with InMemoryStore

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28378: URL: https://github.com/apache/spark/pull/28378#issuecomment-620333535 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28375: [SPARK-30282][SQL][FOLLOWUP] SHOW TBLPROPERTIES should support views

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28375: URL: https://github.com/apache/spark/pull/28375#issuecomment-620333625 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #26257: [SPARK-29606][SQL] Improve EliminateOuterJoin performance

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #26257: URL: https://github.com/apache/spark/pull/26257#issuecomment-620333717 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #28367: [SPARK-31573][R] Apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28367: URL: https://github.com/apache/spark/pull/28367#issuecomment-62001 Let's see if AppVeyor tests pass. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28372: [SPARK-31578][R] Vectorize schema validation for arrow in types.R

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28372: URL: https://github.com/apache/spark/pull/28372#issuecomment-620332934 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28375: [SPARK-30282][SQL][FOLLOWUP] SHOW TBLPROPERTIES should support views

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28375: URL: https://github.com/apache/spark/pull/28375#issuecomment-620211719 **[Test build #121925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121925/testReport)** for PR 28375 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28378: [SPARK-31584][WebUI] Fix NullPointerException when parsing event log with InMemoryStore

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28378: URL: https://github.com/apache/spark/pull/28378#issuecomment-620333143 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28372: [SPARK-31578][R] Vectorize schema validation for arrow in types.R

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28372: URL: https://github.com/apache/spark/pull/28372#issuecomment-620332934 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28372: [SPARK-31578][R] Vectorize schema validation for arrow in types.R

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28372: URL: https://github.com/apache/spark/pull/28372#issuecomment-620316474 **[Test build #121937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121937/testReport)** for PR 28372 at commit

[GitHub] [spark] SparkQA commented on pull request #28372: [SPARK-31578][R] Vectorize schema validation for arrow in types.R

2020-04-27 Thread GitBox
SparkQA commented on pull request #28372: URL: https://github.com/apache/spark/pull/28372#issuecomment-620332801 **[Test build #121937 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121937/testReport)** for PR 28372 at commit

<    1   2   3   4   5   6   7   8   9   10   >