[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455571230 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455571422 **[Test build #101403 has

[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455571237 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455573266 **[Test build #101395 has

[GitHub] SparkQA removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

SparkQA removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455475591 **[Test build #101395 has

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455575390 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455575358 **[Test build #101403 has

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455575396 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

SparkQA removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455571422 **[Test build #101403 has

[GitHub] HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#issuecomment-455579458 That's cool. Looks fine so far. Do you mind if I ask to update PR title and description

[GitHub] srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249083967 ## File path: python/pyspark/cloudpickle.py ## @@ -42,20 +42,26 @@ """ from __future__ import

[GitHub] srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249083802 ## File path: python/pyspark/cloudpickle.py ## @@ -72,6 +78,22 @@ PY3 = True Review

[GitHub] inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249090813 ## File path: python/pyspark/cloudpickle.py ## @@ -42,20 +42,26 @@ """ from __future__ import

[GitHub] inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249093196 ## File path: python/pyspark/cloudpickle.py ## @@ -72,6 +78,22 @@ PY3 = True Review

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455595068 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455595068 Merged build finished. Test FAILed.

[GitHub] rednaxelafx commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

rednaxelafx commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#discussion_r249109140 ## File path:

[GitHub] rednaxelafx commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

rednaxelafx commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#discussion_r249108271 ## File path:

[GitHub] rednaxelafx commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

rednaxelafx commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#discussion_r249109203 ## File path:

[GitHub] purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455615059 Thanks for the quick response. To suppress the warnings, I believe I need to update `project/MimaExcludes.scala`

[GitHub] AmplabJenkins commented on issue #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable

AmplabJenkins commented on issue #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable URL: https://github.com/apache/spark/pull/23587#issuecomment-455619330 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable

AmplabJenkins commented on issue #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable URL: https://github.com/apache/spark/pull/23587#issuecomment-455619342 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable

SparkQA commented on issue #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable URL: https://github.com/apache/spark/pull/23587#issuecomment-455619221 **[Test build #101408 has

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249115818 ## File path:

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249116345 ## File path:

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249114851 ## File path: docs/running-on-kubernetes.md ## @@ -193,8 +193,23 @@ If your

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249118375 ## File path:

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249115464 ## File path: docs/running-on-kubernetes.md ## @@ -193,8 +193,23 @@ If your

[GitHub] SparkQA commented on issue #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched

SparkQA commented on issue #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched URL: https://github.com/apache/spark/pull/22806#issuecomment-455621078 **[Test build #101409 has

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249118870 ## File path: docs/running-on-kubernetes.md ## @@ -1010,6 +1024,15 @@ See the below

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249114166 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -714,6

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249120565 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ## @@

[GitHub] liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

liyinan926 commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249117347 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455575396 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_p

AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455580033 Test PASSed.

[GitHub] SparkQA removed a comment on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

SparkQA removed a comment on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455585171 **[Test build #4521 has

[GitHub] srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249096316 ## File path: python/pyspark/cloudpickle.py ## @@ -72,6 +78,22 @@ PY3 = True Review

[GitHub] srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

srowen commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249096472 ## File path: python/pyspark/cloudpickle.py ## @@ -72,6 +78,22 @@ PY3 = True Review

[GitHub] AmplabJenkins removed a comment on issue #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

AmplabJenkins removed a comment on issue #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#issuecomment-455615489 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

AmplabJenkins removed a comment on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#issuecomment-455615635 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon commented on a change in pull request #23583: [MINOR]Remove unused symbols

HyukjinKwon commented on a change in pull request #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#discussion_r248985669 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala ## @@ -476,7 +475,7 @@ class

[GitHub] HyukjinKwon commented on a change in pull request #23583: [MINOR]Remove unused symbols

HyukjinKwon commented on a change in pull request #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#discussion_r248985631 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/InsertSuite.scala ## @@ -170,7 +170,7 @@ class

[GitHub] SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-45552 **[Test build #101397 has

[GitHub] HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#discussion_r249036191 ## File path:

[GitHub] HeartSaVioR edited a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HeartSaVioR edited a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455539926 Fixed UTs as well as added a new test to verify custom log URL work. Ended up with adding `attributes` to

[GitHub] HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#discussion_r249035982 ## File path:

[GitHub] HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#discussion_r248984540 ## File path:

[GitHub] HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

HyukjinKwon commented on a change in pull request #23582: [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain URL: https://github.com/apache/spark/pull/23582#discussion_r248984540 ## File path:

[GitHub] kiszk commented on a change in pull request #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

kiszk commented on a change in pull request #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#discussion_r249065798 ## File path:

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455571237 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455571230 Merged build finished. Test PASSed.

[GitHub] HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249085930 ## File path: python/pyspark/cloudpickle.py ## @@ -42,20 +42,26 @@ """ from __future__

[GitHub] HyukjinKwon closed pull request #15670: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

HyukjinKwon closed pull request #15670: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/15670 This is an automated message from the

[GitHub] HyukjinKwon commented on issue #15670: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

HyukjinKwon commented on issue #15670: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/15670#issuecomment-455590931 https://github.com/apache/spark/pull/20691 is being taking over. Closing this.

[GitHub] AmplabJenkins removed a comment on issue #23583: [MINOR]Remove unused symbols

AmplabJenkins removed a comment on issue #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#issuecomment-455593138 Merged build finished. Test FAILed. This is an automated message from the

[GitHub] HyukjinKwon commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_pre

HyukjinKwon commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455592973 Merged to master!

[GitHub] SparkQA removed a comment on issue #23583: [MINOR]Remove unused symbols

SparkQA removed a comment on issue #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#issuecomment-455477303 **[Test build #101396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101396/testReport)** for PR 23583 at commit

[GitHub] AmplabJenkins commented on issue #23583: [MINOR]Remove unused symbols

AmplabJenkins commented on issue #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#issuecomment-455593138 Merged build finished. Test FAILed. This is an automated message from the Apache Git

[GitHub] SparkQA commented on issue #23583: [MINOR]Remove unused symbols

SparkQA commented on issue #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#issuecomment-455593083 **[Test build #101396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101396/testReport)** for PR 23583 at commit

[GitHub] AmplabJenkins commented on issue #23583: [MINOR]Remove unused symbols

AmplabJenkins commented on issue #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#issuecomment-455593145 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon edited a comment on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

HyukjinKwon edited a comment on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#issuecomment-455590380 @inpefess, also do you mind if I ask to elaborate how highest protocol solves 4GB problem? I think it's good to leave a

[GitHub] purijatin edited a comment on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

purijatin edited a comment on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455608054 Ok. So I need some guidance here. Below is the error: > [error] * method

[GitHub] srowen commented on issue #23578: Fix typo in README.md

srowen commented on issue #23578: Fix typo in README.md URL: https://github.com/apache/spark/pull/23578#issuecomment-455613571 I think it's OK to treat this as a proper-noun concept, even if it's a buzzword. This isn't a typo.

[GitHub] srowen closed pull request #23578: Fix typo in README.md

srowen closed pull request #23578: Fix typo in README.md URL: https://github.com/apache/spark/pull/23578 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the

[GitHub] squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455616927 >> The one thing I am wondering about is if we should change it so that when the SHS is looking at an inprogress file,

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455574882 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455574882 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_traini

AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455580029 Merged

[GitHub] AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_p

AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455580029 Merged build

[GitHub] AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_traini

AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455580033 Test

[GitHub] SparkQA commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

SparkQA commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455591685 **[Test build #4521 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4521/testReport)**

[GitHub] HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#issuecomment-455591492 Adding @viirya, @ueshin, @BryanCutler too This is an automated

[GitHub] HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455593929 retest this please This is

[GitHub] purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455608054 Ok. So I need some guidance here. Below is the error: > [error] * method

[GitHub] srowen commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

srowen commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455611605 Ignore the 'merge cleanly' message; I think it's caused by another error. It is mergeable. You can suppress the

[GitHub] rednaxelafx opened a new pull request #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable

rednaxelafx opened a new pull request #23587: [SPARK-26664][SQL] Make DecimalType's minimum adjusted scale configurable URL: https://github.com/apache/spark/pull/23587 ## What changes were proposed in this pull request? Introduce a new conf flag that allows the user to set the value

[GitHub] pgandhi999 commented on a change in pull request #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched

pgandhi999 commented on a change in pull request #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched URL: https://github.com/apache/spark/pull/22806#discussion_r249120941 ## File path:

[GitHub] pgandhi999 commented on a change in pull request #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched

pgandhi999 commented on a change in pull request #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched URL: https://github.com/apache/spark/pull/22806#discussion_r249120902 ## File path:

[GitHub] pgandhi999 commented on a change in pull request #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched

pgandhi999 commented on a change in pull request #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched URL: https://github.com/apache/spark/pull/22806#discussion_r249120839 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455574888 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455575390 Merged build finished. Test FAILed.

[GitHub] viirya commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_predicti

viirya commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455577690 cc @HyukjinKwon

[GitHub] SparkQA commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_predict

SparkQA commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455577712 **[Test build #101404

[GitHub] SparkQA commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_predict

SparkQA commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455585096 **[Test build #101404

[GitHub] SparkQA commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

SparkQA commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455585171 **[Test build #4521 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4521/testReport)**

[GitHub] inpefess commented on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

inpefess commented on issue #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#issuecomment-455589610 > Do you mind if I ask to update PR title and description to target upgrade cloudpickle? Done. I guess that

[GitHub] viirya commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_predicti

viirya commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455593676 Thanks @HyukjinKwon

[GitHub] AmplabJenkins removed a comment on issue #23583: [MINOR]Remove unused symbols

AmplabJenkins removed a comment on issue #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#issuecomment-455593145 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455593812 Hmmm running it with coverage itself might be related ..

[GitHub] srowen commented on a change in pull request #23583: [MINOR]Remove unused symbols

srowen commented on a change in pull request #23583: [MINOR]Remove unused symbols URL: https://github.com/apache/spark/pull/23583#discussion_r249101903 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/OffsetSeqLog.scala ## @@ -56,7 +56,6 @@

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455574888 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon commented on issue #21977: [SPARK-25004][CORE] Add spark.executor.pyspark.memory limit.

HyukjinKwon commented on issue #21977: [SPARK-25004][CORE] Add spark.executor.pyspark.memory limit. URL: https://github.com/apache/spark/pull/21977#issuecomment-455577998 Sorry for a late input like this. I totally forgot about it and suddenly I recalled it. Have you guys taken a look for

[GitHub] AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_p

AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455585357 Merged build

[GitHub] HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249083190 ## File path: python/pyspark/serializers.py ## @@ -65,7 +65,7 @@ from itertools import

[GitHub] HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1

HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Update cloudpickle to v0.6.1 URL: https://github.com/apache/spark/pull/20691#discussion_r249083258 ## File path: python/pyspark/tests/test_rdd.py ## @@ -605,7 +605,7 @@ def

[GitHub] AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_traini

AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455585357 Merged

[GitHub] SparkQA removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and

SparkQA removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455577712 **[Test build

[GitHub] AmplabJenkins removed a comment on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

AmplabJenkins removed a comment on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-454310293 Can one of the admins verify this patch? This

[GitHub] AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_traini

AmplabJenkins removed a comment on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455585366 Test

[GitHub] AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_p

AmplabJenkins commented on issue #23586: [SPARK-26646][TEST][PySpark] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction URL: https://github.com/apache/spark/pull/23586#issuecomment-455585366 Test PASSed.

  1   2   3   4   5   6   >