Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #98805 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98805/testReport)**
for PR 22504 at commit
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22962#discussion_r233275410
--- Diff: python/pyspark/taskcontext.py ---
@@ -147,8 +147,8 @@ def __init__(self):
@classmethod
def _getOrCreate(cls):
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98799/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #98799 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98799/testReport)**
for PR 22504 at commit
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/23004#discussion_r233272718
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -237,6 +237,13 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98795/
Test PASSed.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23021
> I'd break the pandas udf one into smaller pieces too, as you suggested.
We should also investigate why the runtime didn't improve ...
One suspection from my investigation is, it
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
**[Test build #98795 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98795/testReport)**
for PR 23019 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/23021#discussion_r233269827
--- Diff: python/pyspark/testing/sqlutils.py ---
@@ -0,0 +1,268 @@
+#
--- End diff --
Yea, similar thought. One thing is though testing
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23021
Yup, will break pandas one into smaller ones as well.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22760#discussion_r233266609
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/HadoopConfExecutorFeatureStepSuite.scala
---
@@ -0,0 +1,68
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98793/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
**[Test build #98793 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98793/testReport)**
for PR 23019 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22993
**[Test build #98804 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98804/testReport)**
for PR 22993 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22993
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22993
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22994
(weird, github ate my last comment)
@HyukjinKwon i think we're g2g for merging this in to master and backports.
you want to do this, or should i?
---
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/23023
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23023
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23023
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98794/
Test PASSed.
---
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22760#discussion_r233257218
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/HadoopConfExecutorFeatureStepSuite.scala
---
@@ -0,0 +1,68
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23023
**[Test build #98794 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98794/testReport)**
for PR 23023 at commit
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r233255758
--- Diff:
core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala ---
@@ -19,18 +19,31 @@ package org.apache.spark.metrics
import
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22994
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22994
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98790/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22994
**[Test build #98790 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98790/testReport)**
for PR 22994 at commit
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r233254497
--- Diff:
core/src/main/scala/org/apache/spark/executor/ProcfsBasedSystems.scala ---
@@ -0,0 +1,266 @@
+/*
+ * Licensed to the Apache Software
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r233252552
--- Diff:
core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala ---
@@ -19,18 +19,31 @@ package org.apache.spark.metrics
import
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21957
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21957
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98788/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21957
**[Test build #98788 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98788/testReport)**
for PR 21957 at commit
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r233250143
--- Diff:
core/src/main/scala/org/apache/spark/executor/ProcfsBasedSystems.scala ---
@@ -0,0 +1,222 @@
+/*
+ * Licensed to the Apache Software
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98789/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
**[Test build #98789 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98789/testReport)**
for PR 23019 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98791/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22880
**[Test build #98791 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98791/testReport)**
for PR 22880 at commit
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22979#discussion_r233242705
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/UnivocityParser.scala
---
@@ -104,6 +106,14 @@ class UnivocityParser(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5006/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98786/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22967
**[Test build #98786 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98786/testReport)**
for PR 22967 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5006/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23026
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user shanyu commented on the issue:
https://github.com/apache/spark/pull/23009
thanks @vanzin! Yes you are right this only affects Yarn mode, and
duplicates should be taken cared by Yarn. Title and description updated as
suggested by you.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23026
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23026
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23026
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user NiharS opened a pull request:
https://github.com/apache/spark/pull/23026
[SPARK-25960][k8s] Support subpath mounting with Kubernetes
## What changes were proposed in this pull request?
This PR adds configurations to use subpaths with Spark on k8s. Subpaths
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23017
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98787/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23017
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22986#discussion_r233232112
--- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala ---
@@ -538,7 +538,7 @@ private[ml] object GBTClassifierParams {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
**[Test build #98803 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98803/testReport)**
for PR 23019 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23017
**[Test build #98787 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98787/testReport)**
for PR 23017 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22993
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22993
**[Test build #98802 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98802/testReport)**
for PR 22993 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22993
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98802/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22993
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22993
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22993
**[Test build #98802 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98802/testReport)**
for PR 22993 at commit
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22993#discussion_r233222902
--- Diff: core/src/main/scala/org/apache/spark/storage/StorageUtils.scala
---
@@ -193,6 +194,36 @@ private[spark] class StorageStatus(
/** Helper
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23009
**[Test build #98801 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98801/testReport)**
for PR 23009 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23019
(The log files did show up though. Yay!)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/21627
Jenkins, retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23025
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23025
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23009
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23009
Setting that property should not affect Scala code in any way.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23025
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user JulienPeloton opened a pull request:
https://github.com/apache/spark/pull/23025
[SPARK-26024][SQL]: Update documentation for repartitionByRange
Following [SPARK-26024](https://issues.apache.org/jira/browse/SPARK-26024),
I noticed the number of elements in each partition
Github user inchiosa commented on the issue:
https://github.com/apache/spark/pull/23009
Might this fix impact the resource usage and performance of Scala notebooks
run through Livy by unnecessarily setting spark.submit.pyFiles?
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23024
**[Test build #98800 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98800/testReport)**
for PR 23024 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5004/
---
Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/22993#discussion_r233216872
--- Diff: core/src/main/scala/org/apache/spark/storage/StorageUtils.scala
---
@@ -193,6 +194,36 @@ private[spark] class StorageStatus(
/** Helper
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23017#discussion_r233215367
--- Diff:
resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh ---
@@ -30,6 +30,10 @@ set -e
# If there is no passwd entry for
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5004/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22986
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22986
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98785/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #98799 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98799/testReport)**
for PR 22504 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22760
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22986
**[Test build #98785 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98785/testReport)**
for PR 22986 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22760
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22504
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22760
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5003/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23024
**[Test build #98798 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98798/testReport)**
for PR 23024 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23024
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22760
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98796/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22760
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23024
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22760
**[Test build #98796 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98796/testReport)**
for PR 22760 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
**[Test build #98797 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98797/testReport)**
for PR 23019 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22760
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5003/
---
101 - 200 of 511 matches
Mail list logo
