Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21029
**[Test build #89490 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89490/testReport)**
for PR 21029 at commit
[`18e391a`](https://github.com/apache/spark/commit/1
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21034
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mn-mikke commented on the issue:
https://github.com/apache/spark/pull/21034
Thanks everybody for code reviews!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21034
Thanks! merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: rev
Github user WeichenXu123 commented on a diff in the pull request:
https://github.com/apache/spark/pull/17086#discussion_r182367186
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/evaluation/MulticlassMetrics.scala
---
@@ -27,10 +27,11 @@ import org.apache.spark.sql.DataFrame
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20894
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20894
**[Test build #89496 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89496/testReport)**
for PR 20894 at commit
[`a5f2916`](https://github.com/apache/spark/commit/a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20894
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89496/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20894
**[Test build #89496 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89496/testReport)**
for PR 20894 at commit
[`a5f2916`](https://github.com/apache/spark/commit/a5
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21089
The PR was closed because the equals and hashCode method were explicitly
deleted in the commit:
https://github.com/apache/spark/commit/3e4e868c850e6b6da2c0d005167316e1abdc7460
---
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20858
**[Test build #89495 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89495/testReport)**
for PR 20858 at commit
[`8a125d9`](https://github.com/apache/spark/commit/8a
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21053#discussion_r182362454
--- Diff: python/pyspark/sql/functions.py ---
@@ -1846,6 +1846,28 @@ def array_contains(col, value):
return Column(sc._jvm.functions.array_contains(_
Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/21091
cc @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/20858#discussion_r182357725
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -353,3 +356,218 @@ case class ArrayMax(c
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21089
@HyukjinKwon I cannot find tests for not-root map types in
JsonFunctionsSuite and JsonExpressionsSuite. I am going to propose a PR for
supporting the map type as root type in from_json. The tests fo
Github user mshtelma commented on the issue:
https://github.com/apache/spark/pull/21052
@wzhfy @maropu Hi guys, is there anything else I should add/change to the
PR ?
---
-
To unsubscribe, e-mail: reviews-unsubscr.
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/20858
LGTM except for nits.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20858#discussion_r182350135
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -353,3 +356,218 @@ case class ArrayMax(chi
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20858#discussion_r182349064
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -353,3 +356,218 @@ case class ArrayMax(chi
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21061
**[Test build #89493 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89493/testReport)**
for PR 21061 at commit
[`bbbc865`](https://github.com/apache/spark/commit/bb
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20636
**[Test build #89494 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89494/testReport)**
for PR 20636 at commit
[`21b3708`](https://github.com/apache/spark/commit/21
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21089
@MaxGekk, mind taking an action to the JIRA too?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For addit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21061
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20636
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21061
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2425/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20636
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2426/
Tes
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21053#discussion_r182350430
--- Diff: python/pyspark/sql/functions.py ---
@@ -1846,6 +1846,28 @@ def array_contains(col, value):
return Column(sc._jvm.functions.array_contains(_t
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21061
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/20636
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/16578
I only looked at the PR description, here are my 2 cents:
Currently column pruning is done with 2 steps in Spark: 1) optimizer
generates extra `Project` to prune unnecessary columns as bot
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20938
**[Test build #89492 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89492/testReport)**
for PR 20938 at commit
[`10849d7`](https://github.com/apache/spark/commit/10
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/20938
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: r
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21094
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21094
**[Test build #89491 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89491/testReport)**
for PR 21094 at commit
[`ad74513`](https://github.com/apache/spark/commit/ad
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2424/
Tes
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21094
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20930#discussion_r182340309
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1266,6 +1266,9 @@ class DAGScheduler(
}
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21094
**[Test build #89488 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89488/testReport)**
for PR 21094 at commit
[`ad74513`](https://github.com/apache/spark/commit/a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89488/
Test FAILed.
---
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21011#discussion_r182333814
--- Diff: python/pyspark/sql/functions.py ---
@@ -1846,6 +1846,27 @@ def array_contains(col, value):
return Column(sc._jvm.functions.array_contains(_
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20930#discussion_r182338127
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1266,6 +1266,9 @@ class DAGScheduler(
}
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21029
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21029
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2423/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21093
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2422/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21093
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20930#discussion_r182336811
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1266,6 +1266,9 @@ class DAGScheduler(
}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21029
**[Test build #89490 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89490/testReport)**
for PR 21029 at commit
[`18e391a`](https://github.com/apache/spark/commit/18
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21093
**[Test build #89489 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89489/testReport)**
for PR 21093 at commit
[`fc5d976`](https://github.com/apache/spark/commit/fc
Github user MaxGekk closed the pull request at:
https://github.com/apache/spark/pull/21089
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21093
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21029
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21095
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user madanadit commented on the issue:
https://github.com/apache/spark/pull/21095
@liyinan926 @foxish Please take a look
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comman
GitHub user madanadit opened a pull request:
https://github.com/apache/spark/pull/21095
[SPARK-23529][K8s] Support mounting hostPath volumes
## What changes were proposed in this pull request?
This PR introduces a new config `spark.kubernetes.driver/executor.volumes`
taking
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21095
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21053#discussion_r182325781
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -417,3 +417,106 @@ case class ArrayMax(chi
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21053#discussion_r182327230
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -417,3 +417,106 @@ case class ArrayMax(chi
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21053#discussion_r182323290
--- Diff: python/pyspark/sql/functions.py ---
@@ -1846,6 +1846,28 @@ def array_contains(col, value):
return Column(sc._jvm.functions.array_contains(_
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21053#discussion_r182326476
--- Diff: python/pyspark/sql/functions.py ---
@@ -1846,6 +1846,28 @@ def array_contains(col, value):
return Column(sc._jvm.functions.array_contains(_
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/21084
@jerryshao , There is not any issue without transient, but I think it is
better to keep same to other fields, and make it clearly which fields do not
need to be serialized.
---
-
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/19222
Sorry this thread is too long for me to follow. I might be bringing up a
point that has been brought up before.
@kiszk did your perf tests take into account megamorphic callsites? It
seems to
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2421/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21094
**[Test build #89488 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89488/testReport)**
for PR 21094 at commit
[`ad74513`](https://github.com/apache/spark/commit/ad
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/21084
@jiangxb1987 It does not take significant time to serialize the
taskMemoryManager, because the value is null in driver side, but I think it is
better to keep same to other fields in the Task class
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21094
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: r
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21029
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21029
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89482/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21094
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89486/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21093
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21061
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89487/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20636
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89485/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21093
**[Test build #89484 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89484/testReport)**
for PR 21093 at commit
[`fc5d976`](https://github.com/apache/spark/commit/f
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20636
**[Test build #89485 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89485/testReport)**
for PR 20636 at commit
[`21b3708`](https://github.com/apache/spark/commit/2
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21093
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89484/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20636
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21061
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21061
**[Test build #89487 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89487/testReport)**
for PR 21061 at commit
[`bbbc865`](https://github.com/apache/spark/commit/b
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21094
**[Test build #89486 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89486/testReport)**
for PR 21094 at commit
[`ad74513`](https://github.com/apache/spark/commit/a
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21029
**[Test build #89482 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89482/testReport)**
for PR 21029 at commit
[`18e391a`](https://github.com/apache/spark/commit/1
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21094
good catch! LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h.
501 - 584 of 584 matches
Mail list logo
