Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23088
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user shahidki31 reopened a pull request:
https://github.com/apache/spark/pull/23088
[SPARK-26119][CORE][WEBUI]Task summary table should contain only successful
tasks' metrics
## What changes were proposed in this pull request?
Task summary table in the stage page
Github user ramaddepally commented on the issue:
https://github.com/apache/spark/pull/23053
> > Probably also want to update `docs/running-on-kubernetes.md` to make it
clear that you now have to opt into building the additional language bindings
>
> @rvesse ... Actually, the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99128/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23105
**[Test build #99128 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99128/testReport)**
for PR 23105 at commit
Github user ramaddepally commented on the issue:
https://github.com/apache/spark/pull/23053
> Probably also want to update `docs/running-on-kubernetes.md` to make it
clear that you now have to opt into building the additional language bindings
@rvesse ... Actually, the usage
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21465
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21465
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99136/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21465
**[Test build #99136 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99136/testReport)**
for PR 21465 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21465
**[Test build #99136 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99136/testReport)**
for PR 21465 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21465
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21465
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user huaxingao commented on a diff in the pull request:
https://github.com/apache/spark/pull/21465#discussion_r235488017
--- Diff: python/pyspark/ml/classification.py ---
@@ -1176,8 +1176,8 @@ def trees(self):
@inherit_doc
class GBTClassifier(JavaEstimator,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23103
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99134/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23103
**[Test build #99134 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99134/testReport)**
for PR 23103 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23103
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99127/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21688
**[Test build #99127 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99127/testReport)**
for PR 21688 at commit
Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/23081
Thank you @srowen
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235480695
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010]
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22938
LGTM except the migration guide. JSON data source can't produce null rows,
but skip it even with permisive mode.
---
-
To
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235479872
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010]
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23103
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23086
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23103
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23086
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23054
hmmm it conflicts again...
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user zouzias commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235478266
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010] object
Github user zouzias commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235478048
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010] object
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23086
**[Test build #99135 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99135/testReport)**
for PR 23086 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23103
**[Test build #99134 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99134/testReport)**
for PR 23103 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22875
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22875
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/23095#discussion_r235473858
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousExecution.scala
---
@@ -117,6 +117,7 @@ class
Github user ijuma commented on the issue:
https://github.com/apache/spark/pull/23099
Amazingly fast update, nice one. :)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/23086#discussion_r235470285
--- Diff: project/MimaExcludes.scala ---
@@ -149,7 +149,8 @@ object MimaExcludes {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22875
**[Test build #99133 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99133/testReport)**
for PR 22875 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23043
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23043
**[Test build #99132 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99132/testReport)**
for PR 23043 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23043
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22875
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23043
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23039
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23039
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99121/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23039
**[Test build #99121 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99121/testReport)**
for PR 23039 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22875
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99123/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22875
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22875
**[Test build #99123 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99123/testReport)**
for PR 22875 at commit
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235462394
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010]
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235461374
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010]
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23055
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99120/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23055
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23055
**[Test build #99120 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99120/testReport)**
for PR 23055 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23106
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99130/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23106
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23106
**[Test build #99130 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99130/testReport)**
for PR 23106 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23080
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23080
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99122/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23105
**[Test build #99131 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99131/testReport)**
for PR 23105 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23106
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23106
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23106
**[Test build #99130 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99130/testReport)**
for PR 23106 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23080
**[Test build #99122 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99122/testReport)**
for PR 23080 at commit
GitHub user rxin opened a pull request:
https://github.com/apache/spark/pull/23106
[SPARK-26141] Enable custom shuffle metrics implementation in shuffle write
## What changes were proposed in this pull request?
This is the write side counterpart to
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/23105
cc @jiangxb1987 @squito
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21308
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21308
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23096
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23062
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/23096
Merging this. Feel free to leave more comments. I'm hoping we can wire this
into the UI eventually.
---
-
To unsubscribe, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/23062
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23081
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/23088
When evaluating these things I use git blame (or visual tools here and in
an IDE) to figure out if there was a previous change that explicitly tried to
change the behavior, and whether it was on
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/23081
Merged to master/2.4/2.3
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22822
Yeah, I can't imagine merging support for any other resource manager I know
of now; it's just way too much to maintain. I have not heard of this one
myself. It should be implemented outside Spark.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23043
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23096
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23043
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99119/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23096
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99118/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23043
**[Test build #99119 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99119/testReport)**
for PR 23043 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23096
**[Test build #99118 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99118/testReport)**
for PR 23096 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23105
**[Test build #99129 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99129/testReport)**
for PR 23105 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23080
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99117/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23080
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23080
**[Test build #99117 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99117/testReport)**
for PR 23080 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23105
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23105
**[Test build #99128 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99128/testReport)**
for PR 23105 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23105#discussion_r235420647
--- Diff:
core/src/main/scala/org/apache/spark/executor/ShuffleReadMetrics.scala ---
@@ -122,34 +123,3 @@ class ShuffleReadMetrics private[spark] () extends
GitHub user rxin opened a pull request:
https://github.com/apache/spark/pull/23105
[SPARK-26140] Pull TempShuffleReadMetrics creation out of shuffle reader
## What changes were proposed in this pull request?
This patch defines an internal Spark interface for reporting shuffle
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/23098#discussion_r235418193
--- Diff: bin/load-spark-env.cmd ---
@@ -21,37 +21,42 @@ rem This script loads spark-env.cmd if it exists, and
ensures it is only loaded
rem
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/22305#discussion_r235417425
--- Diff: python/pyspark/worker.py ---
@@ -154,6 +154,47 @@ def wrapped(*series):
return lambda *a: (wrapped(*a), arrow_return_type)
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23052
Also, it's not always for Parquet to write empty files. That does not write
empty files when data frames are created from emptyRDD (the one pointed out in
the PR link I gave). We should match
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23101
LGTM2
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
301 - 400 of 604 matches
Mail list logo