Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20908
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94697/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20908
**[Test build #94697 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94697/testReport)**
for PR 20908 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22079
**[Test build #94701 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94701/testReport)**
for PR 22079 at commit
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r209707290
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -60,14 +61,20 @@ private[spark] object PythonEvalType {
*/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21146
**[Test build #94702 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94702/testReport)**
for PR 21146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20908
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94698/
Test PASSed.
---
Github user tnachen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22071#discussion_r209714362
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/MesosClusterDispatcher.scala
---
@@ -51,6 +51,13 @@ private[mesos] class
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/22081
I've just pushed up my PR which is ~ in sync with this one; I'll close that
one now and this can be the one to use.
Assume: kinesis uses bouncy castle somewhere. There's some hints
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/21939
>Do you mean we will upgrade arrow to 0.10.0 at java side, but leave the
python side as it is? So people can still use PySpark with pyarrow 0.8.0 and
python 3.4? If they go with arrow 0.10.0
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/22001
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21912
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94691/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21912
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/22071#discussion_r209747074
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/MesosClusterDispatcher.scala
---
@@ -51,6 +51,13 @@ private[mesos] class
Github user abellina commented on the issue:
https://github.com/apache/spark/pull/22025
@HyukjinKwon I have updated the description. Thanks for the comment.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22096
**[Test build #94709 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94709/testReport)**
for PR 22096 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21451
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22024
test this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22094
**[Test build #94694 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94694/testReport)**
for PR 22094 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94694/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20908
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/22079#discussion_r209705612
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/execution/RecordBinaryComparator.java
---
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the
Github user zsxwing closed the pull request at:
https://github.com/apache/spark/pull/22072
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20908
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20908
**[Test build #94698 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94698/testReport)**
for PR 20908 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22036
**[Test build #94693 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94693/testReport)**
for PR 22036 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21859
**[Test build #94688 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94688/testReport)**
for PR 21859 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22095
**[Test build #94707 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94707/testReport)**
for PR 22095 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22095
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2148/
---
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21978
@cloud-fan, on the dev thread about 2.4 you talked about getting this PR
in. What do we need to do next?
I can call a vote on the SPIP if you think that's ready. I just bumped the
thread.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22024
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22024
**[Test build #94696 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94696/testReport)**
for PR 22024 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22079
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22079
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94701/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22084
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22084
**[Test build #94700 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94700/testReport)**
for PR 22084 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22084
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r209703555
--- Diff: python/pyspark/worker.py ---
@@ -259,6 +260,26 @@ def main(infile, outfile):
"PYSPARK_DRIVER_PYTHON are correctly
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/19045
Chatted with some K8s folks and I'll revive this PR with that in mind.
---
-
To unsubscribe, e-mail:
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r209703452
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
---
@@ -91,6 +91,13 @@ private[spark] class Client(
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21221#discussion_r209712159
--- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala
---
@@ -180,6 +180,26 @@ private[spark] abstract class MemoryManager(
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21221#discussion_r209717523
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -669,6 +686,31 @@ private[spark] class AppStatusListener(
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21221#discussion_r209714883
--- Diff:
core/src/main/scala/org/apache/spark/executor/ExecutorMetrics.scala ---
@@ -0,0 +1,81 @@
+/*
+ * Licensed to the Apache Software
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21221#discussion_r209716819
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -669,6 +686,31 @@ private[spark] class AppStatusListener(
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21221#discussion_r209714796
--- Diff:
core/src/main/scala/org/apache/spark/executor/ExecutorMetrics.scala ---
@@ -0,0 +1,81 @@
+/*
+ * Licensed to the Apache Software
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21221#discussion_r209715208
--- Diff:
core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala ---
@@ -0,0 +1,104 @@
+/*
+ * Licensed to the Apache Software
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21221#discussion_r209715001
--- Diff: core/src/main/scala/org/apache/spark/memory/MemoryManager.scala
---
@@ -180,6 +180,26 @@ private[spark] abstract class MemoryManager(
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/21732
Yeah. The encoding rules regarding `Option` are:
1. For non `Product` types, no change is made.
```
Option[Int] in normal encoder -> a nullable int column
Option[Int] in agg
Github user markhamstra commented on the issue:
https://github.com/apache/spark/pull/21698
> I really disagree with this.
I really agree with Tom. At this point, I think the working assumption
should be that any 2.4.0 release candidate that doesn't deliver some fix for
this
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22079#discussion_r209731698
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala ---
@@ -144,7 +144,7 @@ object ChiSqSelectorModel extends
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/22061
Ok, make sense. Thanks @shaneknapp !
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22001
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22001
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22078
**[Test build #94692 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94692/testReport)**
for PR 22078 at commit
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22071#discussion_r209743967
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/MesosClusterDispatcher.scala
---
@@ -51,6 +51,13 @@ private[mesos] class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22071
**[Test build #94706 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94706/testReport)**
for PR 22071 at commit
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/22010
@HyukjinKwon sure, I'll do a micro benchmark sometime this week.
---
-
To unsubscribe, e-mail:
GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/22094
Avro serializer match
## What changes were proposed in this pull request?
With code changes in https://github.com/apache/spark/pull/21847 , Spark can
write out to Avro file as per
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22094
**[Test build #94694 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94694/testReport)**
for PR 22094 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20908
**[Test build #94697 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94697/testReport)**
for PR 20908 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22024
**[Test build #94696 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94696/testReport)**
for PR 22024 at commit
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21819#discussion_r209699459
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/JsonUtils.scala
---
@@ -95,4 +95,20 @@ private object JsonUtils {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94690/
Test FAILed.
---
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22048
@xuejianbest Could you please create a JIRA entry and add test cases to
this PR?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22009
**[Test build #94690 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94690/testReport)**
for PR 22009 at commit
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r209702097
--- Diff: python/pyspark/worker.py ---
@@ -259,6 +260,26 @@ def main(infile, outfile):
"PYSPARK_DRIVER_PYTHON are correctly
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r209702134
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/streaming/StreamingReadSupport.java
---
@@ -0,0 +1,49 @@
+/*
+ *
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r209712363
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/BatchWriteSupportProvider.java
---
@@ -21,33 +21,39 @@
import
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20541
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r209726516
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala
---
@@ -76,41 +76,43 @@ object
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21912
**[Test build #94691 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94691/testReport)**
for PR 21912 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22071
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22024
@vincent-grosbois do you have some benchmark or profiling on this change?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22071
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22095
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22095
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2148/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22095
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user TomaszGaweda commented on a diff in the pull request:
https://github.com/apache/spark/pull/22063#discussion_r209713521
--- Diff: project/MimaExcludes.scala ---
@@ -36,6 +36,11 @@ object MimaExcludes {
// Exclude rules for 2.4.x
lazy val v24excludes =
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22096
[MINOR][SQL][DOC] Fix `to_json` example in function description and doc
## What changes were proposed in this pull request?
This PR fixes the an example for `to_json` in doc and
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22084#discussion_r209696613
--- Diff: dev/make-distribution.sh ---
@@ -188,6 +190,23 @@ if [ -f
"$SPARK_HOME"/common/network-yarn/target/scala*/spark-*-yarn-shuffle.jar
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20908
**[Test build #94698 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94698/testReport)**
for PR 20908 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20908
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20908
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r209699841
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/SessionConfigSupport.java
---
@@ -27,10 +27,10 @@
@InterfaceStability.Evolving
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21819
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21819
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94699/
Test FAILed.
---
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r209708483
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/BatchWriteSupportProvider.java
---
@@ -21,33 +21,39 @@
import
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21819
**[Test build #94699 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94699/testReport)**
for PR 21819 at commit
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22061
also, i'll be taking the ubuntu-testing worker offline today to wipe and do
a fresh install of conda w/python3.5.
---
-
To
Github user bersprockets commented on a diff in the pull request:
https://github.com/apache/spark/pull/22079#discussion_r209736691
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala ---
@@ -144,7 +144,7 @@ object ChiSqSelectorModel extends
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/22095
@holdenk @felixcheung small change to separate from SparkR PR. Ready for
merge
---
-
To unsubscribe, e-mail:
1 - 100 of 633 matches
Mail list logo
