Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22994
**[Test build #98790 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98790/testReport)**
for PR 22994 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22994
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98790/
Test PASSed.
---
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22962#discussion_r233275410
--- Diff: python/pyspark/taskcontext.py ---
@@ -147,8 +147,8 @@ def __init__(self):
@classmethod
def _getOrCreate(cls):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #98805 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98805/testReport)**
for PR 22504 at commit
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23027
**[Test build #98806 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98806/testReport)**
for PR 23027 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21957#discussion_r233287374
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -269,7 +269,8 @@ case class FileSourceScanExec(
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/23012
Hey shane I donât think we are saying to test multiple R version at all.
In fact quite the opposite, just the new(er) version at some point in the
future.
(We donât have a better
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23017
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98787/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5006/
---
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r233254497
--- Diff:
core/src/main/scala/org/apache/spark/executor/ProcfsBasedSystems.scala ---
@@ -0,0 +1,266 @@
+/*
+ * Licensed to the Apache Software
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22760#discussion_r233266609
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/HadoopConfExecutorFeatureStepSuite.scala
---
@@ -0,0 +1,68
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
**[Test build #98795 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98795/testReport)**
for PR 23019 at commit
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/23004#discussion_r233272718
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -237,6 +237,13 @@ case class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23009
**[Test build #98801 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98801/testReport)**
for PR 23009 at commit
GitHub user wangyum opened a pull request:
https://github.com/apache/spark/pull/23027
[SPARK-26049][SQL][TEST] Add InMemoryTable filter benchmark to
FilterPushdownBenchmark
## What changes were proposed in this pull request?
Add InMemoryTable filter benchmark to
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/23021
One thing - I would put âpandasâ right after test_ so you get the
natural
logical grouping with sorting by file name.
On Tue, Nov 13, 2018 at 4:58 PM Hyukjin Kwon
wrote:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98797/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23019
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23024
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98800/
Test PASSed.
---
GitHub user NiharS opened a pull request:
https://github.com/apache/spark/pull/23026
[SPARK-25960][k8s] Support subpath mounting with Kubernetes
## What changes were proposed in this pull request?
This PR adds configurations to use subpaths with Spark on k8s. Subpaths
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23023
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22760#discussion_r233257218
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/HadoopConfExecutorFeatureStepSuite.scala
---
@@ -0,0 +1,68
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23023
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98794/
Test PASSed.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23021
Yup, will break pandas one into smaller ones as well.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23024
**[Test build #98800 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98800/testReport)**
for PR 23024 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23024
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22962
@HyukjinKwon No problem, I'll give a follow up PR to address all your
comments and rewrite the UT in to a separate class.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23021
**[Test build #98808 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98808/testReport)**
for PR 23021 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23012
@shaneknapp, do you roughly know how difficult it is (and do you have some
time shortly) to upgrade R from 3.1 to 3.4? I am asking this because I had some
difficulties when I tried to manually
Github user shanyu commented on the issue:
https://github.com/apache/spark/pull/23009
thanks @vanzin! Yes you are right this only affects Yarn mode, and
duplicates should be taken cared by Yarn. Title and description updated as
suggested by you.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23026
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23026
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23026
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23019
**[Test build #98789 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98789/testReport)**
for PR 23019 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21957
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21957
**[Test build #98788 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98788/testReport)**
for PR 21957 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21957
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98788/
Test FAILed.
---
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r233255758
--- Diff:
core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala ---
@@ -19,18 +19,31 @@ package org.apache.spark.metrics
import
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/23021#discussion_r233269827
--- Diff: python/pyspark/testing/sqlutils.py ---
@@ -0,0 +1,268 @@
+#
--- End diff --
Yea, similar thought. One thing is though testing
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #98799 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98799/testReport)**
for PR 22504 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22967
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23024
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98798/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23024
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23021
Yup!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22994
I haven't taken a look super closely but the idea looks itself okay. Is it
urgent? if yes, yup. I don't object to go ahead right away. Otherwise, might be
good to leave open for few days for
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23021
> Could you add some descriptions to run a single test file or a single
test case if exists?
Done!
---
-
To
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22994
nah, it's not urgent at all.
i also tested this locally by breaking various python scripts and
confirming that it caught errors as expected.
On Tue, Nov 13, 2018 at 5:03 PM
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22880
**[Test build #98791 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98791/testReport)**
for PR 22880 at commit
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r233250143
--- Diff:
core/src/main/scala/org/apache/spark/executor/ProcfsBasedSystems.scala ---
@@ -0,0 +1,222 @@
+/*
+ * Licensed to the Apache Software
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23023
**[Test build #98794 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98794/testReport)**
for PR 23023 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98799/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23024
**[Test build #98798 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98798/testReport)**
for PR 23024 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23021
adding @icexelloss as well.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23028
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23028
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23027
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23027
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98806/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98807/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/23029
[SPARK-26055][CORE] InterfaceStability annotations should be retained at
runtime
## What changes were proposed in this pull request?
It's good to have annotations available at runtime,
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23029
cc @rxin @srowen @vanzin @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22976
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23029
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22966
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23029
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22966
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22966
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98811/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22966
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22966
**[Test build #98811 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98811/testReport)**
for PR 22966 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22967
**[Test build #98813 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98813/testReport)**
for PR 22967 at commit
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22967
@dongjoon-hyun thanks for trigging the build. The python test script was
only looking for scala 2.11 jars resulting python test failures. I just fixed
it in the latest push. Let's see how it goes.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23021
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98808/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23021
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23021
**[Test build #98808 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98808/testReport)**
for PR 23021 at commit
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/22966
@dongjoon-hyun sure.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23029
**[Test build #98810 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98810/testReport)**
for PR 23029 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22967
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22967
**[Test build #98807 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98807/testReport)**
for PR 22967 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/23029#discussion_r233322079
--- Diff:
common/tags/src/main/java/org/apache/spark/annotation/InterfaceStability.java
---
@@ -17,7 +17,7 @@
package
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22967
**[Test build #98812 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98812/testReport)**
for PR 22967 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23028
**[Test build #98809 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98809/testReport)**
for PR 23028 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23028
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23028
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98809/
Test FAILed.
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23021
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/22967#discussion_r22593
--- Diff: pom.xml ---
@@ -2718,7 +2710,6 @@
*:*_2.11
-
GitHub user wangyum opened a pull request:
https://github.com/apache/spark/pull/23028
[SPARK-26053][SQL] Enhance LikeSimplification
## What changes were proposed in this pull request?
This PR enhance `LikeSimplification` in 2 cases:
1. null like col -> null
2.
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22989#discussion_r233318346
--- Diff: dev/checkstyle.xml ---
@@ -180,5 +180,10 @@
+
+
+
--- End
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/23021
I am merging this in - maybe I am rushing it but please allow me to go
ahead since it's going to block other PySpark PRs.
At worst case, I am willing to revert and propose this again if
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23027
**[Test build #98806 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98806/testReport)**
for PR 23027 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #98805 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98805/testReport)**
for PR 22504 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98805/
Test PASSed.
---
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/23028#discussion_r233317201
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala
---
@@ -504,6 +504,19 @@ object LikeSimplification extends
301 - 400 of 511 matches
Mail list logo
