Github user ConeyLiu commented on the issue:
https://github.com/apache/spark/pull/19511
Hi, @cloud-fan @gatorsmile. Would you mind take a look?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19511
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user ConeyLiu opened a pull request:
https://github.com/apache/spark/pull/19511
[SPARK-22293][SQL] Avoid unnecessary traversal in ResolveReferences
## What changes were proposed in this pull request?
We don't need traverse the children expression to determine whether
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18664#discussion_r145037361
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/arrow/ArrowWriter.scala
---
@@ -55,6 +55,12 @@ object ArrowWriter {
case (Double
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18664#discussion_r145036404
--- Diff: python/pyspark/sql/types.py ---
@@ -1619,11 +1619,38 @@ def to_arrow_type(dt):
arrow_type = pa.decimal(dt.precision, dt.scale)
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19370#discussion_r145039851
--- Diff: bin/find-spark-home.cmd ---
@@ -0,0 +1,44 @@
+@echo off
+
+rem
+rem Licensed to the Apache Software Foundation (ASF) under one
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145039356
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) fo
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19476
**[Test build #82833 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82833/testReport)**
for PR 19476 at commit
[`bba8ea1`](https://github.com/apache/spark/commit/bb
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145035994
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) fo
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/19508
I will check this on Wed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: revie
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19496#discussion_r145034923
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -2103,4 +2103,13 @@ class DataFrameSuite extends QueryTest with
Share
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19496#discussion_r145034645
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -2103,4 +2103,13 @@ class DataFrameSuite extends QueryTest with
Share
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145034007
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) for row
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19510
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user windkit opened a pull request:
https://github.com/apache/spark/pull/19510
[SPARK-22292][Mesos] Added spark.mem.max support for Mesos
## What changes were proposed in this pull request?
To limit the amount of resources a spark job accept from Mesos, currently
we
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82829/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82829 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82829/testReport)**
for PR 19269 at commit
[`416da98`](https://github.com/apache/spark/commit/4
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145032365
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) for row
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145032174
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) fo
Github user hhbyyh commented on the issue:
https://github.com/apache/spark/pull/17862
Please let me know if there's any unresolved comments. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145029289
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) fo
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18664
**[Test build #82832 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82832/testReport)**
for PR 18664 at commit
[`a3ba4ac`](https://github.com/apache/spark/commit/a3
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145029049
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) fo
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19505#discussion_r145027904
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFs.scala
---
@@ -137,11 +137,15 @@ object ExtractPythonUDFs extends R
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18747
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r145028238
--- Diff: python/pyspark/sql/session.py ---
@@ -414,6 +415,43 @@ def _createFromLocal(self, data, schema):
data = [schema.toInternal(row) fo
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19505
**[Test build #82831 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82831/testReport)**
for PR 19505 at commit
[`85f250d`](https://github.com/apache/spark/commit/85
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18747
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82830/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18747
**[Test build #82830 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82830/testReport)**
for PR 18747 at commit
[`34982c6`](https://github.com/apache/spark/commit/3
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19488
After I rethinking about it, non-determinstic expressions should not
qualify this rule. Please remove it. Thanks!
---
-
To un
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18747#discussion_r145026444
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala
---
@@ -23,21 +23,56 @@ import org.apache.spark.sql.cat
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18747#discussion_r145026389
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/ColumnarBatchScan.scala
---
@@ -19,10 +19,10 @@ package org.apache.spark.sql.execution
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18747#discussion_r145026383
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/ColumnarBatchScan.scala
---
@@ -84,6 +82,7 @@ private[sql] trait ColumnarBatchScan extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19363
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19363
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82828/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19363
**[Test build #82828 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82828/testReport)**
for PR 19363 at commit
[`955e3c9`](https://github.com/apache/spark/commit/9
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18664#discussion_r145024991
--- Diff: python/pyspark/sql/tests.py ---
@@ -3383,6 +3403,42 @@ def test_vectorized_udf_varargs(self):
res = df.select(f(col('id')))
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19488#discussion_r145025165
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala
---
@@ -205,14 +205,17 @@ object PhysicalAggregation {
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19505#discussion_r145012436
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFs.scala
---
@@ -137,11 +137,15 @@ object ExtractPythonUDFs exte
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19509
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82825/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19509
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19509
**[Test build #82825 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82825/testReport)**
for PR 19509 at commit
[`95a9658`](https://github.com/apache/spark/commit/9
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18747
**[Test build #82830 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82830/testReport)**
for PR 18747 at commit
[`34982c6`](https://github.com/apache/spark/commit/34
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82829 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82829/testReport)**
for PR 19269 at commit
[`416da98`](https://github.com/apache/spark/commit/41
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19269#discussion_r145018796
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/sources/v2/SimpleWritableDataSource.scala
---
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Ap
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19269#discussion_r145017823
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/sources/v2/SimpleWritableDataSource.scala
---
@@ -0,0 +1,254 @@
+/*
+ * Licensed to the Ap
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19363
LGTM, pending jenkins
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: revie
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19488#discussion_r145017429
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala
---
@@ -205,14 +205,17 @@ object PhysicalAggregation {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19439
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19439
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82827/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19439
**[Test build #82827 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82827/testReport)**
for PR 19439 at commit
[`697585f`](https://github.com/apache/spark/commit/6
Github user caneGuy commented on the issue:
https://github.com/apache/spark/pull/19482
Okï¼thanks @vanzin
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-
Github user caneGuy closed the pull request at:
https://github.com/apache/spark/pull/19482
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145013312
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -653,15 +663,34 @@ private[spark] class BlockManager(
require(bl
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145013046
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -653,15 +663,34 @@ private[spark] class BlockManager(
require(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18664
**[Test build #82826 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82826/testReport)**
for PR 18664 at commit
[`9894519`](https://github.com/apache/spark/commit/9
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18664
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82826/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18664
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145011923
--- Diff:
core/src/test/scala/org/apache/spark/storage/BlockManagerSuite.scala ---
@@ -509,11 +508,10 @@ class BlockManagerSuite extends SparkFunSuite wit
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145011775
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -684,7 +713,7 @@ private[spark] class BlockManager(
// tak
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19363
**[Test build #82828 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82828/testReport)**
for PR 19363 at commit
[`955e3c9`](https://github.com/apache/spark/commit/95
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145010440
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -653,15 +663,34 @@ private[spark] class BlockManager(
require(bl
Github user ArtRand commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r145010250
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
---
@@ -469,6 +474,12 @@ trait MesosSch
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19495
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19495
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82823/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19499
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19495
**[Test build #82823 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82823/testReport)**
for PR 19495 at commit
[`2f35889`](https://github.com/apache/spark/commit/2
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19499
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82824/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19499
**[Test build #82824 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82824/testReport)**
for PR 19499 at commit
[`cf7edbb`](https://github.com/apache/spark/commit/c
Github user ArtRand commented on a diff in the pull request:
https://github.com/apache/spark/pull/19390#discussion_r145009696
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -380,7 +389,8 @@
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19488
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82821/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19488
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145009567
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -662,7 +662,9 @@ private[spark] object SparkConf extends Logging {
"spark.ya
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19488
**[Test build #82821 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82821/testReport)**
for PR 19488 at commit
[`6159dcc`](https://github.com/apache/spark/commit/6
Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145009167
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -653,15 +663,34 @@ private[spark] class BlockManager(
require(bl
Github user WeichenXu123 commented on the issue:
https://github.com/apache/spark/pull/19381
cc @jkbradley @yanboliang thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19497
Thank you @mridulm. I regret that I raised this here, causing confusion.
Let's talk more in another place. I will cc you (and @jiangxb1987) when I
happened to file up a JIRA or see similar issue
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19439
**[Test build #82827 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82827/testReport)**
for PR 19439 at commit
[`697585f`](https://github.com/apache/spark/commit/69
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19439
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: review
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19439#discussion_r145007975
--- Diff: python/pyspark/ml/image.py ---
@@ -0,0 +1,129 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contri
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19497
@HyukjinKwon Thanks for clarifying.
The way I look at it is:
`saveAsHadoopFile` is explicitly referring to `Output the RDD to any
Hadoop-supported file system` in its description (and na
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19495
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19495
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82820/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19495
**[Test build #82820 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82820/testReport)**
for PR 19495 at commit
[`52deee7`](https://github.com/apache/spark/commit/5
Github user idlecool commented on the issue:
https://github.com/apache/spark/pull/14321
Hi @sethah, any plans to work on it again?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional com
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19509
**[Test build #82825 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82825/testReport)**
for PR 19509 at commit
[`95a9658`](https://github.com/apache/spark/commit/95
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18664
**[Test build #82826 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82826/testReport)**
for PR 18664 at commit
[`9894519`](https://github.com/apache/spark/commit/98
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/19509
[SPARK-22290][core] Avoid creating Hive delegation tokens when not
necessary.
Hive delegation tokens are only needed when the Spark driver has no access
to the kerberos TGT. That happens only in
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19451#discussion_r144997755
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/ReplaceExceptWithFilter.scala
---
@@ -0,0 +1,73 @@
+/*
+ * License
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19497
I agree this was focussed more on the regression introduced and it should
be good enough already, and I am talking about a different thing for behaviour
change.
Let me organise my idea
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19452
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82819/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19452
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19452
**[Test build #82819 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82819/testReport)**
for PR 19452 at commit
[`23db42c`](https://github.com/apache/spark/commit/2
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19499
**[Test build #82824 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82824/testReport)**
for PR 19499 at commit
[`cf7edbb`](https://github.com/apache/spark/commit/cf
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/19500
Thank you so much, @gatorsmile and @wzhfy . :D
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For addit
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/18664#discussion_r144994750
--- Diff: python/pyspark/sql/tests.py ---
@@ -3086,18 +3086,35 @@ class ArrowTests(ReusedPySparkTestCase):
@classmethod
def setUp
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19439
**[Test build #82822 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82822/testReport)**
for PR 19439 at commit
[`697585f`](https://github.com/apache/spark/commit/6
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19439
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82822/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19439
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
1 - 100 of 470 matches
Mail list logo